-- Logs begin at Tue 2022-10-04 19:25:28 UTC, end at Tue 2022-10-04 23:13:11 UTC. -- Oct 04 20:18:43.077035 n-d-851029-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:18:43.085355 n-d-851029-13 devstack@n-api.service[107357]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:18:43 2022] *** Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: nodename: n-d-851029-13 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: machine: x86_64 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: clock source: unix Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: pcre jit disabled Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: detected number of CPU cores: 4 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: current working directory: / Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: your processes number limit is 47680 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: your memory page size is 4096 bytes Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: detected max file descriptor number: 2048 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: lock engine: pthread robust mutexes Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: thunder lock: enabled Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:18:43.094878 n-d-851029-13 devstack@n-api.service[107357]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:18:43.129654 n-d-851029-13 devstack@n-api.service[107357]: Python main interpreter initialized at 0x5600c31459c0 Oct 04 20:18:43.129654 n-d-851029-13 devstack@n-api.service[107357]: python threads support enabled Oct 04 20:18:43.129654 n-d-851029-13 devstack@n-api.service[107357]: your server socket listen backlog is limited to 100 connections Oct 04 20:18:43.129654 n-d-851029-13 devstack@n-api.service[107357]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:18:43.130068 n-d-851029-13 devstack@n-api.service[107357]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:18:43.130068 n-d-851029-13 devstack@n-api.service[107357]: *** Operational MODE: preforking *** Oct 04 20:18:43.130356 n-d-851029-13 devstack@n-api.service[107357]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:18:43.130356 n-d-851029-13 devstack@n-api.service[107357]: spawned uWSGI master process (pid: 107357) Oct 04 20:18:43.130572 n-d-851029-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:18:43.134704 n-d-851029-13 devstack@n-api.service[107357]: spawned uWSGI worker 1 (pid: 107358, cores: 1) Oct 04 20:18:43.134704 n-d-851029-13 devstack@n-api.service[107357]: spawned uWSGI worker 2 (pid: 107359, cores: 1) Oct 04 20:18:43.134704 n-d-851029-13 devstack@n-api.service[107357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:18:43.790911 n-d-851029-13 devstack@n-api.service[107359]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:18:43.805076 n-d-851029-13 devstack@n-api.service[107358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:18:44.873639 n-d-851029-13 devstack@n-api.service[107359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:44.873639 n-d-851029-13 devstack@n-api.service[107359]: from cryptography.utils import int_from_bytes Oct 04 20:18:44.874244 n-d-851029-13 devstack@n-api.service[107359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:44.874244 n-d-851029-13 devstack@n-api.service[107359]: from cryptography.utils import int_from_bytes Oct 04 20:18:44.887550 n-d-851029-13 devstack@n-api.service[107358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:44.887550 n-d-851029-13 devstack@n-api.service[107358]: from cryptography.utils import int_from_bytes Oct 04 20:18:44.888217 n-d-851029-13 devstack@n-api.service[107358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:18:44.888217 n-d-851029-13 devstack@n-api.service[107358]: from cryptography.utils import int_from_bytes Oct 04 20:18:47.483768 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:18:47.484811 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:18:47.484811 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:18:47.485019 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:18:47.485194 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:18:47.485586 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.485930 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.486246 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.486568 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.486792 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:18:47.487422 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.487573 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:18:47.487713 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.487713 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.487959 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:18:47.488078 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.488197 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:18:47.488349 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.488477 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:18:47.488622 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.488754 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.488887 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.489021 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.489180 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851029-13 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.489301 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.489443 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.489878 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490043 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490193 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490306 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490431 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490542 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.490839 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491058 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491268 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491475 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491673 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491879 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.491879 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.492737 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.492954 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.493134 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.493308 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851029-13 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.493498 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.493498 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.493840 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.494084 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.494279 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.494477 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.494697 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.494883 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.495103 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.495304 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.495505 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.495708 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.495845 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496049 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496218 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496367 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851029-13 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496493 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496628 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496628 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.496913 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.497064 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.497419 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.497639 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.497832 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.498037 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.498236 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.498443 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.498647 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.498886 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.499088 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.499292 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.499503 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.499706 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.499911 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500117 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500318 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500538 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500745 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500952 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.500952 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.501347 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.501549 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.501549 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.501549 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.502106 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.502323 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.502527 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851029-13 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.502782 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.502977 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503195 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503393 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503600 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503797 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503998 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.503998 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.504492 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.504693 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.504905 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505116 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505318 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505525 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505725 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505923 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.505923 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.506319 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.506527 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.506777 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.506986 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.507188 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.507412 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.507412 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.507972 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.508694 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.508899 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.509115 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.509315 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.509501 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.509716 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.509922 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.510128 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.510335 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.510521 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.510751 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.510978 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.511185 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.511377 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.511583 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.511784 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.511965 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.512179 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.512179 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.512558 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.512558 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.512927 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.513122 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.513328 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.513513 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.513719 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.513719 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.514099 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.514311 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.514505 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.514727 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.514942 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.515154 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.515351 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.515560 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.515751 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.515929 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516131 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516326 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516533 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516533 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516905 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.516905 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.517389 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.517598 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.517952 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.517952 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.518321 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.518503 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.518741 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.518960 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.519182 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.519383 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.519574 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.519766 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.519974 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.520180 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.520387 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.520572 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.520760 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.520945 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.521135 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.521320 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.521531 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.521730 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.521936 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.522131 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.522333 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.522528 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.522777 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.522988 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.523180 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.523374 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.523577 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.523787 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.523997 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.524190 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.524396 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.524590 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.524790 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525003 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525201 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525417 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525608 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525796 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.525988 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.526204 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.526401 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.526592 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.526845 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.527054 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.527262 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.527479 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.527676 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.527905 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.528220 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.528428 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.528633 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.528845 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529027 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529211 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529402 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529600 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529793 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.529949 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.530130 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.530330 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.530493 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.530751 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.530941 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531107 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531273 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531436 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531631 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531812 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.531995 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.532172 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.532337 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.532915 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533093 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533256 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533436 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533602 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533779 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.533941 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534102 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534281 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534444 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534604 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534813 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.534987 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535161 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535336 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535336 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535656 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535818 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.535988 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536162 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536341 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536341 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536668 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536832 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536988 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.536988 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.537316 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.537496 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.537672 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.537672 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.537981 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.538171 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.538445 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.538621 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.538851 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.539569 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.539740 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.539916 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.540185 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.540351 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.540524 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.540702 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.540873 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.541047 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.541210 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.541373 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.541540 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.541720 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.541885 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.542063 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.542244 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.542409 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.542572 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.542751 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.542930 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.543106 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.543384 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.543549 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.543722 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.543886 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.544060 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.544239 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.544402 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.544562 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.544723 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.544885 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.545058 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.545221 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.545386 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.545562 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.545736 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.545901 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.546086 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.546276 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:18:47.546496 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.546718 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.546913 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.547109 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.547319 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.547499 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.547706 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.547920 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.548131 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.548326 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.548656 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.548847 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.549048 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.549240 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.549451 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.549664 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.549883 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.550083 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.550275 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.550466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.550685 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.550883 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.551104 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.551314 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.551495 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.551694 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.551895 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.552109 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.552317 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.552520 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.552717 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.552895 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553063 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553256 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553435 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553610 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553777 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.553960 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.554149 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.554337 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.554530 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.555398 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.555586 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.555754 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.555914 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.556105 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.556308 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.556497 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.556689 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.556858 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.557038 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.557231 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.557554 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.557554 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.557911 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.558098 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.558288 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.558464 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.558724 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.559037 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.559240 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.559437 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.559665 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.559871 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.560061 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.560253 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.560453 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.560650 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.560870 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.561077 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.561272 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.561461 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.561656 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.561862 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.562062 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.562266 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.562476 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.562710 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.562927 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.563141 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.563348 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.563537 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.563745 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.563946 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.564147 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.564354 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.564546 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.564734 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.564920 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.565093 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.565273 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.565468 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.565643 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.565822 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.566024 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.566205 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.566390 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.566593 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.566809 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.567012 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.567210 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.567422 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.567641 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.567830 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.568023 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.568220 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.568220 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.568615 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.568923 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.569779 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.569962 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.570147 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.570338 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.570522 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.570755 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.570929 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571116 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571291 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571454 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571618 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571799 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.571971 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.572142 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.572328 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.572524 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.572742 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.572742 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.573104 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.573291 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.573479 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.573666 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.573873 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.574061 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.574249 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.574430 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.574607 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.574805 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.575016 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.576149 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.576332 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.576526 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.576721 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.576721 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.577113 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.577317 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.577509 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.577699 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.577915 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.578120 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.578327 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.578538 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.578865 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.579068 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.579271 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.579464 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.579688 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.580010 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.580204 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.580409 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.580620 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.580820 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.581021 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.581217 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.581404 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.581609 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.581824 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.582022 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.582230 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.582426 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.582618 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.582848 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.583038 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.583229 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.583415 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.583605 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.583805 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.584018 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.584218 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.584417 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.584614 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.584812 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.585088 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.585294 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.585492 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.585701 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.585901 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.586115 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.586384 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.586585 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.586793 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.586977 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587155 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587356 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587582 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587785 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587992 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.587992 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.588345 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.588529 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.588725 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.588918 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.589124 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.589314 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.589518 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.589715 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.589946 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.590219 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.590404 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.590595 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.590806 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.590993 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.591195 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.591386 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.591578 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.591778 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.591989 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.592210 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.592404 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.592404 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.592769 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.592970 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.593184 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.593392 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.593587 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.593789 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.593986 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.594250 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.594446 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.594649 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.594932 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.595126 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.595318 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.595497 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.595690 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.595903 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.596094 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.596285 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.596528 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.596719 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.596911 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.597112 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.597299 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.597483 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.597677 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.597868 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.598075 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.598281 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.598475 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.598706 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.598898 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.599104 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.599311 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.599515 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.599705 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.599907 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.600101 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.600405 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.600615 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.600805 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.600996 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.601197 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.601390 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.602100 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.602308 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.602512 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.602762 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.602995 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.603186 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.603428 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.603688 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.603889 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.604085 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.604284 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.604494 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.604705 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.604919 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.605112 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.605301 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.605483 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.605671 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.605906 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.606194 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.606387 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.606588 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.606882 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.607080 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.607291 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.607491 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.607677 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.607864 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608058 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608259 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608567 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608765 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608957 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.608957 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.609330 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.609532 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.609722 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.609908 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.610092 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.610289 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.610621 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.610859 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611041 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611216 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611399 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611586 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611771 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.611972 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.612173 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.612361 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.612553 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.612745 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.612930 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.613126 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.613313 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.613502 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.613687 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.613877 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.614091 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.614291 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.614491 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.614726 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.614937 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.615130 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.615341 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.615538 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.615746 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.615939 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.616128 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.616341 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.616554 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.616749 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.616957 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.617289 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.617991 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.618191 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.618528 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.618772 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.618973 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.619169 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.619372 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.619581 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.619782 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.619976 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.620175 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.620383 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.620603 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.620915 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.621111 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.621310 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.621513 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.621513 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.621881 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.622097 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.622303 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.622492 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.622719 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.622939 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.623136 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.623356 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.623548 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.623755 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.623960 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.624150 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.624361 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.624574 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.624789 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.624973 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.625167 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.625369 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.625564 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.625779 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.625987 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.626182 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.626378 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.626588 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.626820 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.627034 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.627230 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.627430 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.627631 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.627829 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.628017 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.628227 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.628425 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.628625 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.628863 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.629060 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.629251 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.629452 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.629640 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.629828 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.630019 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.630210 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.630417 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.630607 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.630900 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.631188 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.631383 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.631383 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.631762 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.631958 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.632148 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.632339 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.632528 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.632718 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.632986 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.633191 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.633191 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.633576 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.633790 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.633996 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.634196 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.634397 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.634579 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.634802 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.634983 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.635179 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.635365 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.635554 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.635554 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.635881 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.636063 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.636261 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.636440 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.636629 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.636818 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.637002 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.637206 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.637412 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.637618 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.637812 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.638009 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.638205 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.638205 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.638578 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.638852 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.639053 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.639249 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.639448 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.639701 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.639901 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.640218 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.640427 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.640629 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.640820 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.641013 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.641232 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.641548 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.641746 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.641938 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.642115 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.642305 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.642524 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.642768 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.642972 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.643172 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.643355 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.643567 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.643780 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.643972 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.644157 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.644354 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.644552 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.644773 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.644992 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.645195 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.645389 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.645587 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.645791 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.645984 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.646200 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.646402 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.646597 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.646837 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.647037 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.647254 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.647467 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.647670 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.647884 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.648080 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.648266 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.648506 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.648705 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.648905 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.649103 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.649299 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.649500 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.649711 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.649917 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.650112 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.650305 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.650499 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.650721 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.650936 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.651148 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.651351 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.651566 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.651854 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.652066 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.652263 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.652470 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.652668 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.652861 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653038 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653237 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653418 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653605 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653793 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.653978 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.654156 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.654359 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.654556 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.654814 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.655012 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.655203 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.655397 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.655621 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.655816 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656004 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656191 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656388 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656580 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656768 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.656944 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.657127 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.657304 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.657747 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658006 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658201 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658392 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658392 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658789 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.658985 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.659212 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.659410 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.659608 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.659802 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660001 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660207 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660425 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660425 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660800 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.660995 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.661182 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.661386 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.661575 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.661775 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.662089 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.662299 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.662510 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.662778 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.662980 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.663179 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.663370 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.663569 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.663782 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.664515 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.664713 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.664915 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.665125 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.665323 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.665539 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.665762 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.665958 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.666148 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.666346 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.666555 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.666803 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667212 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667411 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667611 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667798 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.667999 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.668193 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.668375 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.668566 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.668760 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.668946 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.669146 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.669334 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.669527 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.669720 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.669919 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.670109 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.670314 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.670502 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.670726 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.670920 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.671111 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.671319 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.671509 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.671701 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.671901 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.672110 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.672392 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.672602 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.672799 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.672991 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.673182 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.673385 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.673576 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.673787 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.673981 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.674171 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.674362 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.674549 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.674757 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.674964 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.675155 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.675341 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.675530 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.675729 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.675927 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.676118 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.676303 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.676488 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.676689 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.676888 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.677113 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.677315 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.677507 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.677703 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.677894 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.678088 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.678397 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.678586 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.678839 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.679030 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.679239 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.679430 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.679655 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.680379 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.680581 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.680784 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.680976 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.681167 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.681378 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.681568 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.681768 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.681956 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.682154 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.682383 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.682704 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.682918 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.683109 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.683303 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.683498 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.683702 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.683882 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684064 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684250 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684424 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684424 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684783 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.684957 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685128 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685309 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685482 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685664 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685832 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.685832 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.686149 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.686315 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.686479 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.686712 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.686908 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.687120 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.687316 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.687512 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.687713 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.687926 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.688126 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.688336 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.688534 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.688738 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.688940 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.689148 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.689148 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.689522 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.689522 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.689900 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.690120 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.690321 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.690531 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.690766 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.690968 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691164 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691380 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691576 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691776 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691973 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.691973 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.692314 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.692519 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.692877 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.693071 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.693284 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.693484 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.693680 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.693896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.694089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.694289 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.694481 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.694706 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.694950 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.695156 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.695388 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.695594 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.695786 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.695786 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.696144 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.696336 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.696516 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.696720 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.696913 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.697111 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.697314 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.697510 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.697716 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.697716 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.698080 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.698281 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.698470 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.698684 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.698904 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.699095 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.699277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.699469 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.699660 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.699865 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.700068 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.700261 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.700452 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.700642 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.700832 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.701043 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.701245 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.701447 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.701640 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.701842 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.702034 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.702247 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.702437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.702640 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.702893 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.703182 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.703376 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.703597 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.703789 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.703978 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.704170 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.704352 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.704552 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.704758 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.704948 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.705140 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.705333 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.705527 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.705741 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.705933 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.706122 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.706312 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.706312 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.706710 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.706927 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.707121 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.707121 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.707500 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.707500 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.707857 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.708064 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.708253 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.708440 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.708644 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.708825 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709014 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709214 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709403 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709403 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709768 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.709956 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.710183 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.710551 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.710821 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.711039 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.711244 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.711432 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.711631 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.711823 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.712006 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.712195 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.712384 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.712585 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.712795 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.713000 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.713210 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.713449 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.713650 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.713842 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.714044 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.714044 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.714401 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.714600 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.714827 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715027 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715217 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715406 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715594 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715782 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.715982 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.716185 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.716185 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.716555 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.716735 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.716915 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.717103 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.717305 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.717496 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.717687 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.717875 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.718077 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.718268 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.718471 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.718682 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.718875 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.719065 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.719369 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.719581 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.719775 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.719969 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.720162 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.720351 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.720561 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.720860 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.721055 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.721248 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.721438 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.721628 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.721819 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.722019 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.722210 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.722409 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.722598 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.722893 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.723085 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.723287 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.723478 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.723667 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.723854 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724083 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724288 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724476 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724642 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724780 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724934 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.724934 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725203 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725353 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725500 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725639 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725776 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.725911 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.726070 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.726206 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.726338 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727000 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727141 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727279 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727438 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727579 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727714 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727861 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.727999 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728221 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728361 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728499 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728635 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728772 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.728910 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729065 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729203 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729341 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729478 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729614 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729761 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.729912 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730061 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730206 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730352 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730490 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730640 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730826 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.730966 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731120 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731120 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731382 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731538 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731684 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731821 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.731965 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732103 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732239 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732528 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732528 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732788 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.732925 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733075 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733212 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733350 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733499 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733499 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733763 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.733978 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734128 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734277 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734413 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734550 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734706 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.734969 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735121 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735258 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735393 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735528 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735676 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735814 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.735951 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736086 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736222 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736357 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736515 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736663 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736799 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.736799 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737072 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737209 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737358 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737496 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737643 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737778 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.737915 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738060 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738198 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738334 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738467 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738600 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738776 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.738929 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739067 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739201 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739339 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739481 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739628 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739798 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.739934 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740078 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740211 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740358 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740507 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740643 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740795 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.740931 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741068 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741203 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741451 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741601 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741747 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.741883 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.742034 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.742228 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.742228 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.742496 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743144 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743309 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743447 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743602 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743738 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.743876 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744011 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744011 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744263 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744411 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744547 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744684 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744819 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.744954 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745090 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745090 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745364 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745515 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745651 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745787 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.745937 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746085 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746220 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746366 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746504 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746790 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.746952 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747090 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747226 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747375 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747512 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747647 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747794 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.747943 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.748082 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.748398 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.748808 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.748950 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749106 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749245 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749385 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749524 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749659 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749795 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.749945 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750083 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750230 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750365 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750512 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750679 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750679 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.750948 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751083 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751083 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751344 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751493 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751629 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751763 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.751898 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752052 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752186 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752341 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752476 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752612 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752747 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.752882 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753017 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753166 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753304 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753442 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753582 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753718 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.753881 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754029 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754164 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754312 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754448 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754585 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754772 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.754908 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755055 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755208 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755342 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755489 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755640 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755794 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.755934 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756080 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756217 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756217 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756488 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756627 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756825 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.756965 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757119 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757274 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757422 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757618 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757793 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.757931 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758075 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758231 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758367 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758514 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758698 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758836 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.758976 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759131 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759268 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759409 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759547 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759681 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759828 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.759982 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760138 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760287 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760432 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760568 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760726 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.760873 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761020 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761171 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761366 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761521 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761674 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761824 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.761964 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762108 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762245 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762379 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762536 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762792 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.762948 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763088 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763225 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763376 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763513 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763649 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.763782 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764004 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764146 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764339 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764485 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764621 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764759 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.764759 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765022 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765176 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765312 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765452 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765592 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765735 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.765874 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766023 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766160 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766296 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766432 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766563 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766743 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.766882 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767018 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767151 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767302 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767302 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767579 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767716 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767852 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.767986 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768121 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768271 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768417 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768554 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768690 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768823 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.768959 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769223 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769374 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769526 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769674 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769813 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.769961 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770118 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770254 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770391 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770528 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770688 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770824 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.770973 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771111 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771250 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771451 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771602 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771759 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.771899 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772039 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772175 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772311 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772457 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772606 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772754 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.772889 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773025 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773170 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773312 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773489 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773632 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773770 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.773909 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774044 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774191 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774344 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.774482 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.775498 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.776466 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.777437 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.778408 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.779431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.780392 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.781277 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.782089 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.783216 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784013 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.784795 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.785380 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786171 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.786896 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.787665 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788445 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788445 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788445 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788445 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788839 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.788839 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.789670 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.789999 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.790348 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.790760 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.791030 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.791351 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.791794 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.792122 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.792455 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.792779 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.793101 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.793418 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.793733 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.794054 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.794374 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.794750 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.795086 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.795403 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.795733 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.796066 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.796426 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.796749 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.797140 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.797478 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.797800 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.798318 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.798738 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:18:47.798994 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:18:47.918066 n-d-851029-13 devstack@n-api.service[107358]: INFO dbcounter [None req-febc66fd-c235-413d-9836-17133c906077 None None] Registered counter for database nova_api Oct 04 20:18:47.939719 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_db.sqlalchemy.engines [None req-febc66fd-c235-413d-9836-17133c906077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:47.947223 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writer thread running {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:47.953695 n-d-851029-13 devstack@n-api.service[107359]: INFO dbcounter [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Registered counter for database nova_api Oct 04 20:18:47.975533 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_db.sqlalchemy.engines [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:47.983198 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writer thread running {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.006318 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.context [None req-febc66fd-c235-413d-9836-17133c906077 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=107358) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:18:48.010351 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:48.010936 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:48.012508 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:48.013225 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:48.013670 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:48.015749 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-febc66fd-c235-413d-9836-17133c906077 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:48.017739 n-d-851029-13 devstack@n-api.service[107358]: INFO dbcounter [None req-febc66fd-c235-413d-9836-17133c906077 None None] Registered counter for database nova_cell0 Oct 04 20:18:48.021857 n-d-851029-13 devstack@n-api.service[107358]: INFO dbcounter [None req-febc66fd-c235-413d-9836-17133c906077 None None] Registered counter for database nova_cell1 Oct 04 20:18:48.029710 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_db.sqlalchemy.engines [None req-febc66fd-c235-413d-9836-17133c906077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.031118 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_db.sqlalchemy.engines [None req-febc66fd-c235-413d-9836-17133c906077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.037982 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writer thread running {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.039932 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writer thread running {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.040973 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.context [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=107359) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:18:48.044962 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:48.045435 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:48.047047 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:48.047777 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:48.048226 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:48.050226 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_concurrency.lockutils [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:48.052293 n-d-851029-13 devstack@n-api.service[107359]: INFO dbcounter [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Registered counter for database nova_cell0 Oct 04 20:18:48.056970 n-d-851029-13 devstack@n-api.service[107359]: INFO dbcounter [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Registered counter for database nova_cell1 Oct 04 20:18:48.064547 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_db.sqlalchemy.engines [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.066929 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_db.sqlalchemy.engines [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.072370 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writer thread running {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.076300 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writer thread running {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.199803 n-d-851029-13 devstack@n-api.service[107358]: INFO dbcounter [None req-febc66fd-c235-413d-9836-17133c906077 None None] Registered counter for database nova_cell0 Oct 04 20:18:48.209496 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_db.sqlalchemy.engines [None req-febc66fd-c235-413d-9836-17133c906077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.214334 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writer thread running {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.232469 n-d-851029-13 devstack@n-api.service[107359]: INFO dbcounter [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Registered counter for database nova_cell0 Oct 04 20:18:48.241874 n-d-851029-13 devstack@n-api.service[107359]: DEBUG oslo_db.sqlalchemy.engines [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:18:48.247198 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writer thread running {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:18:48.603745 n-d-851029-13 devstack@n-api.service[107358]: WARNING keystonemiddleware.auth_token [None req-febc66fd-c235-413d-9836-17133c906077 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:48.611201 n-d-851029-13 devstack@n-api.service[107358]: WARNING keystonemiddleware.auth_token [None req-febc66fd-c235-413d-9836-17133c906077 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:48.630142 n-d-851029-13 devstack@n-api.service[107359]: WARNING keystonemiddleware.auth_token [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:48.637631 n-d-851029-13 devstack@n-api.service[107359]: WARNING keystonemiddleware.auth_token [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:48.951332 n-d-851029-13 devstack@n-api.service[107358]: WARNING keystonemiddleware.auth_token [None req-febc66fd-c235-413d-9836-17133c906077 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:48.957205 n-d-851029-13 devstack@n-api.service[107358]: WARNING keystonemiddleware.auth_token [None req-febc66fd-c235-413d-9836-17133c906077 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:48.962976 n-d-851029-13 devstack@n-api.service[107358]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600c31459c0 pid: 107358 (default app) Oct 04 20:18:48.965078 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-febc66fd-c235-413d-9836-17133c906077 None None] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:18:48.966262 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-febc66fd-c235-413d-9836-17133c906077 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Oct 04 20:18:48.966653 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Oct 4 20:18:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:18:48.982399 n-d-851029-13 devstack@n-api.service[107359]: WARNING keystonemiddleware.auth_token [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:18:48.988486 n-d-851029-13 devstack@n-api.service[107359]: WARNING keystonemiddleware.auth_token [None req-f35eab0e-dfe3-4e58-a451-9aaa908aca66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:18:48.994490 n-d-851029-13 devstack@n-api.service[107359]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600c31459c0 pid: 107359 (default app) Oct 04 20:20:30.512431 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-febc66fd-c235-413d-9836-17133c906077 None None] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:30.513545 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-febc66fd-c235-413d-9836-17133c906077 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 04 20:20:30.513952 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:30.530466 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_api:SELECT=3 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:30.532003 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_cell1:SELECT=3 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:30.533282 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_cell0:SELECT=3 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:30.534694 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:31.830757 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-f53802b2-2f8d-4157-ae31-e92bccdc4a72 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:31.867849 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-f53802b2-2f8d-4157-ae31-e92bccdc4a72 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.344600 Oct 04 20:20:31.869028 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:20:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:35.042678 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-febc66fd-c235-413d-9836-17133c906077 None None] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:35.044112 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-febc66fd-c235-413d-9836-17133c906077 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 Oct 04 20:20:35.044940 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:35.659294 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-8c8e49b2-4a8b-40e8-ad9e-79006a3f3bde admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:35.796458 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-8c8e49b2-4a8b-40e8-ad9e-79006a3f3bde admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.742421 Oct 04 20:20:35.797562 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:20:35.822434 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_api:SELECT=3 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:35.823891 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_cell0:SELECT=3 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:35.825428 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_cell1:SELECT=3 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:35.826711 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:20:36.269092 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-bb1902b7-cf75-45d6-ba21-38c42b48dc12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:36.482823 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-bb1902b7-cf75-45d6-ba21-38c42b48dc12 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.670468 Oct 04 20:20:36.483724 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:40.357862 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-8c8e49b2-4a8b-40e8-ad9e-79006a3f3bde admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:40.359734 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-8c8e49b2-4a8b-40e8-ad9e-79006a3f3bde admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002737 Oct 04 20:20:40.360754 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:41.875186 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-5025a525-5fa8-4be9-88b4-f3e4a4faee3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:42.124814 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-5025a525-5fa8-4be9-88b4-f3e4a4faee3f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.751799 Oct 04 20:20:42.126570 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:20:42.152793 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-8e35b210-ff84-4f90-ad18-482233b26a9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:42.317271 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-8e35b210-ff84-4f90-ad18-482233b26a9a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171916 Oct 04 20:20:42.319022 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:46.522491 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-5025a525-5fa8-4be9-88b4-f3e4a4faee3f admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:46.526252 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-5025a525-5fa8-4be9-88b4-f3e4a4faee3f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004455 Oct 04 20:20:46.527732 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:47.289603 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-59040395-0c5d-4d86-8566-58f45a314c89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "disk": 10, "id": "d2", "rxtx_factor": 1.0}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:47.384383 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-59040395-0c5d-4d86-8566-58f45a314c89 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.847074 Oct 04 20:20:47.386079 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:20:47.409287 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-4f83e71d-2e78-4ceb-82a5-97f681b95c79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:47.543370 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-4f83e71d-2e78-4ceb-82a5-97f681b95c79 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139916 Oct 04 20:20:47.545452 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:51.259449 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-59040395-0c5d-4d86-8566-58f45a314c89 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:51.260503 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-59040395-0c5d-4d86-8566-58f45a314c89 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002768 Oct 04 20:20:51.261317 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:20:52.132182 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-253ef2a7-6973-4142-b805-96b912b6d306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:52.247092 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-253ef2a7-6973-4142-b805-96b912b6d306 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.972226 Oct 04 20:20:52.247092 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:20:52.268114 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-4e37efe1-f98a-4eb9-9720-6ab4c45653f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:52.405335 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-4e37efe1-f98a-4eb9-9720-6ab4c45653f7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144435 Oct 04 20:20:52.414710 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:20:56.236409 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-253ef2a7-6973-4142-b805-96b912b6d306 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:20:56.238368 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-253ef2a7-6973-4142-b805-96b912b6d306 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Oct 04 20:20:56.239210 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:20:56.895997 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:57.013096 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.765966 Oct 04 20:20:57.015064 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:20:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:20:57.028020 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-7ab726c8-f7e3-4613-8f35-5b5812d97c5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:20:57.172787 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-7ab726c8-f7e3-4613-8f35-5b5812d97c5c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149195 Oct 04 20:20:57.188397 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 4 20:20:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:00.773976 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:00.775706 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Oct 04 20:21:00.776134 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:01.460624 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-d6c0dc3a-e242-44d8-949e-919e1b86d292 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:01.511812 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-d6c0dc3a-e242-44d8-949e-919e1b86d292 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.726384 Oct 04 20:21:01.512803 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:21:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:05.391922 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:05.393816 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-7c8f1ddb-dd15-4a79-842e-ce13304ab364 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002549 Oct 04 20:21:05.394815 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:06.125706 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-3ccae7bb-6908-49c5-9229-7ae193b7b4ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:06.236075 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-3ccae7bb-6908-49c5-9229-7ae193b7b4ee admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.825278 Oct 04 20:21:06.237054 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:06.260916 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-d0ea56e6-5bc3-4057-bfef-c1ea1b9de129 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:06.270461 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:06.411897 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-d0ea56e6-5bc3-4057-bfef-c1ea1b9de129 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160564 Oct 04 20:21:06.412963 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:09.515834 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-3ccae7bb-6908-49c5-9229-7ae193b7b4ee admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:09.517897 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-3ccae7bb-6908-49c5-9229-7ae193b7b4ee admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002804 Oct 04 20:21:09.519502 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:10.180950 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-7c25f347-ce77-4e3e-98ac-408824d462fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:10.289961 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-7c25f347-ce77-4e3e-98ac-408824d462fb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.762170 Oct 04 20:21:10.291476 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:10.307473 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-9d69b859-54b2-4344-a548-f4f87369efa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:10.404957 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_api:SELECT=34,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:10.415038 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-9d69b859-54b2-4344-a548-f4f87369efa9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113485 Oct 04 20:21:10.415777 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:21:13.798101 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-7c25f347-ce77-4e3e-98ac-408824d462fb admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:13.800296 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-7c25f347-ce77-4e3e-98ac-408824d462fb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003385 Oct 04 20:21:13.800868 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:14.412595 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-b347a4d6-df86-46b6-8572-9c699ed3c5cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:14.510285 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-b347a4d6-df86-46b6-8572-9c699ed3c5cf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.701716 Oct 04 20:21:14.510820 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:21:14.524502 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-288bf607-1e9f-4b65-aad1-153af96b57ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:14.657788 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-288bf607-1e9f-4b65-aad1-153af96b57ed admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137648 Oct 04 20:21:14.658594 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:18.356679 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-b347a4d6-df86-46b6-8572-9c699ed3c5cf admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:18.359354 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-b347a4d6-df86-46b6-8572-9c699ed3c5cf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003301 Oct 04 20:21:18.360276 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:19.147077 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-6e0b6cfd-3d3d-493d-b9a5-b25e9bb09a3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "ram": 8192, "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:19.379675 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-6e0b6cfd-3d3d-493d-b9a5-b25e9bb09a3e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.008920 Oct 04 20:21:19.380299 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:21:19.403546 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-2ddd07c5-9d02-4ccc-99b5-12db7d7e5487 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:19.703584 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-2ddd07c5-9d02-4ccc-99b5-12db7d7e5487 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305434 Oct 04 20:21:19.704913 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:23.601401 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-6e0b6cfd-3d3d-493d-b9a5-b25e9bb09a3e admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:23.605635 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-6e0b6cfd-3d3d-493d-b9a5-b25e9bb09a3e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004349 Oct 04 20:21:23.607043 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:24.392914 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:24.501518 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.886311 Oct 04 20:21:24.503011 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 4 20:21:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:24.524453 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-1f9d2205-f426-4d6d-b50e-7002f394c5f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:24.637606 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-1f9d2205-f426-4d6d-b50e-7002f394c5f1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120566 Oct 04 20:21:24.639915 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 4 20:21:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:21:46.412832 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:46.413805 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 04 20:21:46.414223 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:46.426509 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:46.950266 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-9a64ca2b-3c3c-49fd-93a8-cbd77685ddb9 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:46.986031 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-9a64ca2b-3c3c-49fd-93a8-cbd77685ddb9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.564000 Oct 04 20:21:46.986937 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:21:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:48.473811 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:48.475091 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-04577b70-a524-4617-b2db-e610ad697212 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Oct 04 20:21:48.475564 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:49.166601 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-10c0ee19-5c5b-4eeb-8bf3-daa2dd51b8c1 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:49.176086 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.wsgi [None req-10c0ee19-5c5b-4eeb-8bf3-daa2dd51b8c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-10c0ee19-5c5b-4eeb-8bf3-daa2dd51b8c1 admin admin] Request method failure captured: Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Accept: application/json Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Accept-Encoding: gzip, deflate Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Connection: keep-alive Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Content-Length: 0 Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Host: 10.222.0.36 Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: Openstack-System-Scope: None Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: User-Agent: python-novaclient Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Auth-Token: gAAAAABjPJXc_YuZEthOm8jX81wys2akbAi7QypYlADVB-kJTtdjNC8BslqFLPfiR6OTimQjv6rWh-EcFaZZBe4BLwQkQWuNuLTD4-5_aoZA_bNJvsUx9obW3L06iZBDs6SRcqdCCwsF37Mfh8MZancXJaaSfY0xDwVh5zDvkYHEFABtCDwUXtE Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Id: None Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Name: None Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Identity-Status: Confirmed Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Is-Admin-Project: True Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Id: default Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Name: Default Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Name: admin Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Role: member,admin,reader Oct 04 20:21:49.182839 n-d-851029-13 devstack@n-api.service[107359]: X-Roles: member,admin,reader Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant: admin Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Name: admin Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-User: admin Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Id: default Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Name: Default Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: X-User-Name: admin Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: method: > Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: exception: Flavor 42 could not be found. Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: action_args: {'id': '42'} Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:49.184652 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:49.185721 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.187063 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-10c0ee19-5c5b-4eeb-8bf3-daa2dd51b8c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:49.188766 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-10c0ee19-5c5b-4eeb-8bf3-daa2dd51b8c1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.529696 Oct 04 20:21:49.188766 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 532 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:49.202854 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-ae7db21c-7213-4427-b10c-1650322040ed admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:49.210073 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:21:49.241464 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-ae7db21c-7213-4427-b10c-1650322040ed admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.045228 Oct 04 20:21:49.242739 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:49.261443 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-bd90a94c-78fa-4784-9b50-5148763e4481 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:49.285117 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-bd90a94c-78fa-4784-9b50-5148763e4481 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028564 Oct 04 20:21:49.285676 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:49.297247 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-993e89b6-dbb0-46b9-bd30-c9bd57c2a697 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:49.304904 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.wsgi [None req-993e89b6-dbb0-46b9-bd30-c9bd57c2a697 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-993e89b6-dbb0-46b9-bd30-c9bd57c2a697 admin admin] Request method failure captured: Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Accept: application/json Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Accept-Encoding: gzip, deflate Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Connection: keep-alive Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Content-Length: 0 Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Host: 10.222.0.36 Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: Openstack-System-Scope: None Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: User-Agent: python-novaclient Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Auth-Token: gAAAAABjPJXc_YuZEthOm8jX81wys2akbAi7QypYlADVB-kJTtdjNC8BslqFLPfiR6OTimQjv6rWh-EcFaZZBe4BLwQkQWuNuLTD4-5_aoZA_bNJvsUx9obW3L06iZBDs6SRcqdCCwsF37Mfh8MZancXJaaSfY0xDwVh5zDvkYHEFABtCDwUXtE Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Id: None Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Name: None Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Identity-Status: Confirmed Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Is-Admin-Project: True Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Id: default Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Name: Default Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Name: admin Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Role: member,admin,reader Oct 04 20:21:49.308490 n-d-851029-13 devstack@n-api.service[107358]: X-Roles: member,admin,reader Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant: admin Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Name: admin Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-User: admin Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Id: default Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Name: Default Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: X-User-Name: admin Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: method: > Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: exception: Flavor 42 could not be found. Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: action_args: {'id': '42'} Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:49.317560 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:49.319228 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:49.321905 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-993e89b6-dbb0-46b9-bd30-c9bd57c2a697 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:49.324405 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-993e89b6-dbb0-46b9-bd30-c9bd57c2a697 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016631 Oct 04 20:21:49.324405 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:50.805958 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-bd90a94c-78fa-4784-9b50-5148763e4481 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:50.807768 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-bd90a94c-78fa-4784-9b50-5148763e4481 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003087 Oct 04 20:21:50.808538 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:51.571112 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-130c0ac7-e02a-43e1-b247-0614043c28ad admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:51.581310 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.wsgi [None req-130c0ac7-e02a-43e1-b247-0614043c28ad admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-130c0ac7-e02a-43e1-b247-0614043c28ad admin admin] Request method failure captured: Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Accept: application/json Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Accept-Encoding: gzip, deflate Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Connection: keep-alive Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Content-Length: 0 Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Host: 10.222.0.36 Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: Openstack-System-Scope: None Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: User-Agent: python-novaclient Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Auth-Token: gAAAAABjPJXeKepFBJz6YA8YlpP6XnSrx5Iz5LmgJbjp9k3iAU-0pv8vKzlA2X-JMCWd_zAlhvvkEp6GNlXSE3jJgkaFOl59nSi_UA5R2XWMdJgmSIFB_7I39zTpDU6JYWJlk5AhOeQSEUHOgO9XDE_Rh77O6z-s_raztjmCCMwjH1Gp2_2lk1Q Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Id: None Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Name: None Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Identity-Status: Confirmed Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Is-Admin-Project: True Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Id: default Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Name: Default Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Name: admin Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Role: member,admin,reader Oct 04 20:21:51.584538 n-d-851029-13 devstack@n-api.service[107358]: X-Roles: member,admin,reader Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant: admin Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Name: admin Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-User: admin Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Id: default Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Name: Default Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: X-User-Name: admin Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: method: > Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: exception: Flavor 84 could not be found. Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: action_args: {'id': '84'} Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:51.587001 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:51.588085 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.589407 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-130c0ac7-e02a-43e1-b247-0614043c28ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:51.590788 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-130c0ac7-e02a-43e1-b247-0614043c28ad admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.635009 Oct 04 20:21:51.590788 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 637 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:51.603845 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-13f88e27-33de-4aaf-9fb9-82145e7f6c0a admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:51.631891 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-13f88e27-33de-4aaf-9fb9-82145e7f6c0a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033999 Oct 04 20:21:51.633461 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:51.649057 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-85dc936d-c206-4e49-b5c4-59c9a2cae1fd admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:51.669677 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-85dc936d-c206-4e49-b5c4-59c9a2cae1fd admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026112 Oct 04 20:21:51.670278 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:51.684872 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-1a1b225a-658c-4bc9-a17a-28dc8742011c admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:51.692062 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.wsgi [None req-1a1b225a-658c-4bc9-a17a-28dc8742011c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-1a1b225a-658c-4bc9-a17a-28dc8742011c admin admin] Request method failure captured: Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Accept: application/json Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Accept-Encoding: gzip, deflate Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Connection: keep-alive Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Content-Length: 0 Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Host: 10.222.0.36 Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: Openstack-System-Scope: None Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: User-Agent: python-novaclient Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Auth-Token: gAAAAABjPJXeKepFBJz6YA8YlpP6XnSrx5Iz5LmgJbjp9k3iAU-0pv8vKzlA2X-JMCWd_zAlhvvkEp6GNlXSE3jJgkaFOl59nSi_UA5R2XWMdJgmSIFB_7I39zTpDU6JYWJlk5AhOeQSEUHOgO9XDE_Rh77O6z-s_raztjmCCMwjH1Gp2_2lk1Q Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Id: None Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Name: None Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Identity-Status: Confirmed Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Is-Admin-Project: True Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Id: default Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Name: Default Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Name: admin Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Role: member,admin,reader Oct 04 20:21:51.693602 n-d-851029-13 devstack@n-api.service[107359]: X-Roles: member,admin,reader Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant: admin Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Name: admin Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-User: admin Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Id: default Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Name: Default Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: X-User-Name: admin Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: method: > Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: exception: Flavor 84 could not be found. Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: action_args: {'id': '84'} Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:51.697132 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:51.699355 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:51.701925 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-1a1b225a-658c-4bc9-a17a-28dc8742011c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:51.704335 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-1a1b225a-658c-4bc9-a17a-28dc8742011c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.019402 Oct 04 20:21:51.704335 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:21:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:53.184385 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-85dc936d-c206-4e49-b5c4-59c9a2cae1fd admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:53.185997 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-85dc936d-c206-4e49-b5c4-59c9a2cae1fd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Oct 04 20:21:53.186251 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:53.973337 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-b1ce41ac-8317-4535-943b-789d603c41f1 admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:53.981058 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.wsgi [None req-b1ce41ac-8317-4535-943b-789d603c41f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-b1ce41ac-8317-4535-943b-789d603c41f1 admin admin] Request method failure captured: Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Accept: application/json Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Accept-Encoding: gzip, deflate Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Connection: keep-alive Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Content-Length: 0 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Host: 10.222.0.36 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: Openstack-System-Scope: None Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: User-Agent: python-novaclient Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Auth-Token: gAAAAABjPJXhZCVqUCPu5qB-R1L4t0_e78qR-CXfUcia7rVNJQiySArWmgl22pcIt0PxUGE1CoHwuX_oDRc0ZiDTTQ9ungvXVs4U66QzNqp34zAacr1007kyPaI3CEdTLZ5mv2xAImHg6-w2V0Insj0vhFBpm-9uuo1Kt_hPDJAz-CONsIRuTv8 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Id: None Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Domain-Name: None Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Identity-Status: Confirmed Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Is-Admin-Project: True Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Id: default Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Domain-Name: Default Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Project-Name: admin Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Role: member,admin,reader Oct 04 20:21:53.983052 n-d-851029-13 devstack@n-api.service[107359]: X-Roles: member,admin,reader Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant: admin Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-Tenant-Name: admin Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-User: admin Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Id: default Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-User-Domain-Name: Default Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: X-User-Name: admin Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: method: > Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: exception: Flavor 451 could not be found. Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: action_args: {'id': '451'} Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:53.985081 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:53.986312 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: ERROR nova.api.openstack.wsgi Oct 04 20:21:53.988344 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-b1ce41ac-8317-4535-943b-789d603c41f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:53.990170 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-b1ce41ac-8317-4535-943b-789d603c41f1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.546139 Oct 04 20:21:53.990170 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:21:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 547 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:21:53.996850 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-28872b3f-9841-457f-b22a-db3acc13e710 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:54.012918 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-28872b3f-9841-457f-b22a-db3acc13e710 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019717 Oct 04 20:21:54.013777 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:21:54.024193 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:54.041937 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021735 Oct 04 20:21:54.042989 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 4 20:21:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:21:54.053827 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-4679013c-d80b-40e9-bc67-07223e82bbe3 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:54.059896 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.wsgi [None req-4679013c-d80b-40e9-bc67-07223e82bbe3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-4679013c-d80b-40e9-bc67-07223e82bbe3 admin admin] Request method failure captured: Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Accept: application/json Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Accept-Encoding: gzip, deflate Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Connection: keep-alive Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Content-Length: 0 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Host: 10.222.0.36 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Openstack-Api-Version: compute 2.92 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: Openstack-System-Scope: None Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: User-Agent: python-novaclient Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Auth-Token: gAAAAABjPJXhZCVqUCPu5qB-R1L4t0_e78qR-CXfUcia7rVNJQiySArWmgl22pcIt0PxUGE1CoHwuX_oDRc0ZiDTTQ9ungvXVs4U66QzNqp34zAacr1007kyPaI3CEdTLZ5mv2xAImHg6-w2V0Insj0vhFBpm-9uuo1Kt_hPDJAz-CONsIRuTv8 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Id: None Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Domain-Name: None Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Identity-Status: Confirmed Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Is-Admin-Project: True Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Id: default Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Domain-Name: Default Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Project-Name: admin Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Role: member,admin,reader Oct 04 20:21:54.061582 n-d-851029-13 devstack@n-api.service[107358]: X-Roles: member,admin,reader Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a62afa292fe421289c7430cb0f4bcdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant: admin Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Id: 5a62afa292fe421289c7430cb0f4bcdd Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-Tenant-Name: admin Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-User: admin Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Id: default Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-User-Domain-Name: Default Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-User-Id: b2674f5b6b9341cd95c5e78ee198307c Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: X-User-Name: admin Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: method: > Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: exception: Flavor 451 could not be found. Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: action_args: {'id': '451'} Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:21:54.063736 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:54.064862 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: ERROR nova.api.openstack.wsgi Oct 04 20:21:54.066611 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-4679013c-d80b-40e9-bc67-07223e82bbe3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:21:54.068079 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-4679013c-d80b-40e9-bc67-07223e82bbe3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013412 Oct 04 20:21:54.068079 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:21:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:21:55.417376 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:55.418770 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002414 Oct 04 20:21:55.419109 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:56.072838 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-0a0ae558-f837-41b2-951d-0ab1a7f52216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:56.147936 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-0a0ae558-f837-41b2-951d-0ab1a7f52216 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.579693 Oct 04 20:21:56.149766 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 4 20:21:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:57.558485 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:57.560214 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Oct 04 20:21:57.560822 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:21:58.286836 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-d0b7b231-3386-4397-a52c-520040edaf40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:21:58.378100 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-d0b7b231-3386-4397-a52c-520040edaf40 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.669165 Oct 04 20:21:58.378976 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 4 20:21:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:21:59.846103 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:21:59.847994 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002464 Oct 04 20:21:59.848718 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:00.821748 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-abeb769e-52ff-4805-8e26-3dd720a5f921 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:00.933434 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-abeb769e-52ff-4805-8e26-3dd720a5f921 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.825351 Oct 04 20:22:00.934424 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:22:02.552604 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:02.554117 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 Oct 04 20:22:02.555352 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:03.307135 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-186a8f07-4436-4828-ac86-c915a3356e92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:22:03.396635 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-186a8f07-4436-4828-ac86-c915a3356e92 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.682546 Oct 04 20:22:03.397316 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 4 20:22:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:22:04.842936 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:04.844124 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Oct 04 20:22:04.844789 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:05.468174 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-6396b355-2603-4045-aa6e-98e39ff0a0c9 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:05.489868 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-6396b355-2603-4045-aa6e-98e39ff0a0c9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.500973 Oct 04 20:22:05.490463 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 4 20:22:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:23:06.896160 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:06.897206 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-866c6c74-fd4b-468b-ad47-361ac20dcebd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 04 20:23:06.897610 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 4 20:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:23:06.905443 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:07.352939 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-10e20d65-cb0e-4fe2-b861-eaf165605872 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:07.374598 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-10e20d65-cb0e-4fe2-b861-eaf165605872 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.470450 Oct 04 20:23:07.375190 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:23:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:23:07.398433 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_api:SELECT=14 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:23:07.402725 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-def45e8a-e60d-461a-9bbf-51df83e3625f admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:07.411006 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-def45e8a-e60d-461a-9bbf-51df83e3625f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014600 Oct 04 20:23:07.413175 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Oct 4 20:23:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:23:07.424687 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-52d017f7-946d-424b-a3ae-0ccca096b501 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:07.432431 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-52d017f7-946d-424b-a3ae-0ccca096b501 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011454 Oct 04 20:23:07.432995 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Oct 4 20:23:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:23:07.446908 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:07.456061 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012517 Oct 04 20:23:07.456061 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Oct 4 20:23:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:23:07.468363 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-f7fbe4bd-1f69-407e-b234-e6ce1c8be4f2 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:23:07.476532 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-f7fbe4bd-1f69-407e-b234-e6ce1c8be4f2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Oct 04 20:23:07.477094 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Oct 4 20:23:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:28:47.520114 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:28:47.521168 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 04 20:28:47.522083 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:28:47.670090 n-d-851029-13 devstack@n-api.service[107358]: DEBUG dbcounter [-] [107358] Writing DB stats nova_api:SELECT=6 {{(pid=107358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:28:47.816655 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:28:47.821894 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:28:47.822368 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:28:47.822832 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:28:47.823532 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:28:47.823974 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:28:47.824383 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:28:47.862016 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-07542334-032b-4ed4-8a86-6217657785a9 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.193023 Oct 04 20:28:47.862585 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:28:47 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:28:48.968132 n-d-851029-13 devstack@n-api.service[107359]: DEBUG nova.api.openstack.wsgi [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] Calling method '>' {{(pid=107359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:28:48.969251 n-d-851029-13 devstack@n-api.service[107359]: INFO nova.api.openstack.requestlog [None req-bd48a8ec-e720-4359-852d-218d5797387c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 04 20:28:48.969673 n-d-851029-13 devstack@n-api.service[107359]: [pid: 107359|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 4 20:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:28:49.167611 n-d-851029-13 devstack@n-api.service[107358]: DEBUG nova.api.openstack.wsgi [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Calling method '>' {{(pid=107358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:28:49.171040 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:28:49.171620 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:28:49.171989 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:28:49.172700 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:28:49.173140 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:28:49.173729 n-d-851029-13 devstack@n-api.service[107358]: DEBUG oslo_concurrency.lockutils [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:28:49.197660 n-d-851029-13 devstack@n-api.service[107358]: INFO nova.api.openstack.requestlog [None req-b8671ac8-4a1a-4742-94c4-48b66ab0538d admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.087258 Oct 04 20:28:49.198223 n-d-851029-13 devstack@n-api.service[107358]: [pid: 107358|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:28:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:29:36.502978 n-d-851029-13 devstack@n-api.service[107357]: Tue Oct 4 20:29:36 2022 - graceful shutdown triggered... Oct 04 20:29:36.503539 n-d-851029-13 devstack@n-api.service[107358]: Gracefully killing worker 1 (pid: 107358)... Oct 04 20:29:36.503223 n-d-851029-13 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 20:29:36.504464 n-d-851029-13 devstack@n-api.service[107359]: Gracefully killing worker 2 (pid: 107359)... Oct 04 20:29:36.630933 n-d-851029-13 devstack@n-api.service[107359]: DEBUG dbcounter [-] [107359] Writing DB stats nova_api:SELECT=4 {{(pid=107359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:29:37.504241 n-d-851029-13 devstack@n-api.service[107357]: worker 1 buried after 1 seconds Oct 04 20:29:37.504241 n-d-851029-13 devstack@n-api.service[107357]: worker 2 buried after 1 seconds Oct 04 20:29:37.504241 n-d-851029-13 devstack@n-api.service[107357]: goodbye to uWSGI. Oct 04 20:29:37.505871 n-d-851029-13 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 20:29:37.507295 n-d-851029-13 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 20:29:37.510156 n-d-851029-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:29:37.527601 n-d-851029-13 devstack@n-api.service[123529]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:29:37 2022] *** Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: nodename: n-d-851029-13 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: machine: x86_64 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: clock source: unix Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: pcre jit disabled Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: detected number of CPU cores: 4 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: current working directory: / Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: your processes number limit is 47680 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: your memory page size is 4096 bytes Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: detected max file descriptor number: 2048 Oct 04 20:29:37.542975 n-d-851029-13 devstack@n-api.service[123529]: lock engine: pthread robust mutexes Oct 04 20:29:37.544076 n-d-851029-13 devstack@n-api.service[123529]: thunder lock: enabled Oct 04 20:29:37.544076 n-d-851029-13 devstack@n-api.service[123529]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:29:37.544076 n-d-851029-13 devstack@n-api.service[123529]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:29:37.590781 n-d-851029-13 devstack@n-api.service[123529]: Python main interpreter initialized at 0x5574700e89c0 Oct 04 20:29:37.590781 n-d-851029-13 devstack@n-api.service[123529]: python threads support enabled Oct 04 20:29:37.590781 n-d-851029-13 devstack@n-api.service[123529]: your server socket listen backlog is limited to 100 connections Oct 04 20:29:37.590781 n-d-851029-13 devstack@n-api.service[123529]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:29:37.591499 n-d-851029-13 devstack@n-api.service[123529]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:29:37.591499 n-d-851029-13 devstack@n-api.service[123529]: *** Operational MODE: preforking *** Oct 04 20:29:37.593731 n-d-851029-13 devstack@n-api.service[123529]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:29:37.593731 n-d-851029-13 devstack@n-api.service[123529]: spawned uWSGI master process (pid: 123529) Oct 04 20:29:37.593731 n-d-851029-13 devstack@n-api.service[123529]: spawned uWSGI worker 1 (pid: 123541, cores: 1) Oct 04 20:29:37.593731 n-d-851029-13 devstack@n-api.service[123529]: spawned uWSGI worker 2 (pid: 123542, cores: 1) Oct 04 20:29:37.593731 n-d-851029-13 devstack@n-api.service[123529]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:29:37.591789 n-d-851029-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:29:38.263301 n-d-851029-13 devstack@n-api.service[123541]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:29:38.289126 n-d-851029-13 devstack@n-api.service[123542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:29:39.461389 n-d-851029-13 devstack@n-api.service[123541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:39.461389 n-d-851029-13 devstack@n-api.service[123541]: from cryptography.utils import int_from_bytes Oct 04 20:29:39.462151 n-d-851029-13 devstack@n-api.service[123541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:39.462151 n-d-851029-13 devstack@n-api.service[123541]: from cryptography.utils import int_from_bytes Oct 04 20:29:39.463854 n-d-851029-13 devstack@n-api.service[123542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:39.463854 n-d-851029-13 devstack@n-api.service[123542]: from cryptography.utils import int_from_bytes Oct 04 20:29:39.464334 n-d-851029-13 devstack@n-api.service[123542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:29:39.464334 n-d-851029-13 devstack@n-api.service[123542]: from cryptography.utils import int_from_bytes Oct 04 20:29:41.937315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:29:41.938007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:29:41.938124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:29:41.938393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:29:41.938674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:29:41.939074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.939400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.939720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.940207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.940537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.940851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.941174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.941505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.941841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.942106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.942428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.942783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851029-13 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.943320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.944077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.944426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.944730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.945041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.945373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.945693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.946202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.946648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.947042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.947762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.947762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.948056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.948245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.948705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.949027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.949210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.949509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.949919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851029-13 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.950246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.950571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.950923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.951065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:29:41.951503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:29:41.951605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.951706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.951859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:29:41.951977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.952244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:29:41.952597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.952715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:29:41.952801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.952889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.952970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.953950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.954932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.955131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.955430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.955575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.955733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.955856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851029-13 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.956929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.957956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.958928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.959112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.959454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.959570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.959730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.959867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.960968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.961992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.962214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.962324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.962526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.962628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.962872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851029-13 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.963946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.964949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.965959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.966860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.967751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.968971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.969864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.970943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.971999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.972900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.973831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.974934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.975953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.976862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.977809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.978989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.979913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.980860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.981994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.982934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.983831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.983951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.984128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.984253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.984430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.984525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.984733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.984856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.985039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.985195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.985341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.985502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.985648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.985814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.985964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.986116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.986272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.986445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.986577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.986783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.986895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.987099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.987208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.987407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.987554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.987724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.987878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.988039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.988191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.988370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.988495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.988688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.988814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.989003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.989114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.989321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.989537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.989639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.989864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.989965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.990713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.990820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.991040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.991159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.991452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.991556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.991656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.991744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.991916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.992084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.992235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.992413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.992598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.992729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.992908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.993047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.993210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.993364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.993516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.993685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.993819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.993999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.994122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.994348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.994452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.994678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.994786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.995101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.995227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.995323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.995407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.995625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.995728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.995933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.996027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.996238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.996337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.996543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.996643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.996854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.996954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:29:41.997169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.997279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.997482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:41.997583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.204568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.204912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.205960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.206953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.207975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.208996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.209934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.210908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.211973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.212935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.213998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.214999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.215961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.216940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.217980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.218972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.219901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.220923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.221995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.222954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.223984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.224951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.225972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.226974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.227995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.228956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.229976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.230990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.231939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.232952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.233919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.234151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.234392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.234480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.234856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.235008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.235218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.235452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.235580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.235833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.236243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.236360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.236644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.236959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.237047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.237363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.237519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.237781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.237919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.238113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.238415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.238495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.238864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.238972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.239189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.239495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.239611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.239877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.239971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.240908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.241052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.241257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.241466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.241587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.241914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.242920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.243124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.243268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.243586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.243705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.243904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.244884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.245901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.246176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.246290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.246492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.246604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.246856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.247959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.248223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.248463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.248587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.248705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.248914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.249976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.250908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.251834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.252951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.253913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.254940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.255149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.255348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.255496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.262991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.263979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.264983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.265960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.266953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.267931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.268944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.269949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.270997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.271082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.271368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.271546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.271688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.272979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.273115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.273431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.273511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.273765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.274096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.274183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.274421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.274752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.274909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.275918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.276992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.277960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.278120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.278289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.278445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.278708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.278832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.279985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.280907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.281996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.282198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.282320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.282537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.282754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.282864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.285951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.286874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.287476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.287605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.287737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.287816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.287959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.288902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.289086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.289225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.289418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.289647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.289729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.290886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.291907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.292924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.293887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.294869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.295826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.296912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.297925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.298885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.299837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.300950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.301893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.302006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.302199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.302328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.302525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.302719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.303477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.303599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.303832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.303966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.304157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.304270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.304531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.304665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.304813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.306958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.307898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.308962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.309923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.310947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.311867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.312847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.313971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.314956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.315978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.316934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.317882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.318897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.319864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.320947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.321994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.322982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.323939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.324880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.325989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.326165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.326281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.326487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.326608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.326829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.327806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.328833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.329967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.330088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.330283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.330404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.330594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.330772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.331978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.332984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.333177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.333298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.333494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.333615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.333835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.334076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.334375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.334499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.334712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.334837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.335925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.336970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.337930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.338915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.339902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.340982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.341956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.342926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.343957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.344892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.345956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.346906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.347827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.348929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.349047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.349241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.350971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.351924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.352977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.353940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.354906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.355104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.355226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.355423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.355725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.355847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.356861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.357959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.358091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.358285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.358560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.358691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.358924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.359887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.360953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.361899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.362939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.363909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.364943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.365132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.365742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.365961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.366091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.366210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.366318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.366579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.366754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.367898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.368954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.369998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.370955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.371962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.372981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.373970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.374931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.375990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.376896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.377985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.378906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.379873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.380861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.381854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.382308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.382430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.382619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.382787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.382967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.383919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.384996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.385184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.385297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.385657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.385782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.385904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.386952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.387783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.388916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.389975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.390999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.391129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.391249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:29:42.391615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.391736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.392008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.392335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.392661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.392994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.393321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.393681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.394117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.394308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.395065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.395065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.395311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.395722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.396001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:29:42.396127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:29:42.459624 n-d-851029-13 devstack@n-api.service[123542]: INFO dbcounter [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Registered counter for database nova_api Oct 04 20:29:42.459962 n-d-851029-13 devstack@n-api.service[123541]: INFO dbcounter [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Registered counter for database nova_api Oct 04 20:29:42.478277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.479625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.484478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writer thread running {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.486617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writer thread running {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.542157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.context [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123542) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:29:42.542792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.context [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123541) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:29:42.546386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:42.546796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:42.546895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:42.547476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:42.548575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:42.548915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:42.549326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:42.549652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:29:42.549776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:42.550091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:29:42.551900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:42.552107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:29:42.556550 n-d-851029-13 devstack@n-api.service[123542]: INFO dbcounter [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Registered counter for database nova_cell0 Oct 04 20:29:42.556694 n-d-851029-13 devstack@n-api.service[123541]: INFO dbcounter [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Registered counter for database nova_cell0 Oct 04 20:29:42.558737 n-d-851029-13 devstack@n-api.service[123542]: INFO dbcounter [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Registered counter for database nova_cell1 Oct 04 20:29:42.565916 n-d-851029-13 devstack@n-api.service[123541]: INFO dbcounter [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Registered counter for database nova_cell1 Oct 04 20:29:42.566465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.568894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.572618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.573579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.575816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writer thread running {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.580859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writer thread running {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.582147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writer thread running {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.731364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writer thread running {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.739876 n-d-851029-13 devstack@n-api.service[123541]: INFO dbcounter [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Registered counter for database nova_cell0 Oct 04 20:29:42.743589 n-d-851029-13 devstack@n-api.service[123542]: INFO dbcounter [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Registered counter for database nova_cell0 Oct 04 20:29:42.750827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.752294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:29:42.756672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writer thread running {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:42.758374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writer thread running {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:29:43.089369 n-d-851029-13 devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:43.096793 n-d-851029-13 devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:29:43.102508 n-d-851029-13 devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:43.110925 n-d-851029-13 devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:29:43.448685 n-d-851029-13 devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:43.454937 n-d-851029-13 devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-bd4db9df-1dcc-4603-991b-315598174fd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:29:43.460989 n-d-851029-13 devstack@n-api.service[123541]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574700e89c0 pid: 123541 (default app) Oct 04 20:29:43.475858 n-d-851029-13 devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:29:43.482150 n-d-851029-13 devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-d2df0cc3-d8bb-4783-bf01-b5761a132857 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:29:43.487538 n-d-851029-13 devstack@n-api.service[123542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574700e89c0 pid: 123542 (default app) Oct 04 20:30:29.711138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:29.713488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:29.716867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:29.719988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:31.315699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:31.321938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:31.323643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:31.326125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:32.053662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c69c4fdc-e084-4ca9-bd82-88b67792e92c tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1996342472", "id": 373461986, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:32.226743 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c69c4fdc-e084-4ca9-bd82-88b67792e92c tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 2.522578 Oct 04 20:30:32.232866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:29 2022] POST /compute/v2.1/flavors => generated 427 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:32.905037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Calling method '.version_select at 0x7f54f7c7fca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:32.927004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123541) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:30:32.929409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:32.930134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:32.933168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.017050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.018948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.020005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.099186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.099186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.102247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.155482 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc3a63e3-d77f-4471-a7eb-4aff2ec5e2eb tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.906590 Oct 04 20:30:33.163547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:33.171741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f086b338-3576-4070-931c-ede9ea053d77 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:33.349460 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f086b338-3576-4070-931c-ede9ea053d77 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/373461986" status: 202 len: 0 microversion: 2.1 time: 0.183759 Oct 04 20:30:33.355477 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3/3] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:30:33 2022] DELETE /compute/v2.1/flavors/373461986 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:33.493554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:33.510416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.530603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.530603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.530603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.531100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.531100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.539099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:33.541657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.542323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.542931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.544195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:33.544661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:33.545082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:33.638322 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04363bdf-3d6b-45d2-9cc1-904563464456 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 2.331962 Oct 04 20:30:33.644888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1900cb0-fcec-48d1-ba3d-db343b92cb78 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.287372 Oct 04 20:30:33.658815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:30:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:33.659650 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1/5] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 4 20:30:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:30:34.191136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '.version_select at 0x7f54f7bc63a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:34.196068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:34.196948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:34.197715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:34.236586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:34.237977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:34.239675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:34.288521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:34.289360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:34.290130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:34.309139 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28f7b464-949b-435e-8759-b4518214c5a1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.660585 Oct 04 20:30:34.310455 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 5/6] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 20:30:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:34.335733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-265712116", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:34.624728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a637597c-f0a6-4658-9070-be8725ae9190 tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Calling method '.version_select at 0x7f54f7bc60d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:34.629569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a637597c-f0a6-4658-9070-be8725ae9190 tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '74ecfb8aeceb4b4a852031bef2ed43cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d5e702372d40818f1f6783363ccb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a637597c-f0a6-4658-9070-be8725ae9190 tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Request method failure captured: Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/n-h2-851029-13/search HTTP/1.1 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfjSx9n_zfFA-bItk1GbDTdWvmS5M8jgamriKkNLBgO1SRfKpy2-z1vmMHZ_RnPSCLPLhXHzWb_wbR8pCQZjGEVz7HWDlCl-fvPinCQXc5DJ-eu_vI1g9erF721aH4fPn5-55zZzg-g57-soWPVOdhIRYYIv2HbMAjZHxVfU2o66GM Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e7d5e702372d40818f1f6783363ccb94 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:30:34.635210 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e7d5e702372d40818f1f6783363ccb94 Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-182107537-project Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 74ecfb8aeceb4b4a852031bef2ed43cc Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537-project Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:30:34.645436 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'n-h2-851029-13'} Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:34.646124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:30:34.647151 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:34.648163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a637597c-f0a6-4658-9070-be8725ae9190 tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:34.648163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a637597c-f0a6-4658-9070-be8725ae9190 tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-851029-13/search" status: 403 len: 117 microversion: 2.1 time: 0.299519 Oct 04 20:30:34.648163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 6/7] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 4 20:30:34 2022] GET /compute/v2.1/os-hypervisors/n-h2-851029-13/search => generated 117 bytes in 327 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:34.648163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cbec86a-88d3-4f9b-bba9-ea856f85e1ec tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:34.680000 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1cbec86a-88d3-4f9b-bba9-ea856f85e1ec tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041374 Oct 04 20:30:34.680937 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 7/8] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:34.686080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:34.688088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:34.689428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:34.690268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:34.691619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:34.692505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:34.693115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:34.755608 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d277a57-4431-4647-af24-bcc8cd373fd7 tempest-AZAdminV2TestJSON-1169570288 tempest-AZAdminV2TestJSON-1169570288-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.073090 Oct 04 20:30:34.758886 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 8/9] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:30:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:34.773906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d477f161-34c9-475a-8c3f-01e587daf788 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1337631554"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:34.784639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-d477f161-34c9-475a-8c3f-01e587daf788 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid 6624e46c-618b-4d5d-93c5-51c7729fbdc3 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:35.019690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d477f161-34c9-475a-8c3f-01e587daf788 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.256872 Oct 04 20:30:35.021946 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 9/10] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:35.033377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Calling method '.version_select at 0x7f54f7abc700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:35.040130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:35.047365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:35.047365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:35.087475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Request method failure captured: Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfomnPgUYvmjHL85_ZiLV4T15wEMawV25lcCiaruGYF-BxzbcZnlHGHK9DQ5LUu-PwdYzR6-QfuQsQOSGrehv6gGYnpgVNT4LE6GiIUUhcHnyXAjnLUm_olvYQH-XcNw0YExdW_fvI-sjlhv0P_aH7RIH81f9EsdmhnfbCtiUbFYcQ Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b05d64d87dbd4c97b02529a3dfb6cd7f Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:35.090524 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b05d64d87dbd4c97b02529a3dfb6cd7f Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f7d77f183aa549e2b3aea60a033d645c Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:30:35.093049 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:35.098027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e54a336-9b70-4d96-9553-8bc6a880a7b1 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069997 Oct 04 20:30:35.101995 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 10/11] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 20:30:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:35.108194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5230a2cc-baed-4091-8daf-cf99752b83b8 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-884472684", "id": 1622371629, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:35.288326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5230a2cc-baed-4091-8daf-cf99752b83b8 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.187173 Oct 04 20:30:35.289280 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 11/12] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:35 2022] POST /compute/v2.1/flavors => generated 416 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:35.301563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d649c0d6-9466-48b1-be3e-d14dc32671cd tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:35.335456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d649c0d6-9466-48b1-be3e-d14dc32671cd tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:35.336312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d649c0d6-9466-48b1-be3e-d14dc32671cd tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:35.337017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d649c0d6-9466-48b1-be3e-d14dc32671cd tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:35.507499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:30:36.089704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:30:36.090414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:30:36.091486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:30:36.092353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:30:36.093116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:30:36.134759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:36.135246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:36.135682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:36.136920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:36.137632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:36.138383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:36.245133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Getting quotas for project 05e82b6f1ee143b2b285a424cab7b8f8. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:30:36.258154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Getting quotas for user e953b401d7cd4ff8b8547760cf0caa4d and project 05e82b6f1ee143b2b285a424cab7b8f8. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:30:36.300956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:30:36.307482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:30:36.656289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a636a9e7-66d6-4a45-afc5-940439a63647 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.997457 Oct 04 20:30:36.657532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2/13] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:30:36.687849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Calling method '.version_select at 0x7f54f735c3a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:36.718864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123542) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:30:36.720753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:36.722494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:36.723562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:36.839987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:36.847379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:36.848641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:36.874003 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d649c0d6-9466-48b1-be3e-d14dc32671cd tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 1.583363 Oct 04 20:30:36.883271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 12/14] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:36.908101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4748fc59-bd2a-43c3-9b92-db50ed5f2994 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:36.908920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:36.911789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:36.912679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:36.942054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac567a32-56e8-4024-beeb-d926ec7dde2a tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.271699 Oct 04 20:30:36.943728 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3/15] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:36.967626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65923fa8-8f0a-470a-b33c-d60f852304a2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:36.969421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65923fa8-8f0a-470a-b33c-d60f852304a2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:37.004868 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4748fc59-bd2a-43c3-9b92-db50ed5f2994 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.121033 Oct 04 20:30:37.006749 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 13/16] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:36 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:37.026152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:37.071170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:37.072577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:37.073641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:37.153231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65923fa8-8f0a-470a-b33c-d60f852304a2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:37.225300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65923fa8-8f0a-470a-b33c-d60f852304a2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1219 microversion: 2.1 time: 0.278189 Oct 04 20:30:37.230956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 4/17] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:36 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:37.269426 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-851029-13. Oct 04 20:30:37.269665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199abcd0-5453-496c-b78e-795cf7890a0b tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Calling method '.version_select at 0x7f54f731faf0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:37.277088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-199abcd0-5453-496c-b78e-795cf7890a0b tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '74ecfb8aeceb4b4a852031bef2ed43cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d5e702372d40818f1f6783363ccb94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199abcd0-5453-496c-b78e-795cf7890a0b tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Request method failure captured: Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjSx9n_zfFA-bItk1GbDTdWvmS5M8jgamriKkNLBgO1SRfKpy2-z1vmMHZ_RnPSCLPLhXHzWb_wbR8pCQZjGEVz7HWDlCl-fvPinCQXc5DJ-eu_vI1g9erF721aH4fPn5-55zZzg-g57-soWPVOdhIRYYIv2HbMAjZHxVfU2o66GM Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e7d5e702372d40818f1f6783363ccb94 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:30:37.289317 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e7d5e702372d40818f1f6783363ccb94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e7d5e702372d40818f1f6783363ccb94 Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537 Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-182107537-project Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 74ecfb8aeceb4b4a852031bef2ed43cc Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-182107537-project Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:30:37.291881 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1'} Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:37.293361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:30:37.295614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.304075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199abcd0-5453-496c-b78e-795cf7890a0b tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:37.305257 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-199abcd0-5453-496c-b78e-795cf7890a0b tempest-HypervisorAdminNegativeUnderV252Test-182107537 tempest-HypervisorAdminNegativeUnderV252Test-182107537-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.068393 Oct 04 20:30:37.307044 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 5/18] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:30:37 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:37.327920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c0bc9ba-f777-4bfd-806e-47bf8344cc42 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 40 Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:37.339617 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: {"add_host": {"host": "n-h2-851029-13"}} Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:37.341876 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate 1 already has host n-h2-851029-13. Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-851029-13'}}} Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:30:37.343266 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851029-13-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:30:37.345443 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:30:37.347390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:30:37.349142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851029-13-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 30, 37, 135493), 'updated_at': None, 'host': 'n-h2-851029-13', 'aggregate_id': 1}] Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.354145 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-851029-13. Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.355872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-851029-13. Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:37.358132 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:37.364673 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-851029-13. Oct 04 20:30:37.364673 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.365446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-851029-13. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:37.369592 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ba31e6a-1611-4d1a-af06-24f960f80955 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.360683 Oct 04 20:30:37.370875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 14/19] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 363 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 20:30:37.386488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Calling method '.version_select at 0x7f54f6fc6310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:37.396264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:37.399610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:37.400343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:37.422163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] HTTP exception thrown: No hypervisor matching 'e08dfc9d-6356-4667-8549-d2b8d037b37d' could be found. Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Request method failure captured: Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/e08dfc9d-6356-4667-8549-d2b8d037b37d/servers HTTP/1.1 Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfomnPgUYvmjHL85_ZiLV4T15wEMawV25lcCiaruGYF-BxzbcZnlHGHK9DQ5LUu-PwdYzR6-QfuQsQOSGrehv6gGYnpgVNT4LE6GiIUUhcHnyXAjnLUm_olvYQH-XcNw0YExdW_fvI-sjlhv0P_aH7RIH81f9EsdmhnfbCtiUbFYcQ Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b05d64d87dbd4c97b02529a3dfb6cd7f Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:37.424866 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b05d64d87dbd4c97b02529a3dfb6cd7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b05d64d87dbd4c97b02529a3dfb6cd7f Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324 Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f7d77f183aa549e2b3aea60a033d645c Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: exception: No hypervisor matching 'e08dfc9d-6356-4667-8549-d2b8d037b37d' could be found. Oct 04 20:30:37.432445 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e08dfc9d-6356-4667-8549-d2b8d037b37d'} Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'e08dfc9d-6356-4667-8549-d2b8d037b37d' could be found. Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.434104 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'e08dfc9d-6356-4667-8549-d2b8d037b37d' could be found. Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] Returning 404 to user: No hypervisor matching 'e08dfc9d-6356-4667-8549-d2b8d037b37d' could be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ab3e841-6589-4704-b288-1b0a5f72cd19 tempest-HypervisorAdminNegativeUnderV252Test-1471091324 tempest-HypervisorAdminNegativeUnderV252Test-1471091324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/e08dfc9d-6356-4667-8549-d2b8d037b37d/servers" status: 404 len: 123 microversion: 2.1 time: 0.046401 Oct 04 20:30:37.436093 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 15/20] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 4 20:30:37 2022] GET /compute/v2.1/os-hypervisors/e08dfc9d-6356-4667-8549-d2b8d037b37d/servers => generated 123 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:37.442055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75c47fc4-3d67-4019-b9b0-f3525a55c9d1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:37.459522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75c47fc4-3d67-4019-b9b0-f3525a55c9d1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:37.461730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75c47fc4-3d67-4019-b9b0-f3525a55c9d1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:37.462643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75c47fc4-3d67-4019-b9b0-f3525a55c9d1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:37.507048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c0bc9ba-f777-4bfd-806e-47bf8344cc42 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1622371629" status: 202 len: 0 microversion: 2.1 time: 0.197216 Oct 04 20:30:37.511626 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 6/21] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:37 2022] DELETE /compute/v2.1/flavors/1622371629 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:37.521022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20e2c775-06a8-4cf1-8176-d66519ba149e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:37.627649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20e2c775-06a8-4cf1-8176-d66519ba149e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114319 Oct 04 20:30:37.649732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 7/22] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:30:37.664856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e58aa19-731b-4666-b2b5-1a06e2cf140e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1623299141", "id": 1630624741, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:37.836523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e58aa19-731b-4666-b2b5-1a06e2cf140e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.176365 Oct 04 20:30:37.838478 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 8/23] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:37 2022] POST /compute/v2.1/flavors => generated 429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:37.888817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75c47fc4-3d67-4019-b9b0-f3525a55c9d1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.459088 Oct 04 20:30:37.890710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 16/24] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:37.904536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1db4ae17-8a2b-4861-8b5c-298a302206b1 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:38.039877 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1db4ae17-8a2b-4861-8b5c-298a302206b1 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1630624741" status: 202 len: 0 microversion: 2.1 time: 0.147279 Oct 04 20:30:38.045577 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 17/25] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:37 2022] DELETE /compute/v2.1/flavors/1630624741 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:38.053735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a64d282f-0058-4ad0-9cfb-9e7cb5712325 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:38.149824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d5096d1-9a04-4af9-a11b-7b721b72c5fd tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1951450648", "id": 1990271710, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:38.219538 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a64d282f-0058-4ad0-9cfb-9e7cb5712325 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.176398 Oct 04 20:30:38.221168 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 18/26] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:38 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:30:38.232781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46314ee1-8c22-41bd-890f-ff899c999645 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:38.296623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d5096d1-9a04-4af9-a11b-7b721b72c5fd tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.456004 Oct 04 20:30:38.298706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 9/27] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:30:37 2022] POST /compute/v2.1/flavors => generated 471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:30:38.318183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff11f135-3afe-4dc0-be14-7eea89847cd6 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-555485672"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:38.333277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-ff11f135-3afe-4dc0-be14-7eea89847cd6 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid c7bdf401-d282-4f9f-a0f2-783bc9503fb8 for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:38.341574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46314ee1-8c22-41bd-890f-ff899c999645 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.118416 Oct 04 20:30:38.350864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 19/28] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:38 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:38.377817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87e370e5-3771-4ae7-b614-3e49b57c4eab tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:38.379695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87e370e5-3771-4ae7-b614-3e49b57c4eab tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:38.578922 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff11f135-3afe-4dc0-be14-7eea89847cd6 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.276519 Oct 04 20:30:38.583571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 10/29] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:38.618356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9162380f-781a-4168-ba64-4c2fc1bf566d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-849625051", "name": "tempest-test_aggregate-577496975"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:38.709456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-9162380f-781a-4168-ba64-4c2fc1bf566d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid c52a44dd-b585-4fcf-a821-dcbcdba5b10b for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:38.872341 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9162380f-781a-4168-ba64-4c2fc1bf566d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.275638 Oct 04 20:30:38.878471 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 11/30] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 4 20:30:38 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:38.898076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dbcf7352-468c-4ec6-b8d9-1518ba8d531e tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:39.310038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dbcf7352-468c-4ec6-b8d9-1518ba8d531e tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1990271710/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.429496 Oct 04 20:30:39.312225 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 12/31] 10.222.0.36 () {62 vars in 1265 bytes} [Tue Oct 4 20:30:38 2022] POST /compute/v2.1/flavors/1990271710/os-extra_specs => generated 62 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:39.338886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2f91162-cfc8-477d-a9e0-7749beea8b4b tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1578143853", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:39.523922 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2f91162-cfc8-477d-a9e0-7749beea8b4b tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.205979 Oct 04 20:30:39.540378 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 13/32] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:39.610579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87e370e5-3771-4ae7-b614-3e49b57c4eab tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:39.655508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87e370e5-3771-4ae7-b614-3e49b57c4eab tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1219 microversion: 2.1 time: 1.299563 Oct 04 20:30:39.660292 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 20/33] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:38 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1219 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:39.677938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f96aee16-5898-4521-8558-a3659681cda6 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:39.722418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f96aee16-5898-4521-8558-a3659681cda6 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.055229 Oct 04 20:30:39.723513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 21/34] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:30:39 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:39.749872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-241517b4-0734-41ff-b45a-05ad93d2568a tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:39.880592 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-241517b4-0734-41ff-b45a-05ad93d2568a tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1990271710" status: 202 len: 0 microversion: 2.86 time: 0.142203 Oct 04 20:30:39.890222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 22/35] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 4 20:30:39 2022] DELETE /compute/v2.1/flavors/1990271710 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:30:39.901658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84455208-3049-4a4e-9827-1dfc9f4b9117 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:39.944637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb34b146-1983-4c6d-b61d-9ceae27fce96 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:39.967184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb34b146-1983-4c6d-b61d-9ceae27fce96 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb34b146-1983-4c6d-b61d-9ceae27fce96 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 40 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:30:39.982032 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: {"add_host": {"host": "n-h2-851029-13"}} Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:39.984248 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-851029-13'}}} Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:39.986000 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:30:39.991894 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:39.993720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb34b146-1983-4c6d-b61d-9ceae27fce96 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:39.993720 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb34b146-1983-4c6d-b61d-9ceae27fce96 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.447232 Oct 04 20:30:39.993720 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 14/36] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 449 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:40.003637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b3d552e-79d2-4f20-b7cf-b07a80fe1c1e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:40.039406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3d552e-79d2-4f20-b7cf-b07a80fe1c1e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:40.045036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3d552e-79d2-4f20-b7cf-b07a80fe1c1e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:40.045382 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84455208-3049-4a4e-9827-1dfc9f4b9117 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/4e0f7a0b-da54-4ec7-a263-392e0088c7ee" status: 202 len: 0 microversion: 2.1 time: 0.152989 Oct 04 20:30:40.052085 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 23/37] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:30:39 2022] DELETE /compute/v2.1/flavors/4e0f7a0b-da54-4ec7-a263-392e0088c7ee => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:40.053717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3d552e-79d2-4f20-b7cf-b07a80fe1c1e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:40.060702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1926920d-5c72-4e84-b845-b40392061fb1 tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:40.158284 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1926920d-5c72-4e84-b845-b40392061fb1 tempest-FlavorMetadataValidation-719947448 tempest-FlavorMetadataValidation-719947448-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.107222 Oct 04 20:30:40.160692 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 24/38] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:30:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:30:40.216573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26c6e3e8-2097-4e24-8c86-f2a7b1b29555 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:40.244237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:40.409754 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26c6e3e8-2097-4e24-8c86-f2a7b1b29555 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.228446 Oct 04 20:30:40.416941 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 25/39] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:40 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:30:40.433552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2258222-700f-44a1-8a39-6fe9f688c8fb tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:40.523589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2258222-700f-44a1-8a39-6fe9f688c8fb tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.110997 Oct 04 20:30:40.525039 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 26/40] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:40.559520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1da00a49-297e-4d4b-bcd8-b37a75387705 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1940399538"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:40.586647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-1da00a49-297e-4d4b-bcd8-b37a75387705 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid 5b1b5c2f-c1f2-4064-bf98-05dab41d92f0 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:41.036787 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1da00a49-297e-4d4b-bcd8-b37a75387705 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.498266 Oct 04 20:30:41.086301 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 27/41] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:41.123256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-acc68b8e-45a0-4a48-9286-7839653584ac tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-868290402", "id": "c9846e5c-ac96-4d11-b7cb-95e9b06736b5", "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:41.365153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-acc68b8e-45a0-4a48-9286-7839653584ac tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.270416 Oct 04 20:30:41.373198 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 28/42] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:41 2022] POST /compute/v2.1/flavors => generated 506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:41.390994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b3d552e-79d2-4f20-b7cf-b07a80fe1c1e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.1 time: 1.394199 Oct 04 20:30:41.392099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 15/43] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:41.394481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:41.396156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:41.413169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-271579884"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:41.433046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:41.434595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:41.436275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:41.438510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:41.442712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:41.442892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:41.443052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:41.443226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:41.443372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:41.460134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:41.460134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:41.461902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:41.487902 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-271579884 could not be found. Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 57 Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:30:41.499845 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: {"add_host": {"host": "tempest-nonexist_host-271579884"}} Oct 04 20:30:41.503055 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: exception: Compute host tempest-nonexist_host-271579884 could not be found. Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-271579884'}}} Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-271579884' is not mapped to any cell Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.504487 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 20:30:41.507863 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-271579884 could not be found. Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-271579884 could not be found. Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.514568 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-271579884 could not be found. Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.522285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-271579884 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:41.528199 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb05316e-337e-492f-b42a-5c991266d60e tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.127328 Oct 04 20:30:41.530109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 16/44] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:30:41 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:41.540402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6574086-9209-4de4-bbec-3b2549883903 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:41.687174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6574086-9209-4de4-bbec-3b2549883903 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/c9846e5c-ac96-4d11-b7cb-95e9b06736b5" status: 202 len: 0 microversion: 2.1 time: 0.154793 Oct 04 20:30:41.688582 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 17/45] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:30:41 2022] DELETE /compute/v2.1/flavors/c9846e5c-ac96-4d11-b7cb-95e9b06736b5 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:41.704776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca5951b2-6804-445d-98c3-1cb22c565df1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:41.768257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=12,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:41.865576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:41.886246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca5951b2-6804-445d-98c3-1cb22c565df1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.194169 Oct 04 20:30:41.893585 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 18/46] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:41 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:30:41.915651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0810137-b2b0-449d-a5d2-50ce8050e8eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1223 microversion: 2.1 time: 0.536976 Oct 04 20:30:41.935059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f07b7297-8141-41a2-bf4a-9167002b9b68 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:41.935289 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 29/47] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:41 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1223 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:41.961541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c860010-c6e0-4940-ba0b-49efc05f7dcc tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c860010-c6e0-4940-ba0b-49efc05f7dcc tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 283 Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:41.972801 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:41.975243 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:30:41.976283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:41.977336 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:41.979188 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:41.980612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:30:41.980612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:30:41.980612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:30:41.980612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:41.984028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c860010-c6e0-4940-ba0b-49efc05f7dcc tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:41.986092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c860010-c6e0-4940-ba0b-49efc05f7dcc tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.063755 Oct 04 20:30:41.993598 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 30/48] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 4 20:30:41 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:30:42.021946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5628d646-cefd-4f82-9071-fb678a448eb1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:42.030472 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f07b7297-8141-41a2-bf4a-9167002b9b68 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.136334 Oct 04 20:30:42.033625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 19/49] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5628d646-cefd-4f82-9071-fb678a448eb1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 27 Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:42.043902 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: {"aggregate": {"name": ""}} Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:42.047104 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '' Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:42.048615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:30:42.051855 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.057778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5628d646-cefd-4f82-9071-fb678a448eb1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:42.065383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5628d646-cefd-4f82-9071-fb678a448eb1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.052052 Oct 04 20:30:42.065383 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 31/50] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:41 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:30:42.075266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d10d6ef4-9d82-4dea-850b-6ad708f9baca tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-673491169", "id": 648946372, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:42.101499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b7e347d-f477-4a41-928a-ef21a1ac72fd tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1240015073"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:42.108820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b7e347d-f477-4a41-928a-ef21a1ac72fd tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b7e347d-f477-4a41-928a-ef21a1ac72fd tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 60 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:30:42.113795 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: {"aggregate": {"name": "tempest-test_aggregate-1240015073"}} Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:42.116044 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1240015073'}}} Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:42.117404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:42.119302 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:30:42.121174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.125338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b7e347d-f477-4a41-928a-ef21a1ac72fd tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:42.125338 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b7e347d-f477-4a41-928a-ef21a1ac72fd tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.043380 Oct 04 20:30:42.127362 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 32/51] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:42 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:42.142991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ebd790a-3c0a-4302-931b-0cbfc3d87b21 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-971596775"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:42.149897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-4ebd790a-3c0a-4302-931b-0cbfc3d87b21 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid 81909dcc-9733-41f3-87bb-54ecd526e694 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:42.272960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d10d6ef4-9d82-4dea-850b-6ad708f9baca tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.204330 Oct 04 20:30:42.275552 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ebd790a-3c0a-4302-931b-0cbfc3d87b21 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.140315 Oct 04 20:30:42.276418 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 20/52] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:42 2022] POST /compute/v2.1/flavors => generated 410 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:42.278152 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 33/53] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:42.305664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ec2eeae-f005-4729-9430-5b107a52a965 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:42.306031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-971596775"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:42.315771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid df9ed5e1-2b5d-4ebf-b7e9-cf5d059c4a56 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:42.327506 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ec2eeae-f005-4729-9430-5b107a52a965 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/648946372" status: 200 len: 410 microversion: 2.1 time: 0.034965 Oct 04 20:30:42.329595 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 21/54] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:30:42 2022] GET /compute/v2.1/flavors/648946372 => generated 410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:42.358612 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-971596775 already exists. Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 59 Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:42.395244 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: {"aggregate": {"name": "tempest-test_aggregate-971596775"}} Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:42.397778 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate tempest-test_aggregate-971596775 already exists. Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-971596775'}}} Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 20:30:42.399254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-971596775 already exists. Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:42.402538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-971596775 already exists. Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-971596775 already exists. Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:42.411018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-971596775 already exists. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:42.415146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6cedf590-e1cb-4e79-b5f6-319e0703c9c1 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.109820 Oct 04 20:30:42.415343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 34/55] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:42 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:30:42.432776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f5e8564-2fc4-4ab9-a08e-541b2b254862 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:42.712627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f5e8564-2fc4-4ab9-a08e-541b2b254862 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.288024 Oct 04 20:30:42.718331 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 35/56] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:42 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:30:43.436390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f0a1a0b-0c07-4a48-8ea9-c76cfcfe6fdb tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:43.635477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f0a1a0b-0c07-4a48-8ea9-c76cfcfe6fdb tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 1.291083 Oct 04 20:30:43.640699 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 22/57] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:42 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:43.663149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-098d35c2-a971-44d2-9568-11d5874cf434 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-326881628"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:43.675266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-098d35c2-a971-44d2-9568-11d5874cf434 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid b55d348a-985b-466e-b020-e860b3f250bb for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:43.816488 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-098d35c2-a971-44d2-9568-11d5874cf434 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.173760 Oct 04 20:30:43.826078 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 23/58] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:43.865829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:43.871193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:43.902599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:43.907268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:43.907268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:43.907268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:43.912776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:43.915268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:44.316748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1248852381", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "availability_zone": "tempest-test_az-849625051"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:44.461930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:44.464484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:44.472275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:44.473798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:44.479129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:44.483259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:44.578928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:44.670818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc338699-f2e0-4ad0-9ca8-e2bf527efe43 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1300 microversion: 2.1 time: 0.838820 Oct 04 20:30:44.701774 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 24/59] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:43 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1300 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:44.741735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e5603537-aba2-4bee-902a-8501a24bc836 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:44.916096 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e5603537-aba2-4bee-902a-8501a24bc836 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/648946372" status: 202 len: 0 microversion: 2.1 time: 0.211379 Oct 04 20:30:44.927762 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 25/60] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:30:44 2022] DELETE /compute/v2.1/flavors/648946372 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:44.956782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4f95850-0037-4fb6-bb06-bfd4c5310c45 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:44.960950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4f95850-0037-4fb6-bb06-bfd4c5310c45 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4f95850-0037-4fb6-bb06-bfd4c5310c45 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:30:44.971393 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:30:44.974051 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6'} Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:44.975288 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:30:44.977121 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:44.988115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4f95850-0037-4fb6-bb06-bfd4c5310c45 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:44.992037 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4f95850-0037-4fb6-bb06-bfd4c5310c45 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.066109 Oct 04 20:30:44.998438 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 26/61] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:45.015215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:30:45.020443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d240fa24-0791-448b-b57a-f9012107da23 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:45.137217 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d240fa24-0791-448b-b57a-f9012107da23 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.136544 Oct 04 20:30:45.149079 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 27/62] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:45.186157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95137d2f-1c47-4efb-a3a2-624799b79b17 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:45.415402 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95137d2f-1c47-4efb-a3a2-624799b79b17 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.264221 Oct 04 20:30:45.416555 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 28/63] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:30:45.453204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f68aaaef-3f10-45f6-acd4-955f81527585 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-979221193", "id": 1953238949, "os-flavor-access:is_public": "False"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:45.623339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f68aaaef-3f10-45f6-acd4-955f81527585 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.200910 Oct 04 20:30:45.632776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 29/64] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:45 2022] POST /compute/v2.1/flavors => generated 429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:45.663789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76c21fd7-b8af-400a-a7f1-6ced8090c7d8 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:45.713218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-76c21fd7-b8af-400a-a7f1-6ced8090c7d8 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76c21fd7-b8af-400a-a7f1-6ced8090c7d8 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:30:45.722106 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: exception: Aggregate -1 could not be found. Oct 04 20:30:45.724393 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '-1'} Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:30:45.725619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.729225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76c21fd7-b8af-400a-a7f1-6ced8090c7d8 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76c21fd7-b8af-400a-a7f1-6ced8090c7d8 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.100492 Oct 04 20:30:45.739116 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 30/65] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:30:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:30:45.748907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30ad6d51-95f3-4341-83a0-e855d7da1efa tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "1953238949"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:45.777683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-30ad6d51-95f3-4341-83a0-e855d7da1efa tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] HTTP exception thrown: Flavor 1953238949 could not be found. Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30ad6d51-95f3-4341-83a0-e855d7da1efa tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Request method failure captured: Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 107 Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfhJJJ7hfExnOPRZyBV3De0lko19pgRUZbr46FnhTUbpsN6hgWjpI14lSbCZJaMmr_CJkPRJ-Iwp3CEWC7D8x0zwo7NzDiXsycTHlNGL7_LzSSYw7eFE_9E7NezATqzxA3l5sHdBQwX7Z5v5Fx1T07mv44gLi9JtzU0GHF2Ke6kvXU Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 4c8197fcd56046e2952729c6651e79ae Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsAdminTestJSON-1280893869 Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:30:45.793732 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4c8197fcd56046e2952729c6651e79ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4c8197fcd56046e2952729c6651e79ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4c8197fcd56046e2952729c6651e79ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4c8197fcd56046e2952729c6651e79ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsAdminTestJSON-1280893869 Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 4c8197fcd56046e2952729c6651e79ae Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1280893869 Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsAdminTestJSON-1280893869-project Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: c340694396a648beba4f9bd090f5f904 Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsAdminTestJSON-1280893869-project Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "test", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "1953238949"}} Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:45.796087 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor 1953238949 could not be found. Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '1953238949'}}} Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1953238949 could not be found. Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.797914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1953238949 could not be found. Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:45.801693 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1953238949 could not be found. Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30ad6d51-95f3-4341-83a0-e855d7da1efa tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Returning 400 to user: Flavor 1953238949 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30ad6d51-95f3-4341-83a0-e855d7da1efa tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.058115 Oct 04 20:30:45.806206 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 31/66] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:45 2022] POST /compute/v2.1/servers => generated 81 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:30:45.843025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:45.846876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:45.883786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:45.884732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:45.890182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:45.894588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:45.901974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:45.908842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:46.362176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:46.420775 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6dd18c15-9d44-49e7-bc7c-c2bdf6e3d254 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1298 microversion: 2.1 time: 0.608206 Oct 04 20:30:46.422917 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 32/67] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:45 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1298 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:46.437413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bf64953-7ef4-4d36-b23c-eb99cec9e4aa tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-272496898"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:46.467556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-6bf64953-7ef4-4d36-b23c-eb99cec9e4aa tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid 3aaf4063-f509-4c35-a123-84472d98d8eb for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:30:46.664540 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bf64953-7ef4-4d36-b23c-eb99cec9e4aa tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.235627 Oct 04 20:30:46.671069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 33/68] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:30:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:46.693216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-099a4f67-39c3-4963-9c44-dc9b0e245d4a tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:46.754261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:30:46.754827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:30:46.755634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:30:46.756546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:30:46.757141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:30:46.813627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:46.826318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:46.826318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:46.826318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:46.826318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:46.826584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:46.856433 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-099a4f67-39c3-4963-9c44-dc9b0e245d4a tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1953238949" status: 202 len: 0 microversion: 2.1 time: 0.183675 Oct 04 20:30:46.858619 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:46 2022] DELETE /compute/v2.1/flavors/1953238949 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:46.864678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-613a9709-4107-4fe0-830b-97251d7a13b1 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:46.868153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-613a9709-4107-4fe0-830b-97251d7a13b1 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-613a9709-4107-4fe0-830b-97251d7a13b1 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:30:46.869016 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:30:46.871244 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7'} Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:46.872527 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:30:46.873468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-613a9709-4107-4fe0-830b-97251d7a13b1 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:46.876804 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-613a9709-4107-4fe0-830b-97251d7a13b1 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.012007 Oct 04 20:30:46.883460 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 35/70] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:30:46 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:46.897531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-83339cb3-2258-442b-91f3-31a11a577df5 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:46.931874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Getting quotas for project 9b8f23134f1444a994c667625d3ef10a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:30:46.960288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Getting quotas for user 8652c21a239e4828841774b892990f1c and project 9b8f23134f1444a994c667625d3ef10a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:30:46.973551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-83339cb3-2258-442b-91f3-31a11a577df5 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088643 Oct 04 20:30:46.974792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:47.008983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bcaecf9-4e6b-4a70-8a13-e0fa123fe137 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:47.032328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:30:47.045427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:30:47.174943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bcaecf9-4e6b-4a70-8a13-e0fa123fe137 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.192948 Oct 04 20:30:47.181062 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:46 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:30:47.206329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db3f8f80-931e-4457-a384-0185bf86f8d2 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-51090811", "id": 769773391, "os-flavor-access:is_public": "False"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:47.250028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:47.371941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6564250-48c4-4b0e-83bd-e59c01470ca6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.650861 Oct 04 20:30:47.373759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 36/73] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:30:47.409034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-859f69a4-9bd3-44ee-a65b-9bd8ee7cb3f4 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:47.412240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db3f8f80-931e-4457-a384-0185bf86f8d2 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.225663 Oct 04 20:30:47.416898 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:47 2022] POST /compute/v2.1/flavors => generated 410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:47.449731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c0b9720-c974-4fb6-acbc-12152e62b706 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:47.454765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-859f69a4-9bd3-44ee-a65b-9bd8ee7cb3f4 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:30:47.458286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c0b9720-c974-4fb6-acbc-12152e62b706 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-859f69a4-9bd3-44ee-a65b-9bd8ee7cb3f4 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:30:47.462449 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate -1 could not be found. Oct 04 20:30:47.464625 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '-1'} Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:47.465913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:30:47.467946 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:47.469659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-859f69a4-9bd3-44ee-a65b-9bd8ee7cb3f4 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:47.469659 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-859f69a4-9bd3-44ee-a65b-9bd8ee7cb3f4 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.089335 Oct 04 20:30:47.481606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 37/75] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:30:47 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:30:47.500184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0922f02a-d769-428f-92f0-880183772e56 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-781053532", "id": 781485090, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:47.613008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0922f02a-d769-428f-92f0-880183772e56 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.128881 Oct 04 20:30:47.626590 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:47 2022] POST /compute/v2.1/flavors => generated 410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:47.661795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:47.663094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:47.700375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:47.701035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:47.703680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:47.705402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:47.708496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:47.715848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:48.628709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:48.646423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c0b9720-c974-4fb6-acbc-12152e62b706 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:48.672356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c465bdd3-57f5-4b8b-83f0-a76fe959879f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1298 microversion: 2.1 time: 1.037325 Oct 04 20:30:48.675522 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:47 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1298 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:48.689416 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c0b9720-c974-4fb6-acbc-12152e62b706 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1242 microversion: 2.1 time: 1.268401 Oct 04 20:30:48.691071 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:47 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1242 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:48.735845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab621eab-fbd6-4e47-9a41-0789d541fb7a tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:48.741425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b893d01c-8c66-40b4-8157-4424de0dd319 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:48.750437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b893d01c-8c66-40b4-8157-4424de0dd319 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b893d01c-8c66-40b4-8157-4424de0dd319 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:30:48.763904 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:30:48.765883 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:30:48.767655 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:30:48.770087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:30:48.772236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b893d01c-8c66-40b4-8157-4424de0dd319 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:30:48.779663 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b893d01c-8c66-40b4-8157-4424de0dd319 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.094935 Oct 04 20:30:48.782862 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:30:48 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 103 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:30:48.899422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab621eab-fbd6-4e47-9a41-0789d541fb7a tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.194097 Oct 04 20:30:48.906816 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 4 20:30:48 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:48.923766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a1d7a1e-11f5-4e44-8fb2-ff3dadd46dd0 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.019571 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a1d7a1e-11f5-4e44-8fb2-ff3dadd46dd0 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.100402 Oct 04 20:30:49.021815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1177 bytes} [Tue Oct 4 20:30:48 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:49.062650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e04ffecf-fb5f-4cdd-9e18-6d35e4abcb61 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.162288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e04ffecf-fb5f-4cdd-9e18-6d35e4abcb61 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.106310 Oct 04 20:30:49.162288 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1171 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:49.177420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e67086b-0795-4ced-a58f-45c34f31bfc4 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.240371 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e67086b-0795-4ced-a58f-45c34f31bfc4 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.067514 Oct 04 20:30:49.242603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:30:49.276135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9212f35d-a6a3-4236-8007-abda00ed9d42 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.404814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9212f35d-a6a3-4236-8007-abda00ed9d42 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.134537 Oct 04 20:30:49.408109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:49.452669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d3999d0-db3b-41af-b253-2f7728ff2227 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.605419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d3999d0-db3b-41af-b253-2f7728ff2227 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.163833 Oct 04 20:30:49.609624 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:49.653367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed8ed129-6a16-49f7-8ef7-d8c57bd02242 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.717614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.730175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:49.761227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:49.762997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:49.769008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:49.772704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:49.773761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:49.775139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:49.847704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed8ed129-6a16-49f7-8ef7-d8c57bd02242 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.200652 Oct 04 20:30:49.868223 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:49.914137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54c90463-2a69-4ac5-b418-d057962bb6ab tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:49.928621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54c90463-2a69-4ac5-b418-d057962bb6ab tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:51.301403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54c90463-2a69-4ac5-b418-d057962bb6ab tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:51.339453 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54c90463-2a69-4ac5-b418-d057962bb6ab tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1242 microversion: 2.1 time: 1.468883 Oct 04 20:30:51.381203 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1242 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:51.425057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4734345-c743-4d30-98f8-43218e75138e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:51.458730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:51.581052 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4734345-c743-4d30-98f8-43218e75138e tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.180274 Oct 04 20:30:51.603786 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 45/88] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 4 20:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:51.630060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2854975-c89a-4f35-b5f9-66e58d59f6f0 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:51.894231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2854975-c89a-4f35-b5f9-66e58d59f6f0 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/781485090" status: 202 len: 0 microversion: 2.1 time: 0.269458 Oct 04 20:30:51.898251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 46/89] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:30:51 2022] DELETE /compute/v2.1/flavors/781485090 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:51.913163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-187108a1-1637-454c-96b1-277b1330b9ff tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:51.931431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:52.039944 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb4499ad-f34f-4f0e-89fe-e132c2be5612 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 2.330713 Oct 04 20:30:52.087435 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 44/90] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:49 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:52.255113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-187108a1-1637-454c-96b1-277b1330b9ff tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.336624 Oct 04 20:30:52.259883 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 47/91] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:30:52.296838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b348f6e-958e-4c20-869c-f4a4bac7fb37 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:52.391674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:52.393205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:52.441107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b348f6e-958e-4c20-869c-f4a4bac7fb37 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/769773391" status: 202 len: 0 microversion: 2.1 time: 0.152363 Oct 04 20:30:52.444367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:52.447867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:52.454153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:52.455137 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 45/92] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:30:52 2022] DELETE /compute/v2.1/flavors/769773391 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:52.457236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:52.464551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:52.465736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:52.512797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b28193ca-90c5-4c54-a860-d089f71f9e2d tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:52.618838 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b28193ca-90c5-4c54-a860-d089f71f9e2d tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.157161 Oct 04 20:30:52.620613 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 46/93] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:52.664964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aac52b3f-4e11-470d-8db2-d9f81151dd38 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-166128153", "id": 1628186486, "os-flavor-access:is_public": "False"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:52.851671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aac52b3f-4e11-470d-8db2-d9f81151dd38 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.199989 Oct 04 20:30:52.863589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 47/94] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:52.920818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f05166da-26d7-4c9c-aede-20ee4d2a6926 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:52.971763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:53.012623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30bc3cb1-e6df-4aa7-ae59-310421e8e865 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1242 microversion: 2.1 time: 0.629888 Oct 04 20:30:53.030793 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:52 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1242 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:30:53.068286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f05166da-26d7-4c9c-aede-20ee4d2a6926 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.188179 Oct 04 20:30:53.091037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:53.092112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:53.098458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:53.116589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 48/96] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:30:53.126630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bf8462d-bdc5-4f37-a05e-f2f6cb19e1c9 tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:53.127894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:53.128712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:53.132422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:53.139899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:53.149080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:53.150074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:53.264797 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bf8462d-bdc5-4f37-a05e-f2f6cb19e1c9 tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.143044 Oct 04 20:30:53.266654 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 49/97] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:53.306178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8a770f0-3709-43f0-b433-59f52df3b5c2 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:53.449364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8a770f0-3709-43f0-b433-59f52df3b5c2 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1628186486" status: 202 len: 0 microversion: 2.1 time: 0.150544 Oct 04 20:30:53.451231 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 50/98] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:53 2022] DELETE /compute/v2.1/flavors/1628186486 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:53.476608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9468a9a-cf23-4247-8200-af1069e70758 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:53.643123 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9468a9a-cf23-4247-8200-af1069e70758 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.179141 Oct 04 20:30:53.648318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:53.691792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a192520f-13e9-4f55-83e7-dc3b867f7f5d tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-673779032", "id": 1612323417, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:53.895950 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a192520f-13e9-4f55-83e7-dc3b867f7f5d tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.215284 Oct 04 20:30:53.896865 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 52/100] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:53 2022] POST /compute/v2.1/flavors => generated 413 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:53.973292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-442c73a8-3084-4ad0-821f-8b08735fb2ca tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:54.116804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:54.176736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:54.230619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3762f357-028f-4941-8796-061ce732f373 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.145842 Oct 04 20:30:54.246936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:53 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:54.266937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:54.284731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:54.326152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:54.334122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:54.342988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:54.342988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:54.342988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:54.342988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:54.343453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-442c73a8-3084-4ad0-821f-8b08735fb2ca tempest-FlavorsAdminTestJSON-1280893869 tempest-FlavorsAdminTestJSON-1280893869-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.404152 Oct 04 20:30:54.350419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 53/102] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:53 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:54.422639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a4489112-887b-46d3-84d8-af05d796fc22 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:54.698129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a4489112-887b-46d3-84d8-af05d796fc22 tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1612323417" status: 202 len: 0 microversion: 2.1 time: 0.323996 Oct 04 20:30:54.698747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 54/103] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:30:54 2022] DELETE /compute/v2.1/flavors/1612323417 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:30:54.721546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44c066f7-cd93-4b20-8db3-043ad9f6025c tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:54.733172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:54.788368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d486217f-8d7c-4e96-90d2-c04da308ab0f tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1290 microversion: 2.1 time: 0.539282 Oct 04 20:30:54.805618 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 50/104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:54 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1290 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:54.837364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44c066f7-cd93-4b20-8db3-043ad9f6025c tempest-FlavorsAdminTestJSON-1156866015 tempest-FlavorsAdminTestJSON-1156866015-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.128583 Oct 04 20:30:54.841349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 55/105] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:30:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:55.290640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:55.305936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:55.349717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:55.350510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:55.353142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:55.364692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:55.367989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:55.373790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:55.837567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:55.854543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:55.901306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:55.902182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:55.923269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:55.925380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:55.926565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:55.930038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:56.377627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:56.406650 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e05e7b0f-8bad-414f-b1fb-6de5d2cd950e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1296 microversion: 2.1 time: 0.573995 Oct 04 20:30:56.409997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 56/106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:55 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1296 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:56.514900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:56.540001 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d02b09d-0875-4ee3-819a-c68ecbeb24eb tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.262293 Oct 04 20:30:56.560415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 51/107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:55 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:56.884489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:56.993257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:30:57.439195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-525b71fb-9991-4234-b44e-006d0a8b9cd6 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1305588769", "ram": 512, "vcpus": 1, "disk": 10, "id": 367720998, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:57.471283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:57.484670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:57.505465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:57.508408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:57.512568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:57.514730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:57.520136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:57.521998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:57.600270 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-525b71fb-9991-4234-b44e-006d0a8b9cd6 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.184703 Oct 04 20:30:57.614983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 57/108] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:56 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:30:57.625254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:30:57.626174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:30:57.634962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:57.636133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:57.637065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:57.638511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:30:57.639396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:30:57.640166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:30:58.614525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:58.694548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fcfbdb9-6041-4144-abf5-b7f0f9640e64 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1296 microversion: 2.1 time: 1.237404 Oct 04 20:30:58.703621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 52/109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:57 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1296 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:30:58.727237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c32ac71-e33d-449d-aa98-3e74660c4f98 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:58.983036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c32ac71-e33d-449d-aa98-3e74660c4f98 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.276998 Oct 04 20:30:58.985025 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 53/110] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:30:58 2022] POST /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:30:59.717594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-951535920", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:30:59.803832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:30:59.899718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b5ecd9e-2a33-4ea1-a64b-f12733c34938 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 2.280554 Oct 04 20:30:59.900787 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 58/111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:30:57 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:00.039386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:00.396249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc8bfb86-abd8-4c0d-8421-d040aa36e97d tempest-FlavorsExtraSpecsTestJSON-1246515587 tempest-FlavorsExtraSpecsTestJSON-1246515587-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:00.426108 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc8bfb86-abd8-4c0d-8421-d040aa36e97d tempest-FlavorsExtraSpecsTestJSON-1246515587 tempest-FlavorsExtraSpecsTestJSON-1246515587-project] 10.222.0.36 "GET /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.523623 Oct 04 20:31:00.430358 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 59/112] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 4 20:30:59 2022] GET /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:00.826615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d290913d-911d-4ff5-bb26-c31d002992a7", "tag": "ad62b44e-1457-4115-bf5b-10b0230b958a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:00.872775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.884718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.885531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:00.945532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=65 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:00.959206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Creating event network-changed:ad62b44e-1457-4115-bf5b-10b0230b958a for instance d290913d-911d-4ff5-bb26-c31d002992a7 on n-h2-851029-13 Oct 04 20:31:00.959206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:31:00.959206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-256b71fd-2e2f-43e7-9c07-57fb389c916d req-62fb84e0-a2a4-46f8-92d9-24e300e3779f service nova] Acquired lock "compute-rpcapi-router" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:31:00.962932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.965282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.968226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:00.971583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:00.972395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:00.973607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:01.024906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.compute.rpcapi [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:31:01.026630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] Releasing lock "compute-rpcapi-router" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:31:01.067753 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b75448d-7bbd-45c8-9ed9-887b872383be None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.633392 Oct 04 20:31:01.069157 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 60/113] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:01.091229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:01.093624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:01.117381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:01.119518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:01.119978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:01.121076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:01.121893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:01.122332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:01.315335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:01.999832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:31:02.000952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:31:02.004163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:31:02.005144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:31:02.007708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:31:02.051230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.052095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.068460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.070310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.071486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.072532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.121980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=59 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:02.154801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:02.169950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:02.253302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:31:02.263134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:31:02.486198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:02.555180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4c6994f-7fb0-47e2-b1ee-4423d66e8372 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.475339 Oct 04 20:31:02.572665 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 61/114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:01 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:02.653591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8466f9bf-d0d1-44d5-b378-5de4eb9244b8 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:02.803430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8466f9bf-d0d1-44d5-b378-5de4eb9244b8 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.202002 Oct 04 20:31:02.809877 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 62/115] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:31:02 2022] POST /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:02.845447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6d7ff94-39cf-49e6-a034-c97b74bf9e47 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.857892 Oct 04 20:31:02.870419 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 54/116] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:31:02.872632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:02.876589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:02.896366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7fecf50-33ad-49bc-b1ea-d8ceeaa404b4 tempest-FlavorsExtraSpecsTestJSON-1246515587 tempest-FlavorsExtraSpecsTestJSON-1246515587-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:02.908346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.909827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.913610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.917603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:02.919508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:02.921703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:02.977022 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7fecf50-33ad-49bc-b1ea-d8ceeaa404b4 tempest-FlavorsExtraSpecsTestJSON-1246515587 tempest-FlavorsExtraSpecsTestJSON-1246515587-project] 10.222.0.36 "GET /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.082195 Oct 04 20:31:02.992319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 55/117] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:31:02 2022] GET /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes => generated 22 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:03.050967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-17c48f28-c3fb-4d5b-aafa-85c86c5e0ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:03.070464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-17c48f28-c3fb-4d5b-aafa-85c86c5e0ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:03.981787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-17c48f28-c3fb-4d5b-aafa-85c86c5e0ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:04.020170 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-17c48f28-c3fb-4d5b-aafa-85c86c5e0ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1212 microversion: 2.1 time: 1.022234 Oct 04 20:31:04.021262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 56/118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:02 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1212 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:04.050114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e99b2df3-66d7-4961-9e57-f0a361b2fe5b tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:04.115827 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e99b2df3-66d7-4961-9e57-f0a361b2fe5b tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079575 Oct 04 20:31:04.121789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 57/119] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:31:04 2022] POST /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:04.128429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:04.129623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:04.143982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:04.144866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:04.145471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:04.146994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:04.147646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:04.148255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:04.951611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:04.986575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:04.997902 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bd839a1-2149-43f6-aaa5-4c2706151dec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 2.159299 Oct 04 20:31:05.003733 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 63/120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:02 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:05.026313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0779634-a0d6-492b-a255-0555e128f904 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:05.076397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ab89933-02c8-474c-95b6-c5a333be4d70 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.952767 Oct 04 20:31:05.088255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0779634-a0d6-492b-a255-0555e128f904 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080981 Oct 04 20:31:05.088926 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 58/121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:04 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:05.099762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 64/122] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 4 20:31:05 2022] GET /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:05.135645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb019695-ccea-4741-9806-c986114d42d3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:05.145372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb019695-ccea-4741-9806-c986114d42d3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:05.498248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb019695-ccea-4741-9806-c986114d42d3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:05.550390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb019695-ccea-4741-9806-c986114d42d3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1212 microversion: 2.1 time: 0.448295 Oct 04 20:31:05.551492 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 65/123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:05 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1212 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:05.569765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d00eb223-b893-44a0-9737-db6f5c63aca4 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:05.859053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d00eb223-b893-44a0-9737-db6f5c63aca4 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.303344 Oct 04 20:31:05.861129 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 66/124] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:05 2022] PUT /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes => generated 22 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:05.879512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3da9c09e-966b-4379-87a7-708769f630a5 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:05.912228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3da9c09e-966b-4379-87a7-708769f630a5 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042909 Oct 04 20:31:05.914468 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 67/125] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 4 20:31:05 2022] GET /compute/v2.1/flavors/367720998/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:05.928357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26b189b4-8f17-471a-8dd2-3b1852cc61d7 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.035986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Calling method '.version_select at 0x7f54f6f81ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.040007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.040849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.041677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.096431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26b189b4-8f17-471a-8dd2-3b1852cc61d7 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.171691 Oct 04 20:31:06.097512 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 68/126] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 20:31:05 2022] DELETE /compute/v2.1/flavors/367720998/os-extra_specs/hw:numa_nodes => generated 0 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:06.126353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.129723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:06.150420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.160292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.160292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.160292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.160292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.160650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.184628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.196244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.196244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.247137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.248064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.248891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.305368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-37cd664a-a5bf-49cf-a318-6c664e114bf0 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 1.214821 Oct 04 20:31:06.307783 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 59/127] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:31:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:06.326852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd8e4d74-9f17-4cdc-ac37-78d80d7682f3 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.484563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd8e4d74-9f17-4cdc-ac37-78d80d7682f3 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/367720998/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.174530 Oct 04 20:31:06.487030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 60/128] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 20:31:06 2022] DELETE /compute/v2.1/flavors/367720998/os-extra_specs/hw:cpu_policy => generated 0 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:06.500217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:06.503466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:06.536721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.540385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.543874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:06.549050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:06.555369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:06.559160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:07.085467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:07.143733 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35060c1b-acae-4f8d-8e0b-c3b4ddf76e39 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.043223 Oct 04 20:31:07.192741 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 69/129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:06 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:07.202575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Calling method '.version_select at 0x7f54f6dd2310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.209204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:07.209204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:07.216687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:07.289398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:07.290637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:07.291676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:07.316800 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a11ef761-203f-46d1-8f1b-c8cf63bf1580 tempest-HypervisorAdminV228Test-1984760980 tempest-HypervisorAdminV228Test-1984760980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.116767 Oct 04 20:31:07.329439 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 70/130] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:07.357123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66190a16-7e17-49df-89b5-02cafb3ae527 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.392364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66190a16-7e17-49df-89b5-02cafb3ae527 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/367720998/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.059840 Oct 04 20:31:07.405257 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 71/131] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/flavors/367720998/os-extra_specs => generated 19 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:07.419116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.424831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:07.430579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:07.435837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:07.439509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:07.440781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:07.443534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:07.444281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:07.557862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:07.585774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d7a4945-8ed6-45ee-ae4e-5cafcfe85777 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.095860 Oct 04 20:31:07.627123 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 61/132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:06 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:07.661501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:07.661969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e587015-3e17-440c-8554-6cc715af9c3a tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.689838 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6ac862ab-4903-4ba1-a000-36a5d54081ee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1264 microversion: 2.1 time: 0.281156 Oct 04 20:31:07.695746 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 72/133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1264 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:07.884591 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e587015-3e17-440c-8554-6cc715af9c3a tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/367720998" status: 202 len: 0 microversion: 2.1 time: 0.243783 Oct 04 20:31:07.884591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 62/134] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:07 2022] DELETE /compute/v2.1/flavors/367720998 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:07.888937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7cce734-3e1e-4996-b50c-ed86a38dba98 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:07.946907 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7cce734-3e1e-4996-b50c-ed86a38dba98 tempest-FlavorsExtraSpecsTestJSON-320093461 tempest-FlavorsExtraSpecsTestJSON-320093461-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061680 Oct 04 20:31:07.971643 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 73/135] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:08.211502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:08.213013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:08.254941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:08.266469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:08.267245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:08.272847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:08.273416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:08.273857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:08.817195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14717528-b8cd-4ff9-841b-da8ad78a852f", "tag": "473a681e-ce0f-4fbc-896e-fd879714101e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:08.926562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:08.930718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:08.935409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:09.081516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Creating event network-changed:473a681e-ce0f-4fbc-896e-fd879714101e for instance 14717528-b8cd-4ff9-841b-da8ad78a852f on n-h2-851029-13 Oct 04 20:31:09.081516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:31:09.081516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c91549ce-f03a-407f-93d6-79ff9daa5cf7 req-40e7a761-a358-4806-b99a-d7ccf7b37342 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:31:09.083769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:09.084619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:09.086148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:09.088813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:09.089531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:09.090147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:09.117689 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.rpcapi [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:31:09.134603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] Releasing lock "compute-rpcapi-router" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:31:09.163900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c88cbc8-a090-4ef6-8b77-ec1000b3e761 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.084682 Oct 04 20:31:09.169352 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 63/136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:09.184860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:09.196801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:09.228634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:09.232608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:09.232608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:09.233204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:09.249758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:09.251198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:10.072926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:10.108111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32e3fa08-8f7e-4ec7-b330-1c2653ffd1b2 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.903941 Oct 04 20:31:10.120751 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 74/137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:08 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:10.149492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:10.162157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:10.197486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:10.198403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:10.199368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:10.200969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:10.201870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:10.202848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:10.352570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:10.379871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a21f17d-11dd-40f7-8269-dc28abd55b76 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.206230 Oct 04 20:31:10.386783 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 64/138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:09 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:10.660278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:10.671157 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44972311-2891-4a66-bf0c-0813e8d411a1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1270 microversion: 2.1 time: 0.537088 Oct 04 20:31:10.693274 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 75/139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:10 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1270 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:11.155235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:11.160377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:11.187425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.190839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.193476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.198134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.199705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.201529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.436733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:11.440394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:11.450088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:11.488346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.489256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.490054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:11.491415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:11.492356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:11.493120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:12.959833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:12.983226 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b3fb3891-98c2-41f6-a3f7-97d51f3e3ea6 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.559922 Oct 04 20:31:12.997288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 76/140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:11 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:13.020449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:13.026748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:13.056555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:13.059904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:13.064316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:13.066276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:13.068587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:13.071505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:13.221456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:13.295663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27d059b9-a608-4934-b9fc-978df13cafc1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 2.147667 Oct 04 20:31:13.299494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 65/141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:11 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.019039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:14.175939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:14.204366 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-782c70e4-a1b8-42db-ba14-115e23fc4982 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1270 microversion: 2.1 time: 1.204853 Oct 04 20:31:14.214542 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 77/142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:12 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1270 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:14.234099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.244645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:14.274346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:14.281739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:14.288813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:14.295379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:14.298383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:14.299104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:14.700369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-45a5708a-d8bb-4425-ab05-22f3fd9a89d9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.780474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-45a5708a-d8bb-4425-ab05-22f3fd9a89d9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.156227 Oct 04 20:31:14.806609 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 66/143] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:31:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:14.837328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:14.844953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:14.875441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:14.878129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:14.884951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:14.888367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:14.890023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:14.892675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:15.516381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:15.992374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.017444 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c9da48d-2f9c-4803-bd6c-fa9dfc712d9e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.800668 Oct 04 20:31:16.020441 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 78/144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:16.365591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.365591 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3e668c8f-1def-4190-941e-123cf820d327 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.467953 Oct 04 20:31:16.365591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 67/145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:14 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:16.365591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:16.368160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:16.368160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:16.368160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:16.368160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:16.369984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:16.369984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:16.369984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:16.954398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:16.988231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da6afd15-1d5e-47d3-a6c3-2c1e6a366929 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.699016 Oct 04 20:31:16.989713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 68/146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:16 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:17.063047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:17.067057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:17.099956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:17.112049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:17.112832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:17.114402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:17.115257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:17.124273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:17.941549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:17.954215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b01471c5-b793-436e-9864-a47a705c0870 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1728085328", "id": 1527132680, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:17.986253 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5036cd97-49a0-49fe-8ae3-331380045171 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.930211 Oct 04 20:31:18.011659 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 69/147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:17 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:18.050698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:18.053416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:18.069118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.070576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.072133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.074084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.075501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.077034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.152074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b01471c5-b793-436e-9864-a47a705c0870 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 2.127077 Oct 04 20:31:18.171478 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 79/148] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:16 2022] POST /compute/v2.1/flavors => generated 425 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:18.180702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:18.184176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:18.244154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.245542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.247959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.253601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:18.261594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:18.262974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:18.865353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:18.887327 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bbb8e4a-7b28-4066-b74a-d962b02d5a79 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 0.873985 Oct 04 20:31:18.889573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 70/149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:18 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:18.906457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20ec88f0-4166-44a1-a2ae-709294c31a38 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:18.935003 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20ec88f0-4166-44a1-a2ae-709294c31a38 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034137 Oct 04 20:31:18.948120 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 71/150] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 4 20:31:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:18.961317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:18.988480 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-964cc3ad-03ee-4ed1-8730-995e8610bd36 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.827364 Oct 04 20:31:19.004277 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 80/151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:18 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:19.036034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b83ebd62-95de-4872-82ea-185cf71cc921 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-899797241", "id": 1255441963, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:19.058051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:19.117975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:19.148966 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b83ebd62-95de-4872-82ea-185cf71cc921 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.129900 Oct 04 20:31:19.153629 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 81/152] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:19 2022] POST /compute/v2.1/flavors => generated 424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:19.167367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:19.179199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:19.240569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:19.242611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:19.248275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:19.250312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:19.252469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:19.256704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:19.731746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ea008e1-300b-4ca3-aac3-83d35b285773 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-510520537", "id": 197141298, "os-flavor-access:is_public": "False"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:19.772247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:19.851292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ea008e1-300b-4ca3-aac3-83d35b285773 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.901501 Oct 04 20:31:19.865344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 72/153] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:18 2022] POST /compute/v2.1/flavors => generated 427 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:19.878355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-468cd31a-07a3-4600-9514-19cd8e0d4bd1 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:19.900633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-468cd31a-07a3-4600-9514-19cd8e0d4bd1 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033535 Oct 04 20:31:19.904878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 73/154] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 4 20:31:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:19.927277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bae487df-7878-4576-8aba-35dce94b0e66 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9bed456657384b9fba6086c6b9f46623"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:20.194131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:20.254548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25229ab2-90fa-4ebc-babd-c31453a3795a tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 1.094213 Oct 04 20:31:20.266356 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 82/155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:19 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:20.296569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4e1c55b-62e4-4df5-852f-fbf535d071d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Action: 'create', calling method: .version_select at 0x7f54f6da7e50>, body: {"keypair": {"name": "tempest-keypair-1871138313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvzSK/dg6L01lvm4a0OJEbqPZFKWFNZqcL+TNXXCNH7lm8x3NU2sLzzgGBrCnYERi0RNbKp7qXnaLxiJ1FDZzlNqNDpPBMKYwMPuD58/xmKRqvQWmA1BEWY4inwt0/5WA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:20.404702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bae487df-7878-4576-8aba-35dce94b0e66 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/197141298/action" status: 200 len: 96 microversion: 2.1 time: 0.480539 Oct 04 20:31:20.405521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c4e1c55b-62e4-4df5-852f-fbf535d071d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:20.407374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 74/156] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:19 2022] POST /compute/v2.1/flavors/197141298/action => generated 96 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:20.417185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c4e1c55b-62e4-4df5-852f-fbf535d071d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for user 20b601a437764fb8890a2ca25d72367a and project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:20.455253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:20.456427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:20.486585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.488004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.489268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:20.491475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.493025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.494822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:20.556078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4e1c55b-62e4-4df5-852f-fbf535d071d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284565 Oct 04 20:31:20.558521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 83/157] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:31:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:20.616263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:20.618769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:20.654049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.658817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.660714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:20.664359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:20.668780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:20.675392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.335606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:21.410773 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78d8fbea-5b08-473d-8333-3dace64fcea8 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 0.989491 Oct 04 20:31:21.416983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 75/158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:20 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:21.470941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:21.507211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6c5f80f-c9c9-415b-a7d1-dfaa8c043f9c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.940413 Oct 04 20:31:21.523352 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 84/159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:20 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:21.586291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:21.586291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:21.602546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.607131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.608046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.609637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:21.612607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:21.615816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:21.962494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:21.979791 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aad51f1c-57c7-4fb0-a57b-5dcef3ac5228 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.454300 Oct 04 20:31:22.004351 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 85/160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:21 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:22.401800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:22.441579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:22.445241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:22.450647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:22.509057 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] Creating event network-changed:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h1-851029-13 Oct 04 20:31:22.556281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ed20f1e2-bec1-4f32-bfd8-75c6faebd134 req-414b6541-611a-4c1d-b0b6-5a8c6c0cf3ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161372 Oct 04 20:31:22.563701 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 86/161] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:22.613282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:22.627673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:22.662253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:22.678710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:22.688827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:22.690330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:22.699389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:22.700437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:23.058094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e309ef35-7c26-4fa4-ae47-b01256697f59 tempest-FlavorsAccessTestJSON-2054045881 tempest-FlavorsAccessTestJSON-2054045881-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:23.174279 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e309ef35-7c26-4fa4-ae47-b01256697f59 tempest-FlavorsAccessTestJSON-2054045881 tempest-FlavorsAccessTestJSON-2054045881-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 1.755039 Oct 04 20:31:23.180437 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 76/162] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:21 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:23.190453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:23.211382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:23.251507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:23.252792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:23.253845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:23.255750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:23.257158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:23.258485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:24.241975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:24.280030 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d48c4b0a-2c06-4206-b8b2-51b51cd36d22 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 1.096298 Oct 04 20:31:24.296065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 77/163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:23 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:24.362833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:24.364802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:24.427569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:24.431544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:24.440507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:24.445299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:24.455111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:24.456524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:24.505057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:24.524667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9e833cc-6a07-4c5b-8bb1-705c32527c38 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 1.947719 Oct 04 20:31:24.533762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 87/164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:22 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:24.556650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8335914-4250-48af-8fda-1e2c0cff3377 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9bed456657384b9fba6086c6b9f46623"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:25.075726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:25.101673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6b089cc-7a73-4271-ab29-058de9e6cbd2 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.803149 Oct 04 20:31:25.103481 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 78/165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:24 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:25.320105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.323254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:25.338379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.339778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.340959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:25.342757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.344214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.346213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:25.517066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8335914-4250-48af-8fda-1e2c0cff3377 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/197141298/action" status: 200 len: 21 microversion: 2.1 time: 0.975020 Oct 04 20:31:25.518287 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 88/166] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 4 20:31:24 2022] POST /compute/v2.1/flavors/197141298/action => generated 21 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:25.727576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:25.754808 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3282cf36-a03a-4cb3-a8e9-cd74376dcf42 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.441585 Oct 04 20:31:25.768381 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 79/167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:25.786558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29213cd5-2cbf-4764-b491-80064b725f72 tempest-FlavorsAccessTestJSON-2054045881 tempest-FlavorsAccessTestJSON-2054045881-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.837480 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29213cd5-2cbf-4764-b491-80064b725f72 tempest-FlavorsAccessTestJSON-2054045881 tempest-FlavorsAccessTestJSON-2054045881-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.077532 Oct 04 20:31:25.838405 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 80/168] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:25.848771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:25.850809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:25.882766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.883639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.889871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:25.894853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:25.895965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:25.896711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.249111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d290913d-911d-4ff5-bb26-c31d002992a7", "name": "network-vif-plugged", "status": "completed", "tag": "ad62b44e-1457-4115-bf5b-10b0230b958a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:26.302193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.303545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.306085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.349358 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] Creating event network-vif-plugged:ad62b44e-1457-4115-bf5b-10b0230b958a for instance d290913d-911d-4ff5-bb26-c31d002992a7 on n-h2-851029-13 Oct 04 20:31:26.372104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e36e1803-b7b0-4ddb-a93e-e9a7470536e9 req-6d3cc8c7-baf9-41c8-b3f1-92c794af3e79 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.847770 Oct 04 20:31:26.373747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 89/169] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:26.390542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c59624a3-67da-46a0-95da-55ae49d5b155 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.454560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:26.473457 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13246451-e69f-4421-85a0-d84cfd0bce75 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 0.632865 Oct 04 20:31:26.475438 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 81/170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:25 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:26.485644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.487480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:26.517789 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c59624a3-67da-46a0-95da-55ae49d5b155 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/197141298" status: 202 len: 0 microversion: 2.1 time: 0.139612 Oct 04 20:31:26.518860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.518983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 90/171] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:26 2022] DELETE /compute/v2.1/flavors/197141298 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:26.520441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.521544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.534446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc7b3e55-4605-49bd-811c-c19f918568db tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.535569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.536314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.537155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.629981 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc7b3e55-4605-49bd-811c-c19f918568db tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.105156 Oct 04 20:31:26.632070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 91/172] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:26.674095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a753b7b0-a8f4-4fb5-950e-a98f8d85afd7 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1852972997", "id": 465001767, "os-flavor-access:is_public": "False"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:26.793788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a753b7b0-a8f4-4fb5-950e-a98f8d85afd7 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.135009 Oct 04 20:31:26.796016 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 92/173] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:26 2022] POST /compute/v2.1/flavors => generated 428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:26.812772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:26.818434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:26.839661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.841038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.842588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:26.852945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:26.852945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:26.852945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:27.248362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:27.254635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:27.256241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:27.266990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a69facac-9e27-4199-b08d-33b7b61e27fa tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.467998 Oct 04 20:31:27.267810 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 93/174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:26 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:27.270879 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f906342-e4ca-4190-a386-a608595f248e tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.793285 Oct 04 20:31:27.271848 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 82/175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:26 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:27.278272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34f4e691-df47-4abd-b47d-f219d0f9baa4 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:27.305773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34f4e691-df47-4abd-b47d-f219d0f9baa4 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/465001767/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036269 Oct 04 20:31:27.314003 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 94/176] 10.222.0.36 () {58 vars in 1206 bytes} [Tue Oct 4 20:31:27 2022] GET /compute/v2.1/flavors/465001767/os-flavor-access => generated 21 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:27.326705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-803526613", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "1255441963", "adminPass": "***", "networks": [{"uuid": "4a69d721-5ecf-4825-99a2-8ce83fba70b8"}], "security_groups": [{"name": "tempest-securitygroup--1433479041"}], "key_name": "tempest-keypair-1871138313", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:27.522653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] validate_networks() for [('4a69d721-5ecf-4825-99a2-8ce83fba70b8', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:27.558884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b7f43e9-2b12-4f58-8e09-4a457d4fdcc6 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1896898343", "id": 318639958, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:27.708306 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b7f43e9-2b12-4f58-8e09-4a457d4fdcc6 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.434723 Oct 04 20:31:27.709211 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 83/177] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:31:27 2022] POST /compute/v2.1/flavors => generated 446 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:27.729775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a174294b-cd5f-4334-a8c6-60b6c0c7a5a7 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:27.826495 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a174294b-cd5f-4334-a8c6-60b6c0c7a5a7 tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/465001767" status: 202 len: 0 microversion: 2.1 time: 0.116003 Oct 04 20:31:27.827551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 84/178] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:31:27 2022] DELETE /compute/v2.1/flavors/465001767 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:27.895987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22371805-3f72-4853-a7ab-5a1df6d70721 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6f3f4c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.004633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22371805-3f72-4853-a7ab-5a1df6d70721 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2" status: 200 len: 371 microversion: 2.1 time: 0.174908 Oct 04 20:31:28.006191 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 85/179] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:31:27 2022] GET /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2 => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:28.024751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.025412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:28.032823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.033592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.034034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.034858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.035276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.035703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.351378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:28.355167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:28.366492 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a3503e7-3289-44a5-b1f0-5d1cc28ab4ec tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1340 microversion: 2.1 time: 0.346313 Oct 04 20:31:28.367636 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 86/180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1340 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:28.498168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94cbb5e7-560a-46d7-bdee-132705b9f713 tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.509922 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94cbb5e7-560a-46d7-bdee-132705b9f713 tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] 10.222.0.36 "GET /compute/v2.1/flavors/318639958" status: 200 len: 446 microversion: 2.55 time: 0.140740 Oct 04 20:31:28.510895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 87/181] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/flavors/318639958 => generated 446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:28.511075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:31:28.511592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:31:28.512752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:31:28.513784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:31:28.514640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:31:28.516132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79fbd7d8-170c-4595-bc61-1f02a5491bbe tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.531790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.532741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.533140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.534133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.534721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.535273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.545453 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79fbd7d8-170c-4595-bc61-1f02a5491bbe tempest-FlavorsAccessTestJSON-1490338088 tempest-FlavorsAccessTestJSON-1490338088-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.033632 Oct 04 20:31:28.546348 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 88/182] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:28.556233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Action: 'update', calling method: .version_select at 0x7f54f7088e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:28.561546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:28.570491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for user 20b601a437764fb8890a2ca25d72367a and project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:28.598564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:31:28.601897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:31:28.680647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.681330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.681607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.682605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.683106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.683568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.779405 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b481f02-5394-477a-81a8-88a9d1837faf tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.463642 Oct 04 20:31:28.781003 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 95/183] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:31:28.787927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.788761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:28.798395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.799010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.803666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.803666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.803666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.803666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.867634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ae1f771-c1dc-4b37-8720-969b10b2fa03 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2" status: 200 len: 328 microversion: 2.1 time: 0.319291 Oct 04 20:31:28.872195 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 89/184] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:28 2022] PUT /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2 => generated 328 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:28.880854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:28.887793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:28.898461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.905018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.905018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:28.905018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:28.905018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:28.905391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.103870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.118409 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f71ca231-ce36-4ce0-9109-2b72070ea657 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.335488 Oct 04 20:31:29.130220 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 96/185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.147338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14717528-b8cd-4ff9-841b-da8ad78a852f", "name": "network-vif-plugged", "status": "completed", "tag": "473a681e-ce0f-4fbc-896e-fd879714101e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:29.169951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:29.171084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:29.171838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.195518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] Creating event network-vif-plugged:473a681e-ce0f-4fbc-896e-fd879714101e for instance 14717528-b8cd-4ff9-841b-da8ad78a852f on n-h2-851029-13 Oct 04 20:31:29.206055 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-59b98d6e-aa0f-4da3-8107-723f2f0e6fb3 req-430a40ec-c35e-4230-9ec1-d167834e9ae5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073300 Oct 04 20:31:29.208194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 97/186] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:29.220258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2116fe4a-b8dd-40ae-916b-9ba947dc6ed7 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] Action: 'update', calling method: .version_select at 0x7f54f816a670>, body: {"flavor": {"description": "new"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:29.350611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.394113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e299de06-b013-4ee6-bcee-55d6279dc24e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.522798 Oct 04 20:31:29.396528 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 90/187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:28 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.406477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a848bae-6a60-4cca-907c-eb787a5840ad tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.408056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a848bae-6a60-4cca-907c-eb787a5840ad tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:29.468402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2116fe4a-b8dd-40ae-916b-9ba947dc6ed7 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/318639958" status: 200 len: 447 microversion: 2.55 time: 0.256557 Oct 04 20:31:29.469485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 98/188] 10.222.0.36 () {62 vars in 1216 bytes} [Tue Oct 4 20:31:29 2022] PUT /compute/v2.1/flavors/318639958 => generated 447 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:31:29.480498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83ba95a1-8444-4fd4-a347-02bab1083ff7 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.544539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a848bae-6a60-4cca-907c-eb787a5840ad tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.555755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a848bae-6a60-4cca-907c-eb787a5840ad tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1264 microversion: 2.1 time: 0.157579 Oct 04 20:31:29.556933 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 91/189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.580518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.581228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:29.589453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:29.590046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:29.590614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.591650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:29.592247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:29.592809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:29.611713 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83ba95a1-8444-4fd4-a347-02bab1083ff7 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2" status: 202 len: 0 microversion: 2.1 time: 0.139780 Oct 04 20:31:29.612722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 99/190] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 20:31:29 2022] DELETE /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:29.622124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bf8fc43-6758-4198-b40b-2348eaed5dbb tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.673899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bf8fc43-6758-4198-b40b-2348eaed5dbb tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.058797 Oct 04 20:31:29.675343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 100/191] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:29.683150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7eacf530-e308-4ed3-ae8b-c2e152aa7745 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6ce0160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.900625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:29.918695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e66c7c2-adbd-4d12-9d31-517868f45ff0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1489 microversion: 2.1 time: 0.354341 Oct 04 20:31:29.920413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 92/192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1489 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:29.930179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7152b6f2-78eb-40c3-84e5-f7401bdbeab2 tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:29.969852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7152b6f2-78eb-40c3-84e5-f7401bdbeab2 tempest-FlavorsV255TestJSON-1666514958 tempest-FlavorsV255TestJSON-1666514958-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.047938 Oct 04 20:31:29.971059 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 93/193] 10.222.0.36 () {60 vars in 1166 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:30.102594 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7eacf530-e308-4ed3-ae8b-c2e152aa7745 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2" status: 200 len: 371 microversion: 2.1 time: 0.425026 Oct 04 20:31:30.116901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 101/194] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:31:29 2022] GET /compute/v2.1/os-quota-sets/8bee800ef7ce45e1bfc569b6447029e2 => generated 371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:30.116901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f05355b-9ab3-4edc-990a-7c58bdae770c tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.225230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.227187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:30.242990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.244019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.244790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.247298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.247766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.249795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.345683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:31:30.415781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f05355b-9ab3-4edc-990a-7c58bdae770c tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/318639958" status: 202 len: 0 microversion: 2.55 time: 0.310279 Oct 04 20:31:30.429247 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 102/195] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Oct 4 20:31:30 2022] DELETE /compute/v2.1/flavors/318639958 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:31:30.441678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.443967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:30.448747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=84,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:30.463569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.464721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.465595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.466933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.468451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.471193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.686136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:30.686136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57f2049e-0992-4f09-a856-89172f69ef66 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1338 microversion: 2.1 time: 0.250446 Oct 04 20:31:30.686136 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 103/196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:30 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:30.687601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad9b5c5f-5f1e-46bd-8758-e0a744946dc2 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.710459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad9b5c5f-5f1e-46bd-8758-e0a744946dc2 tempest-FlavorsV255TestJSON-1066501994 tempest-FlavorsV255TestJSON-1066501994-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.026612 Oct 04 20:31:30.711092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 104/197] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:31:30 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:30.715738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.716343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:30.723990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.724472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.724941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.725703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:30.731416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:30.731416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:30.921712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:30.932740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15b256ab-7a30-40ac-b577-7d10738fbf38 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.220527 Oct 04 20:31:30.934343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 105/198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:30 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:30.941000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-212facd8-5c4b-4c50-928b-15bc8a1c1b22 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:30.943320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-212facd8-5c4b-4c50-928b-15bc8a1c1b22 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.012274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-212facd8-5c4b-4c50-928b-15bc8a1c1b22 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:31.020426 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-212facd8-5c4b-4c50-928b-15bc8a1c1b22 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1264 microversion: 2.1 time: 0.084579 Oct 04 20:31:31.021513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 106/199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:30 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1264 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:31.029640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e9e6f69-3b11-4ec6-aaf0-8203c6ad3445 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6dd2820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.148152 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20becea4-abc5-47ef-86f2-99a9f4c84d69 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 204 len: 0 microversion: 2.1 time: 1.175377 Oct 04 20:31:31.148987 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 94/200] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:29 2022] DELETE /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:31:31.159482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.160243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.344744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.345231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.345671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.346397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.346984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.347415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.611599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:31.623722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19fd4383-db71-4585-81fa-96a4cabeedba tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1495 microversion: 2.1 time: 0.468453 Oct 04 20:31:31.625144 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 95/201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1495 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:31.787053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.787053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.787053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.787053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.787705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.787705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.787705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.787705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.932510 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e9e6f69-3b11-4ec6-aaf0-8203c6ad3445 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599/defaults" status: 200 len: 371 microversion: 2.1 time: 0.908905 Oct 04 20:31:31.946827 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 107/202] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599/defaults => generated 371 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:31.961542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:31.963795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:31.978171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.979899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.981160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:31.982892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:31.984036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:31.985247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.111846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:32.111846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1165ae39-f609-4048-a967-56fbdb265183 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1488 microversion: 2.1 time: 0.328379 Oct 04 20:31:32.111846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 96/203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1488 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:32.111846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.113218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:32.113218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.113218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.113218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.113650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.113650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.113650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.286834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:32.301197 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70ae6be5-8c79-4960-be29-7b5f3fb31d7b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1268 microversion: 2.1 time: 0.245606 Oct 04 20:31:32.301197 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 97/204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:32.308059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.308668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:32.323585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.324083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.324502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.331807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.333016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.333661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.387501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:32.398089 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6dd43cf5-0ec3-4b7e-afa5-65e83804ad16 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.445726 Oct 04 20:31:32.405962 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 108/205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:31 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:32.655382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:32.656580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:32.700314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.704108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.705227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.709139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:32.711058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:32.712939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:32.996622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cfaf1967-ec1f-47dc-9341-7734656265e5 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1641 microversion: 2.1 time: 0.689556 Oct 04 20:31:32.998365 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 98/206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1641 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:33.021146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.021799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:33.026718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:33.030878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.037324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.037324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.037324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.037324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.037754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.072046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:31:33.256926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:33.270239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee2e8312-a109-44f5-9bfb-b2687c26b0ad tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1495 microversion: 2.1 time: 0.623725 Oct 04 20:31:33.271182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 109/207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:32 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1495 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:33.279097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6ce0310>, body: {"quota_set": {"ram": "5120"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:33.603953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.604597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.605142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.606003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.606749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.607406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.709219 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e83291c-3aa4-45f4-816f-b3f752a75e47 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "DELETE /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 204 len: 0 microversion: 2.1 time: 0.691517 Oct 04 20:31:33.711219 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 99/208] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:33 2022] DELETE /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:31:33.723530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.724622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:33.734479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.735434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.736096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.737084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.747840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.748610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.822098 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75099cd8-6b1e-4527-90db-6e4baf049c2b tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8" status: 200 len: 328 microversion: 2.1 time: 0.547544 Oct 04 20:31:33.825246 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 110/209] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:31:33 2022] PUT /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8 => generated 328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:33.842356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:33.849329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:33.875730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.877734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.882302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.888163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:33.889349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:33.893235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:33.994853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:33.994853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e835b3-5c61-4777-a88c-af7e3e577382 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1316 microversion: 2.1 time: 0.266664 Oct 04 20:31:33.994853 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 100/210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:33 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:33.995809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:34.006733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:34.016801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.017373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.018004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.021794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:34.022500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:34.023315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:34.818374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:34.835207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77aacb1a-e146-48a2-bede-6cc43ebb9440 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 1.007811 Oct 04 20:31:34.839877 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 111/211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:33 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:34.863947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6c99670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.041715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:35.070327 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8339ff0c-e301-432b-bc1d-2ec121a565db tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1494 microversion: 2.1 time: 1.083879 Oct 04 20:31:35.080475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 101/212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:33 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1494 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:35.087992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d290913d-911d-4ff5-bb26-c31d002992a7", "name": "network-vif-deleted", "tag": "ad62b44e-1457-4115-bf5b-10b0230b958a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:35.121189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.122042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.122643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.168936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] Creating event network-vif-deleted:ad62b44e-1457-4115-bf5b-10b0230b958a for instance d290913d-911d-4ff5-bb26-c31d002992a7 on n-h2-851029-13 Oct 04 20:31:35.181946 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8d435c0a-c831-402c-a3b6-0a2d26ba9dd4 req-c41e2072-9efc-41d3-b9be-ddcfb31761c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106035 Oct 04 20:31:35.183141 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 102/213] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:35.196013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.197367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:35.212668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.214170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.215575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.217290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.219290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.220801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.442924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:35.465159 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6793ccda-610a-4a8e-b2b4-ea5d49bf822c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 200 len: 1325 microversion: 2.1 time: 0.279306 Oct 04 20:31:35.474133 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 103/214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:35 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:35.494723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "name": "network-vif-plugged", "status": "completed", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:35.527801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.529044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.530099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.559730 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] Creating event network-vif-plugged:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h1-851029-13 Oct 04 20:31:35.589641 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f97beb7e-9f7a-4a41-951c-d78d23652ab0 req-4d98a2eb-92d6-481a-8714-a741dfb6173a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112852 Oct 04 20:31:35.591798 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 104/215] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:35.604162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.606144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:35.627354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.627354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.627354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.629050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.630084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.632592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.662049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.663310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.664490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.666321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.667669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.668981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.714097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8ff3d0a-eb73-4179-a362-ea5355f8824f tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8/detail" status: 200 len: 916 microversion: 2.1 time: 0.871836 Oct 04 20:31:35.722541 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 112/216] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:31:34 2022] GET /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8/detail => generated 916 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:35.907534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:35.908622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:35.914586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:35.937189 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f02ffc41-7df0-4bf3-a1ba-7301c1c6cb21 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1322 microversion: 2.1 time: 0.341203 Oct 04 20:31:35.943864 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 105/217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:35 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:35.967716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.970566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.975809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:35.978488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:35.979994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:35.980733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.123443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:36.125277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:36.147823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.149014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.150155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.151900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.153111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.154259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.209051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:36.775443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:36.780585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:36.800656 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-100bf9af-b709-42d3-99a0-3e81aa48a9cf tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1494 microversion: 2.1 time: 0.684915 Oct 04 20:31:36.802891 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 106/218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:36 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1494 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:36.807306 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fa860d0-a872-4df7-ad15-668b537e2d95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1312 microversion: 2.1 time: 0.929150 Oct 04 20:31:36.813497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6ef25e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:36.825651 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 113/219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:35 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1312 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:36.850364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:36.852634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:36.889187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.894799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.895622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.896910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:36.897826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:36.898494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:36.947772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 HTTP/1.1 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:31:36.967426 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:31:36.970701 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd290913d-911d-4ff5-bb26-c31d002992a7'} Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:36.972921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:31:36.977468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:37.000033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:37.000033 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56603adc-ea04-455e-8805-a23e3cb9d61b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 404 len: 111 microversion: 2.1 time: 0.149849 Oct 04 20:31:37.000033 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:36 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:37.000033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:37.000033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:37.011016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.011900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.013234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.014609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.015501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.016467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.224250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:37.252577 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bc23e4c-ce7c-4d0e-b100-15859e8b427c tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1322 microversion: 2.1 time: 0.270642 Oct 04 20:31:37.271417 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 115/221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:36 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:37.334283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.335143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.335483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.337610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.337610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.338202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.396759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.397634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.398395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.399804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:37.400621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:37.401374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:37.503510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1892238608", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:37.641644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:31:37.706270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-287e5810-91de-48b5-bb22-64bab32752c3 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8?user_id=ba4947c9e7284772872a07f380921169" status: 200 len: 328 microversion: 2.1 time: 0.897342 Oct 04 20:31:37.707201 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 107/222] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:31:36 2022] PUT /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8?user_id=ba4947c9e7284772872a07f380921169 => generated 328 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:37.735750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ee5191b-147b-4b2c-b3c8-cf8cd3730d91 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6d98c10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.243208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:31:38.244028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:31:38.244612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:31:38.245313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:31:38.246050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:31:38.285162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.287001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.288331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.290295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.291277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.292060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.346901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Getting quotas for project 05e82b6f1ee143b2b285a424cab7b8f8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:31:38.372749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Getting quotas for user e953b401d7cd4ff8b8547760cf0caa4d and project 05e82b6f1ee143b2b285a424cab7b8f8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:31:38.403170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:31:38.411186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:31:38.753842 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ed2e036-147a-4dc7-8671-ae218d03c3c9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251853 Oct 04 20:31:38.755251 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 116/223] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:31:38.785513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.787253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:38.801602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.823513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.823513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.827790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.828739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.831183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.833943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ee5191b-147b-4b2c-b3c8-cf8cd3730d91 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8?user_id=ba4947c9e7284772872a07f380921169" status: 200 len: 370 microversion: 2.1 time: 1.106887 Oct 04 20:31:38.846908 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 108/224] 10.222.0.36 () {58 vars in 1323 bytes} [Tue Oct 4 20:31:37 2022] GET /compute/v2.1/os-quota-sets/061f8b31182e48baa16cc607987028b8?user_id=ba4947c9e7284772872a07f380921169 => generated 370 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:38.874600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:38.874855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:38.890576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.892383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.893443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.895016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.896206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.897252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.975157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:38.979677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:38.980704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:38.984488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lazy-loading 'fault' on Instance uuid 14717528-b8cd-4ff9-841b-da8ad78a852f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:31:39.140830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8652c21a239e4828841774b892990f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f23134f1444a994c667625d3ef10a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:39.164707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20d5dbed-ffb4-41d0-8ac7-ea42db6c1597 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 200 len: 1328 microversion: 2.1 time: 0.404492 Oct 04 20:31:39.166148 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 117/225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 1328 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:39.190587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14717528-b8cd-4ff9-841b-da8ad78a852f", "name": "network-vif-deleted", "tag": "473a681e-ce0f-4fbc-896e-fd879714101e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:39.222065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.223556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.224441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.256722 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] Creating event network-vif-deleted:473a681e-ce0f-4fbc-896e-fd879714101e for instance 14717528-b8cd-4ff9-841b-da8ad78a852f on n-h2-851029-13 Oct 04 20:31:39.270274 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8cb19c1c-7a55-436e-abac-195403595639 req-2e9c182d-427f-4888-b46f-521865098add service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096531 Oct 04 20:31:39.271991 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 118/226] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:39.285333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.294133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:39.302778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.303974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.304977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.306306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:39.307178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:39.308058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:39.632285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:39.709729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b2bdb26-2c71-45d6-aeef-c61780899b63 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1461 microversion: 2.1 time: 0.858954 Oct 04 20:31:39.716448 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 109/227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:38 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1461 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:39.732404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ee1b05c-fea6-4e33-a5ad-4d1f9293bdaf tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:39.734164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ee1b05c-fea6-4e33-a5ad-4d1f9293bdaf tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:39.855928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:39.882249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c236c4b-5a3d-4aa5-aac4-8906abd3b8df tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.607534 Oct 04 20:31:39.883859 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 119/228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:39.937620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ee1b05c-fea6-4e33-a5ad-4d1f9293bdaf tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:39.957200 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ee1b05c-fea6-4e33-a5ad-4d1f9293bdaf tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1220 microversion: 2.1 time: 0.238132 Oct 04 20:31:39.959055 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 110/229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:40.221795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:40.227361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:40.264524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.265786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.266712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.267588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.268116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.268678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.311799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] HTTP exception thrown: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Request method failure captured: Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f HTTP/1.1 Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjyOKpB5kC1Asrb_BEwT2gf8aqXO7hm7NmQX441umQ82o-mizzgCicTcrMBRWDrQbcjr4I7lYVXv_ZOsn-9R1qAQB-DRb37R8YMEfUwTe6M8-ejbuvGO5G10Zmn1dlq5Av_Dg4MwKnTzQxHn2HC1spLulDLjaCHY9kZNaR3UcXxkM Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:31:40.316585 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8652c21a239e4828841774b892990f1c Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:31:40.326352 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '14717528-b8cd-4ff9-841b-da8ad78a852f'} Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:40.328011 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:31:40.330738 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:40.332651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Returning 404 to user: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:40.332651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-224a88e8-c4ea-4480-b3ba-d4967dc66da7 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 404 len: 111 microversion: 2.1 time: 0.109089 Oct 04 20:31:40.332651 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 111/230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:40 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:40.336521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6764938b-3e9a-4a3e-869c-11ed92451b80", "tag": "f19fd326-6c0f-48df-b71d-22d1c13f7a5c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:40.376896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.377531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.378259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.414316 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] Creating event network-changed:f19fd326-6c0f-48df-b71d-22d1c13f7a5c for instance 6764938b-3e9a-4a3e-869c-11ed92451b80 on n-h1-851029-13 Oct 04 20:31:40.430117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-118d6b64-e1c4-4099-831c-a0496a720a55 req-427422e4-20f9-41fa-b368-4b2ce76f8c6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100541 Oct 04 20:31:40.431372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 112/231] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:40.447417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2137c1f5-3db9-4dfd-8272-5c05fd2ab021 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Calling method '.version_select at 0x7f54f6cfcf70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:40.752690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:40.755009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:40.770900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.772405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.773693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:40.775571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:40.776780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:40.778135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.099180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2137c1f5-3db9-4dfd-8272-5c05fd2ab021 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599/defaults" status: 200 len: 371 microversion: 2.1 time: 0.665775 Oct 04 20:31:41.101168 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 113/232] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:31:40 2022] GET /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599/defaults => generated 371 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:41.125222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-988b90cc-17c5-4ca7-8f73-4aa6ddaf50e4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:41.149788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-988b90cc-17c5-4ca7-8f73-4aa6ddaf50e4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.151459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-988b90cc-17c5-4ca7-8f73-4aa6ddaf50e4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.152326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-988b90cc-17c5-4ca7-8f73-4aa6ddaf50e4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.642520 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18659fec-863d-4415-b32a-c357db9b17bd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1614 microversion: 2.1 time: 1.756751 Oct 04 20:31:41.643939 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 120/233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:39 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1614 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:41.652980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:41.654641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:41.664653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.666383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.666909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.667670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.668144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.668702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.809482 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-988b90cc-17c5-4ca7-8f73-4aa6ddaf50e4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 297 microversion: 2.1 time: 0.706192 Oct 04 20:31:41.810705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 114/234] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:41 2022] POST /compute/v2.1/os-aggregates/3/action => generated 297 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:41.824065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:41.825373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:41.837966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.843537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.843537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.843537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:41.843537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:41.844078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:41.872802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:41.888947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b3b26445-8334-4bb5-b4c7-b58f0542b0de tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.243191 Oct 04 20:31:41.890072 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 121/235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:41 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:41.931738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6c13820>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:41.990981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:42.004872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1272 microversion: 2.1 time: 0.191363 Oct 04 20:31:42.006144 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 115/236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:41 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:42.016915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:42.018874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-680f6ddc-70a3-4ca3-b696-a716550ef2e0 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002506 Oct 04 20:31:42.019723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 116/237] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 4 20:31:42 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:31:42.030367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:42.032119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:42.044619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.047536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.048806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.050316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.051329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.052193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.270924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.271614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.272067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.273017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:42.273502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:42.274134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:42.828954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '563c3d0ee1b4446bbec8dd6bb495917d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9125b118d6543cdbfeab6b2ec3f73a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:42.829676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] flavor_id is None. Assuming migration. {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 20:31:42.830501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:31:43.329206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d48ff116-c313-41bb-94ff-c26d6b2fc778 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b/action" status: 202 len: 0 microversion: 2.1 time: 1.306836 Oct 04 20:31:43.330447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 117/238] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:31:42 2022] POST /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:43.340814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04bcec25-641c-462f-bd3a-b6b8156679d4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:43.516949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04bcec25-641c-462f-bd3a-b6b8156679d4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.184306 Oct 04 20:31:43.521415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 118/239] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:43 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:43.532326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:43.532772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:43.541862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.542545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.543438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.544283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:43.544745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:43.545143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:43.606971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:44.038952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:44.063015 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5706455f-f08e-4bb9-b53b-5ff54bb54265 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.537999 Oct 04 20:31:44.066895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 119/240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:43 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:44.089620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:44.091118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:44.103952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:44.104942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:44.105975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:44.109102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:44.111459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:44.112650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:44.289804 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a2c40e3-6b8d-49be-b85d-7929f8d56e92 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599" status: 200 len: 329 microversion: 2.1 time: 2.384421 Oct 04 20:31:44.307675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 122/241] 10.222.0.36 () {60 vars in 1263 bytes} [Tue Oct 4 20:31:41 2022] PUT /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599 => generated 329 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:44.633587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:44.660026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b30d46c-1923-48c4-bafb-d1723d754ae9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.584099 Oct 04 20:31:44.670048 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 120/242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:44 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:44.700670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:44.713331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:44.733513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:44.739616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:44.740777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:44.744122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:44.747968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:44.749249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:44.842016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ef8bb01-b116-4e40-abfa-35f76ff77333 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Calling method '.version_select at 0x7f54f6bdff70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:44.848668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ef8bb01-b116-4e40-abfa-35f76ff77333 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f42ddffaafd64d17a162c38ed65d13f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82232da42fcd464cac12fde714e05b58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ef8bb01-b116-4e40-abfa-35f76ff77333 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Request method failure captured: Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJgtX6BUap6oj9VUnb1SPrno7N9H-CpdVLef245KeOmGwFsZeB4-QS2TTKu8eZELJvfNBHODFalxhKJiTZXKFqKMpfabTX3fOBiAXYdiRoNehDG7swn0sb2Js5rtiyk6ocanz5fXmwYbAdEUOM28FHiL1K_rwA9b80LfNNTKF31Gpr0 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:31:44.852884 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82232da42fcd464cac12fde714e05b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82232da42fcd464cac12fde714e05b58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f42ddffaafd64d17a162c38ed65d13f2 Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:31:44.855785 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:44.857232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:31:44.861396 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:44.878962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ef8bb01-b116-4e40-abfa-35f76ff77333 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:44.878962 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ef8bb01-b116-4e40-abfa-35f76ff77333 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.567368 Oct 04 20:31:44.899777 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 123/243] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 20:31:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 598 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:44.914169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2cc96eb6-5bf4-48e7-ac1b-a92cb242028b tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1894100082"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:44.919391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-2cc96eb6-5bf4-48e7-ac1b-a92cb242028b tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid b379dd9c-287f-4c2e-b34e-612760316211 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:45.131992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2cc96eb6-5bf4-48e7-ac1b-a92cb242028b tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.229838 Oct 04 20:31:45.133212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 124/244] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:45.143827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6c135e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:45.572059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.597672 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6775d17e-7a30-4113-8e87-716da2e51abc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1470 microversion: 2.1 time: 0.925058 Oct 04 20:31:45.598765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 121/245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:44 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1470 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:45.612958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-535384b0-75fa-419f-b512-cc33b82c3b8a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Calling method '.version_select at 0x7f54f6c15f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:45.617039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-535384b0-75fa-419f-b512-cc33b82c3b8a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f42ddffaafd64d17a162c38ed65d13f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82232da42fcd464cac12fde714e05b58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-535384b0-75fa-419f-b512-cc33b82c3b8a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Request method failure captured: Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJgtX6BUap6oj9VUnb1SPrno7N9H-CpdVLef245KeOmGwFsZeB4-QS2TTKu8eZELJvfNBHODFalxhKJiTZXKFqKMpfabTX3fOBiAXYdiRoNehDG7swn0sb2Js5rtiyk6ocanz5fXmwYbAdEUOM28FHiL1K_rwA9b80LfNNTKF31Gpr0 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:31:45.620968 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82232da42fcd464cac12fde714e05b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82232da42fcd464cac12fde714e05b58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f42ddffaafd64d17a162c38ed65d13f2 Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:31:45.624060 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:45.625495 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:31:45.627176 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:45.629630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-535384b0-75fa-419f-b512-cc33b82c3b8a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:45.629630 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-535384b0-75fa-419f-b512-cc33b82c3b8a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.020248 Oct 04 20:31:45.630886 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 122/246] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:45 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:45.640352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:45.641417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:45.643354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=65 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:45.652262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.653443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.653576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.654267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.654408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.655772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.663374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.663374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.663374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.664529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.664529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.664529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.873766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:45.889615 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0198984d-d6f0-4fbb-af44-9076b0c98d7d tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.256258 Oct 04 20:31:45.891099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 123/247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:45 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:45.899916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02456067-6d08-4104-a51d-b8e6eebdac48 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:45.920425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02456067-6d08-4104-a51d-b8e6eebdac48 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:45.921026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02456067-6d08-4104-a51d-b8e6eebdac48 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:45.921710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02456067-6d08-4104-a51d-b8e6eebdac48 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:45.980963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:46.394146 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02456067-6d08-4104-a51d-b8e6eebdac48 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.500072 Oct 04 20:31:46.396152 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 124/248] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:45 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:46.405354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9f0db25-dfa4-44f5-924a-3f67732c7285 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Calling method '.version_select at 0x7f54f6e0b700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:46.408926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9f0db25-dfa4-44f5-924a-3f67732c7285 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f42ddffaafd64d17a162c38ed65d13f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82232da42fcd464cac12fde714e05b58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9f0db25-dfa4-44f5-924a-3f67732c7285 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Request method failure captured: Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJgtX6BUap6oj9VUnb1SPrno7N9H-CpdVLef245KeOmGwFsZeB4-QS2TTKu8eZELJvfNBHODFalxhKJiTZXKFqKMpfabTX3fOBiAXYdiRoNehDG7swn0sb2Js5rtiyk6ocanz5fXmwYbAdEUOM28FHiL1K_rwA9b80LfNNTKF31Gpr0 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:31:46.415540 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82232da42fcd464cac12fde714e05b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82232da42fcd464cac12fde714e05b58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f42ddffaafd64d17a162c38ed65d13f2 Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:31:46.417940 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:46.421283 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:31:46.439276 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:46.441221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9f0db25-dfa4-44f5-924a-3f67732c7285 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:46.441221 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9f0db25-dfa4-44f5-924a-3f67732c7285 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018417 Oct 04 20:31:46.441221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 125/249] 10.222.0.36 () {58 vars in 1179 bytes} [Tue Oct 4 20:31:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:46.464983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:46.470073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:46.487519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.489390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.490761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.492803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.494082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.495705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.879248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:46.900526 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-351253f4-4074-4aa6-9ca7-1e960a7747e3 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.455510 Oct 04 20:31:46.903019 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 126/250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:46 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:46.916016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826949d3-1d7c-40cd-ad9d-34eaa85cf10d", "tag": "54b68e7f-f875-4d19-b360-73a61a60c22c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:46.948143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:46.950652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:46.952297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:46.981773 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] Creating event network-changed:54b68e7f-f875-4d19-b360-73a61a60c22c for instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d on n-h2-851029-13 Oct 04 20:31:46.991573 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8228b82b-d36c-4110-a0ab-9884a23aa7b2 req-d3c900e6-307e-4c11-8634-d2c7df456393 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085727 Oct 04 20:31:46.998996 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 127/251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:47.002763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02e7b36e-8fd9-44b4-a778-3b79b08addb2 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.025438 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02e7b36e-8fd9-44b4-a778-3b79b08addb2 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 243 microversion: 2.1 time: 0.030622 Oct 04 20:31:47.026968 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 128/252] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:31:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 243 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:47.381871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Calling method '.version_select at 0x7f54f7c52d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.391032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.391977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.392737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.415953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.416637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.417239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.437517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:47.438382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.439106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.439749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.449146 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2e26b00-c82c-4083-abee-f35acf3e8bad tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.420338 Oct 04 20:31:47.450167 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 129/253] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:47.457700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.458767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:47.468039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.468546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.469068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.470144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.470763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.471756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.720880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:47.729987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9b60b2c-916e-481b-bebc-2fbef0472655 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1470 microversion: 2.1 time: 0.278409 Oct 04 20:31:47.730581 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 130/254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:47 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:47.738122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:47.738795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:47.748518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.749385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.750144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:47.751199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:47.751899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:47.752375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.006844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:48.017556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:48.030078 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65882ad8-0ad8-4489-922e-d6ecd70f0abd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.297404 Oct 04 20:31:48.032682 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 131/255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:47 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:48.044659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cac03c28-d62c-47c8-b684-3bd6a7040e1d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:48.064352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cac03c28-d62c-47c8-b684-3bd6a7040e1d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.065636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cac03c28-d62c-47c8-b684-3bd6a7040e1d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.066345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cac03c28-d62c-47c8-b684-3bd6a7040e1d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.593979 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cac03c28-d62c-47c8-b684-3bd6a7040e1d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.558411 Oct 04 20:31:48.595119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 132/256] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:48 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:48.613115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69bc2973-fed3-4175-bd21-e22af8e1f27a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Calling method '.version_select at 0x7f54f6cc8a60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.622583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-69bc2973-fed3-4175-bd21-e22af8e1f27a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f42ddffaafd64d17a162c38ed65d13f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82232da42fcd464cac12fde714e05b58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69bc2973-fed3-4175-bd21-e22af8e1f27a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Request method failure captured: Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJgtX6BUap6oj9VUnb1SPrno7N9H-CpdVLef245KeOmGwFsZeB4-QS2TTKu8eZELJvfNBHODFalxhKJiTZXKFqKMpfabTX3fOBiAXYdiRoNehDG7swn0sb2Js5rtiyk6ocanz5fXmwYbAdEUOM28FHiL1K_rwA9b80LfNNTKF31Gpr0 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:31:48.636615 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82232da42fcd464cac12fde714e05b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82232da42fcd464cac12fde714e05b58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f42ddffaafd64d17a162c38ed65d13f2 Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1'} Oct 04 20:31:48.639451 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:48.640750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:31:48.655002 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.656532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69bc2973-fed3-4175-bd21-e22af8e1f27a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:48.656532 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69bc2973-fed3-4175-bd21-e22af8e1f27a tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.048373 Oct 04 20:31:48.656532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 133/257] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:48.668120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.669905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:48.683446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.684556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.685694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.688731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.688731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.689539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.729838 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5dcf9288-3b6b-491c-b279-fb3d6d6e7506 tempest-QuotasAdminTestJSON-174913951 tempest-QuotasAdminTestJSON-174913951-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599" status: 200 len: 329 microversion: 2.1 time: 3.594468 Oct 04 20:31:48.730836 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 125/258] 10.222.0.36 () {60 vars in 1263 bytes} [Tue Oct 4 20:31:45 2022] PUT /compute/v2.1/os-quota-sets/b3fa1dcbb5d34895ad8d2d3073ccc599 => generated 329 bytes in 3597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:48.741443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1904047-d505-49c0-aac6-cf2ccffc1890 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.894652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1904047-d505-49c0-aac6-cf2ccffc1890 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.161584 Oct 04 20:31:48.909075 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 126/259] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:48 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:48.915438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20b10727-9955-4868-94ad-91abc0d67c1b tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Calling method '.version_select at 0x7f54f6c13d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.917385 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-20b10727-9955-4868-94ad-91abc0d67c1b tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] HTTP exception thrown: Hypervisor with ID 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' could not be found. Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20b10727-9955-4868-94ad-91abc0d67c1b tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Request method failure captured: Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/fc140e68-e7e8-42a9-a95e-8289bcb5a651/uptime HTTP/1.1 Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJgvunyzlZj_doFQ363DbrGXDnYwV-DLbZNDbwDeGhkYZjqAZjPrgtPZDa86dlsJZyWMOqufWJnUGTgxkSRqpN-a_6mLdrZpsb_ddKMZnGCbXp8OvZEnf4SygSZJU-EBUeUK9okY7FouTgIXKPs1iLlzfgDikJZ4FzAApdzt54sF08M Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: bfed2194a0714e2f8d83be5b2b0d12ac Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:48.937381 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: bfed2194a0714e2f8d83be5b2b0d12ac Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9992e6260246440d8788043a0cf758ca Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: exception: Hypervisor with ID 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' could not be found. Oct 04 20:31:48.939126 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fc140e68-e7e8-42a9-a95e-8289bcb5a651'} Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:31:48.940043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' could not be found. Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:48.941459 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' could not be found. Oct 04 20:31:48.943208 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:48.945369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20b10727-9955-4868-94ad-91abc0d67c1b tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Returning 404 to user: Hypervisor with ID 'fc140e68-e7e8-42a9-a95e-8289bcb5a651' could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:48.946879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20b10727-9955-4868-94ad-91abc0d67c1b tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/fc140e68-e7e8-42a9-a95e-8289bcb5a651/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035326 Oct 04 20:31:48.948892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 127/260] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/os-hypervisors/fc140e68-e7e8-42a9-a95e-8289bcb5a651/uptime => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:48.960451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6764938b-3e9a-4a3e-869c-11ed92451b80", "name": "network-vif-plugged", "status": "completed", "tag": "f19fd326-6c0f-48df-b71d-22d1c13f7a5c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:48.975301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.975819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.976409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.004489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.011351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] Creating event network-vif-plugged:f19fd326-6c0f-48df-b71d-22d1c13f7a5c for instance 6764938b-3e9a-4a3e-869c-11ed92451b80 on n-h1-851029-13 Oct 04 20:31:49.026014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-531d2042-882c-404f-8b38-9707e22164f1 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.376153 Oct 04 20:31:49.028370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-224463fd-c707-448f-b120-3a1887bce856 req-4080f39c-7f8a-4218-a8f6-408646a62809 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077489 Oct 04 20:31:49.028732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 134/261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:49.030825 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 128/262] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:49.037798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d48c4cf3-9ffc-4769-bc3a-e8432f9930e9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2060793677"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:49.044477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-d48c4cf3-9ffc-4769-bc3a-e8432f9930e9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 8ca169a6-ad88-4638-a62f-34dc76ea8829 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:49.051614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.052904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:49.075605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.075605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.075605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.075605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.077162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.078191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.186501 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d48c4cf3-9ffc-4769-bc3a-e8432f9930e9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.153617 Oct 04 20:31:49.187759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 129/263] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:49.205072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Calling method '.version_select at 0x7f54f6c99040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.208972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.209939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.210765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.236428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:INSERT=21,nova_api:SELECT=63,nova_api:UPDATE=14,nova_api:DELETE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:49.242803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.243608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.244393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.270841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.277358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.277358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.277358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:49.286103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ec8593ac-f290-408e-ab3b-ae5e6906d622 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.096303 Oct 04 20:31:49.286930 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 130/264] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:49.292763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.293409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:49.301492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.301980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.302414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.303158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.303638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.304036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.548526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.562799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a68e7a8c-987b-4d49-aca9-64655ae08e8b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1470 microversion: 2.1 time: 0.531616 Oct 04 20:31:49.573401 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 135/265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:49.582858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0158fdce-ce63-4ecb-b1af-7c5b7afd56c8 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:49.611557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0158fdce-ce63-4ecb-b1af-7c5b7afd56c8 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:49.612753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0158fdce-ce63-4ecb-b1af-7c5b7afd56c8 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:49.615936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0158fdce-ce63-4ecb-b1af-7c5b7afd56c8 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:49.682453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.698432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2db8254f-4de0-44ac-9ac2-041c79a137b8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.409887 Oct 04 20:31:49.700468 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 131/266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:49.710233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d4cdac0-2dc1-4e71-bf04-ab555195cfa1 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Calling method '.version_select at 0x7f54f6da74c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.716088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d4cdac0-2dc1-4e71-bf04-ab555195cfa1 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f42ddffaafd64d17a162c38ed65d13f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82232da42fcd464cac12fde714e05b58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d4cdac0-2dc1-4e71-bf04-ab555195cfa1 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Request method failure captured: Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJgtX6BUap6oj9VUnb1SPrno7N9H-CpdVLef245KeOmGwFsZeB4-QS2TTKu8eZELJvfNBHODFalxhKJiTZXKFqKMpfabTX3fOBiAXYdiRoNehDG7swn0sb2Js5rtiyk6ocanz5fXmwYbAdEUOM28FHiL1K_rwA9b80LfNNTKF31Gpr0 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:31:49.719704 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82232da42fcd464cac12fde714e05b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82232da42fcd464cac12fde714e05b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82232da42fcd464cac12fde714e05b58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 82232da42fcd464cac12fde714e05b58 Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-577327055 Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f42ddffaafd64d17a162c38ed65d13f2 Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-577327055-project Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1'} Oct 04 20:31:49.721313 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:49.722410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:31:49.733217 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.735497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d4cdac0-2dc1-4e71-bf04-ab555195cfa1 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:49.735497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d4cdac0-2dc1-4e71-bf04-ab555195cfa1 tempest-HypervisorAdminNegativeTestJSON-577327055 tempest-HypervisorAdminNegativeTestJSON-577327055-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.019466 Oct 04 20:31:49.735497 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 132/267] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:49.739471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a2c89b3-66ad-40a2-8524-aa043e734a36 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Calling method '.version_select at 0x7f54f6ce0700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.743656 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1a2c89b3-66ad-40a2-8524-aa043e734a36 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] HTTP exception thrown: Hypervisor with ID 'fde62741-d059-490d-9c4d-2b2a46dcfddd' could not be found. Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a2c89b3-66ad-40a2-8524-aa043e734a36 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Request method failure captured: Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hypervisors/fde62741-d059-490d-9c4d-2b2a46dcfddd HTTP/1.1 Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJgvunyzlZj_doFQ363DbrGXDnYwV-DLbZNDbwDeGhkYZjqAZjPrgtPZDa86dlsJZyWMOqufWJnUGTgxkSRqpN-a_6mLdrZpsb_ddKMZnGCbXp8OvZEnf4SygSZJU-EBUeUK9okY7FouTgIXKPs1iLlzfgDikJZ4FzAApdzt54sF08M Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: bfed2194a0714e2f8d83be5b2b0d12ac Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:49.745949 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfed2194a0714e2f8d83be5b2b0d12ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: bfed2194a0714e2f8d83be5b2b0d12ac Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997 Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9992e6260246440d8788043a0cf758ca Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: exception: Hypervisor with ID 'fde62741-d059-490d-9c4d-2b2a46dcfddd' could not be found. Oct 04 20:31:49.753301 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fde62741-d059-490d-9c4d-2b2a46dcfddd'} Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fde62741-d059-490d-9c4d-2b2a46dcfddd' Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:31:49.754985 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:31:49.757972 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fde62741-d059-490d-9c4d-2b2a46dcfddd' could not be found. Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fde62741-d059-490d-9c4d-2b2a46dcfddd' could not be found. Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a2c89b3-66ad-40a2-8524-aa043e734a36 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] Returning 404 to user: Hypervisor with ID 'fde62741-d059-490d-9c4d-2b2a46dcfddd' could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a2c89b3-66ad-40a2-8524-aa043e734a36 tempest-HypervisorAdminNegativeTestJSON-1228003997 tempest-HypervisorAdminNegativeTestJSON-1228003997-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/fde62741-d059-490d-9c4d-2b2a46dcfddd" status: 404 len: 123 microversion: 2.1 time: 0.016846 Oct 04 20:31:49.760624 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 133/268] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1/os-hypervisors/fde62741-d059-490d-9c4d-2b2a46dcfddd => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:49.958298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=30 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:50.062968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.063375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:50.075596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.077090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.078153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.080177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.081222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.082272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.226234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0158fdce-ce63-4ecb-b1af-7c5b7afd56c8 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.651187 Oct 04 20:31:50.227368 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 136/269] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:49 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:50.245402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c26cf9d1-829c-4406-aaef-30b083e36e14 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.264722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c26cf9d1-829c-4406-aaef-30b083e36e14 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.023075 Oct 04 20:31:50.265903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 137/270] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:50.303860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75c25a8f-ccec-4b52-a56c-c135f5f0bb83 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:50.345893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c25a8f-ccec-4b52-a56c-c135f5f0bb83 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.346386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c25a8f-ccec-4b52-a56c-c135f5f0bb83 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.359510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c25a8f-ccec-4b52-a56c-c135f5f0bb83 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.401657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:50.432788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8aece66-f28b-4440-958b-6631041d7fa7 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.376655 Oct 04 20:31:50.433597 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 134/271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:50.636410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.637448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:50.685586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.690643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.692450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.694651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.700482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.702596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.956195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75c25a8f-ccec-4b52-a56c-c135f5f0bb83 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.665471 Oct 04 20:31:50.957119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 138/272] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 4 20:31:50 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:50.971977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.972918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:51.007184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.011512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.014788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.020788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.021993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.022819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.341173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:51.357224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32f55ddc-310f-4744-b616-b1edb69b8a85 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1470 microversion: 2.1 time: 0.738094 Oct 04 20:31:51.361045 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 135/273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1470 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:31:51.381313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c67ef369-f523-43df-abab-903b2e4cd4ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:51.523279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c67ef369-f523-43df-abab-903b2e4cd4ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.162470 Oct 04 20:31:51.524736 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 136/274] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:51.544698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:51.547906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:51.561707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:51.568799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.572919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.577803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.580566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.581482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.587056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:51.595696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da0ba80e-eb4d-47e2-8ebe-c646ffe0835b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1390 microversion: 2.1 time: 0.634092 Oct 04 20:31:51.598877 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 139/275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1390 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:51.621873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fcb48884-e913-498c-932a-a1f90dba988e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-283319482"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:51.632578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-fcb48884-e913-498c-932a-a1f90dba988e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 5a8d25ec-87b7-4506-9179-7f15a1ae7158 for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:51.781872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fcb48884-e913-498c-932a-a1f90dba988e tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.180946 Oct 04 20:31:51.786922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 140/276] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:51.806595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-697b0c8f-4af7-471e-8ee6-61160adcaab9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:51.831777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-697b0c8f-4af7-471e-8ee6-61160adcaab9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:51.833513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-697b0c8f-4af7-471e-8ee6-61160adcaab9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:51.837221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-697b0c8f-4af7-471e-8ee6-61160adcaab9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.152623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:52.174489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17843e3a-2e06-4a7e-a403-47a19d8afc5b tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.647761 Oct 04 20:31:52.175731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 137/277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:51 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:52.340178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-697b0c8f-4af7-471e-8ee6-61160adcaab9 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.541380 Oct 04 20:31:52.342381 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 141/278] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:31:52.364150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826949d3-1d7c-40cd-ad9d-34eaa85cf10d", "name": "network-vif-plugged", "status": "completed", "tag": "54b68e7f-f875-4d19-b360-73a61a60c22c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:52.382439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.385292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.386771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.409245 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] Creating event network-vif-plugged:54b68e7f-f875-4d19-b360-73a61a60c22c for instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d on n-h2-851029-13 Oct 04 20:31:52.418550 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-366c9294-1e32-4b14-9cb5-5d9f83606abd req-49987fdf-9778-4a31-9db0-f7215e9c90d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061157 Oct 04 20:31:52.427233 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 142/279] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:52.433976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f70bae5e-fdc8-48b1-9251-22796195b35a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:52.452916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f70bae5e-fdc8-48b1-9251-22796195b35a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.453415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f70bae5e-fdc8-48b1-9251-22796195b35a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.453861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f70bae5e-fdc8-48b1-9251-22796195b35a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.802118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6c13790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:52.809064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.810205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.811525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.813195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.814291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.815351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.838847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=13 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:52.870118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1fc70dd2-91a9-4943-aa09-71f1ae29042f tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.684580 Oct 04 20:31:52.871467 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 138/280] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:31:52 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:52.881235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:52.883087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:52.894681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.895519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.896337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:52.897632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:52.898468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:52.899302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.008287 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f70bae5e-fdc8-48b1-9251-22796195b35a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.583455 Oct 04 20:31:53.009997 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 143/281] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.047270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.048672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:53.066735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.067624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.068468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.070938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.078123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.078123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.183727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:53.198708 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2e27201-5fde-4c60-a296-b72844af142a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.324970 Oct 04 20:31:53.200150 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 139/282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:52 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:53.209042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6bdfdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.214805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.217946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.217946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.220205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.220879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.221703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.262779 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d47c0ae3-e9d2-4fd1-9884-3526e0c5c757 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.052061 Oct 04 20:31:53.262779 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 140/283] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.262779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc93a2a4-d81e-46c4-9558-20b47d7b6183 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.333502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:53.346396 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc93a2a4-d81e-46c4-9558-20b47d7b6183 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.089573 Oct 04 20:31:53.347534 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 141/284] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:53 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:53.347675 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4831e80d-3477-4ba6-81b5-266f44c4fa90 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1588 microversion: 2.1 time: 0.335401 Oct 04 20:31:53.348690 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 144/285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1588 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:53.360938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6c34040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.367642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.367642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:53.368071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.368461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.369428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.371166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.372270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.373547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.378278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.379305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.379884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.380974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.381534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.382141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.431296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8178fcfb-5773-4c06-881a-9f76e1c46d60 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.080333 Oct 04 20:31:53.432286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 145/286] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:31:53.441839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95af72a0-67bc-4ffe-a426-b6cb7954a9c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2120415895"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:53.448195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-95af72a0-67bc-4ffe-a426-b6cb7954a9c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 5968d3c3-d173-424d-bb63-df7c78a2b293 for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:53.601165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95af72a0-67bc-4ffe-a426-b6cb7954a9c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.167271 Oct 04 20:31:53.604250 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 146/287] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.619714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.620490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:53.629576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:53.632073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.632607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.633655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.635292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.636455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.637209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:53.649104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08f4c56c-e487-44b3-a9a2-b1c0f460232e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1320 microversion: 2.1 time: 0.299093 Oct 04 20:31:53.650624 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 142/288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:53.660357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc923fd5-ce45-472f-b4aa-30c9ea9edf7b tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1103662252"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:53.667976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-bc923fd5-ce45-472f-b4aa-30c9ea9edf7b tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid c8f7e144-9d0d-4b91-a267-f033fb367738 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:53.843403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc923fd5-ce45-472f-b4aa-30c9ea9edf7b tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.190651 Oct 04 20:31:53.856655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 143/289] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.870434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aeeb3f21-77fb-4d10-8ff2-87a362c91c74 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262705 Oct 04 20:31:53.873124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 147/290] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:31:53 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:53.873697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31ab7a24-4cff-4420-831e-089c239f77c7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:53.885772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b107693e-abd9-47f8-9291-d8ae734e6414 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:53.931703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b107693e-abd9-47f8-9291-d8ae734e6414 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:53.932681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b107693e-abd9-47f8-9291-d8ae734e6414 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:53.935324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b107693e-abd9-47f8-9291-d8ae734e6414 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.016972 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31ab7a24-4cff-4420-831e-089c239f77c7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.155070 Oct 04 20:31:54.018171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 144/291] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:54.035246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c37f026f-7b3a-4524-b61d-0b92d03131c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.054451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c37f026f-7b3a-4524-b61d-0b92d03131c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c37f026f-7b3a-4524-b61d-0b92d03131c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Request method failure captured: Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoHUo0AO0VxkGPsyIa42QBJ4YezuPrrL9CHTgQI1TXZSgfsEdpG3rPkTnZIkMEbDZneC_8eF0arelQPMXSUKya0LC2E3ztPkZurSLoh6YS919extFKOYArahd0QHwmJNjdhdYs49k5z1w3Apc6AayzjEXzET1ZfoWIdWLWtPpH9Jw Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:54.058191 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3690f00f590b43d38ce95b320e2de3d5 Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate 11 could not be found. Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '11'} Oct 04 20:31:54.063660 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.068935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.072751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c37f026f-7b3a-4524-b61d-0b92d03131c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:54.074373 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c37f026f-7b3a-4524-b61d-0b92d03131c4 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.035308 Oct 04 20:31:54.083708 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 145/292] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:54.108204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75be27c8-9fd4-4021-b176-1b106da1dec7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.146448 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-75be27c8-9fd4-4021-b176-1b106da1dec7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75be27c8-9fd4-4021-b176-1b106da1dec7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Request method failure captured: Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoHUo0AO0VxkGPsyIa42QBJ4YezuPrrL9CHTgQI1TXZSgfsEdpG3rPkTnZIkMEbDZneC_8eF0arelQPMXSUKya0LC2E3ztPkZurSLoh6YS919extFKOYArahd0QHwmJNjdhdYs49k5z1w3Apc6AayzjEXzET1ZfoWIdWLWtPpH9Jw Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:54.151060 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3690f00f590b43d38ce95b320e2de3d5 Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate 11 could not be found. Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '11'} Oct 04 20:31:54.153619 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:54.155795 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.157854 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75be27c8-9fd4-4021-b176-1b106da1dec7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75be27c8-9fd4-4021-b176-1b106da1dec7 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.070537 Oct 04 20:31:54.159815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:54 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:54.173517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47bee5a0-bbfd-4187-9d9b-97999bebf718 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-701858451", "name": "tempest-test_aggregate-807400248"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:54.203734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-47bee5a0-bbfd-4187-9d9b-97999bebf718 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 52842923-5e77-45a5-8252-63228f301443 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:54.440496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47bee5a0-bbfd-4187-9d9b-97999bebf718 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.273756 Oct 04 20:31:54.443086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 147/294] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 4 20:31:54 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:54.462626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.464754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:54.479499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.484571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.484571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.484571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.484571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.485269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.522690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b107693e-abd9-47f8-9291-d8ae734e6414 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 244 microversion: 2.1 time: 0.646344 Oct 04 20:31:54.525769 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 148/295] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 244 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:54.536194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c3cf0df5-58ba-4022-bf71-bc82ecf97377 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.778606 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c3cf0df5-58ba-4022-bf71-bc82ecf97377 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.249646 Oct 04 20:31:54.779804 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 149/296] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:54.790068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2024b5f-dbc7-4ef7-84e7-2ce6e75eaa71 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:54.798998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2024b5f-dbc7-4ef7-84e7-2ce6e75eaa71 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2dd97cc594d24fc79a563e897cd6d6f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a07825abff841de8eea8a7b5dbe8e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2024b5f-dbc7-4ef7-84e7-2ce6e75eaa71 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Request method failure captured: Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 43 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjsW3dE3roPtiHt4DcF8ZAUKjZA-8XDpD_7jFSCP1pgQr1h2mHFx3ffqs8vPjd8gZIqLmDXHm2v3a4p7hjsZd9xRiTeGwLrkR744d_gYfmmOLQ5dsFiab4Q64IRMqBS-7WnT-Qy60rqWkeR-MpK9hq_YwvtKja1DZDe-PVMAxZJkc Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:31:54.801893 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a07825abff841de8eea8a7b5dbe8e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a07825abff841de8eea8a7b5dbe8e47 Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208 Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 2dd97cc594d24fc79a563e897cd6d6f1 Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2066789208-project Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: {"remove_host": {"host": "n-h2-851029-13"}} Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:31:54.803865 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-851029-13'}}} Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:54.804650 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:31:54.807808 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:31:54.812312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2024b5f-dbc7-4ef7-84e7-2ce6e75eaa71 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:54.812312 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2024b5f-dbc7-4ef7-84e7-2ce6e75eaa71 tempest-AggregatesAdminNegativeTestJSON-2066789208 tempest-AggregatesAdminNegativeTestJSON-2066789208-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.023024 Oct 04 20:31:54.812312 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 150/297] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:54 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:31:54.829168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:54.831704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:54.845027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.846819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.848938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:54.850625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:54.851642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:54.853741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.076542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:55.097376 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8047c00b-408b-47af-971d-14ba28aca0e3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.651826 Oct 04 20:31:55.098921 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 148/298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:55.115280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b960c64-c4ba-494f-ba67-ebde8012dc7a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:55.145042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3b960c64-c4ba-494f-ba67-ebde8012dc7a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b960c64-c4ba-494f-ba67-ebde8012dc7a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Request method failure captured: Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoHUo0AO0VxkGPsyIa42QBJ4YezuPrrL9CHTgQI1TXZSgfsEdpG3rPkTnZIkMEbDZneC_8eF0arelQPMXSUKya0LC2E3ztPkZurSLoh6YS919extFKOYArahd0QHwmJNjdhdYs49k5z1w3Apc6AayzjEXzET1ZfoWIdWLWtPpH9Jw Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:55.149676 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3690f00f590b43d38ce95b320e2de3d5 Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate 13 could not be found. Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '13'} Oct 04 20:31:55.152253 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.153814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.156562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b960c64-c4ba-494f-ba67-ebde8012dc7a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:55.160775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b960c64-c4ba-494f-ba67-ebde8012dc7a tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.052107 Oct 04 20:31:55.160775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 149/299] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:55 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:55.164898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4883b085-c8bd-4345-b514-5c3d328a9088 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:55.183247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4883b085-c8bd-4345-b514-5c3d328a9088 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:55.184153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4883b085-c8bd-4345-b514-5c3d328a9088 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:55.184876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4883b085-c8bd-4345-b514-5c3d328a9088 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:55.634383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4883b085-c8bd-4345-b514-5c3d328a9088 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.477806 Oct 04 20:31:55.636215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 150/300] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:55 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:55.644665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-227ef687-d6d4-422a-91d6-8c4927081beb tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:55.667700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-227ef687-d6d4-422a-91d6-8c4927081beb tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-227ef687-d6d4-422a-91d6-8c4927081beb tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Request method failure captured: Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoHUo0AO0VxkGPsyIa42QBJ4YezuPrrL9CHTgQI1TXZSgfsEdpG3rPkTnZIkMEbDZneC_8eF0arelQPMXSUKya0LC2E3ztPkZurSLoh6YS919extFKOYArahd0QHwmJNjdhdYs49k5z1w3Apc6AayzjEXzET1ZfoWIdWLWtPpH9Jw Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:55.671869 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1bd695e726864fb5b2e100cf1ff06d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 1bd695e726864fb5b2e100cf1ff06d86 Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-37868334 Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3690f00f590b43d38ce95b320e2de3d5 Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminTestJSON-37868334-project-admin Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: exception: Aggregate 13 could not be found. Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '13'} Oct 04 20:31:55.673618 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:55.674641 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:55.676428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-227ef687-d6d4-422a-91d6-8c4927081beb tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-227ef687-d6d4-422a-91d6-8c4927081beb tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.037345 Oct 04 20:31:55.677980 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 151/301] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:55.689239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a9fcafd-21ed-416a-938b-11147f5852f6 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:55.882384 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a9fcafd-21ed-416a-938b-11147f5852f6 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.204333 Oct 04 20:31:55.884721 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 152/302] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:55 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:55.898004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:55.902080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-692b69cc-3122-42ec-96c2-4c67c9814638 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1635523629"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:55.912204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-692b69cc-3122-42ec-96c2-4c67c9814638 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 79f81146-0964-4fdd-aa3f-f1d7a6ed30a4 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:55.930823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63f396ed-6ba6-4173-a7e6-88b375b6001e tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1470 microversion: 2.1 time: 1.122878 Oct 04 20:31:55.932040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 151/303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:54 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1470 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:55.942451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-accb3209-7dd0-4e51-bb5c-f3eaa89e1a05 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-14466762"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:55.948777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-accb3209-7dd0-4e51-bb5c-f3eaa89e1a05 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Generated uuid 5a74c43b-9253-4b76-8ace-b97df9279b54 for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:55.958985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:56.061142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-692b69cc-3122-42ec-96c2-4c67c9814638 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.173696 Oct 04 20:31:56.062465 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-accb3209-7dd0-4e51-bb5c-f3eaa89e1a05 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.127801 Oct 04 20:31:56.063452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 153/304] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.067703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 152/305] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.073834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:56.078250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:56.080591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6dedf70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.090918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.090918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.091343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.092727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.093587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.094351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.099584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.100274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.100942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.105313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.106454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.108458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.155770 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ec94045-d5a5-4f5c-be58-7c82196f1907 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.090430 Oct 04 20:31:56.160015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 154/306] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.174953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63cc3d75-d0c6-44b3-92de-a454cfee91ff tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.202187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63cc3d75-d0c6-44b3-92de-a454cfee91ff tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.038617 Oct 04 20:31:56.203470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 155/307] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.214029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:56.242213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.244713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.245565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.270744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.271728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.272462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.289215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.compute.aggregates [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:31:56.289661 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Request method failure captured: Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 42 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfoAOkglsPy7-mfr5ZF2XPQ1MyIx_NOilPtUb_ffi77-1Z1WcvjCcQAIuc-boR3z-5T-x2utbdkz3bx3L8zKvrLy_lylcQ_uA-4IyvfEUhqeva6EYGGMRXp0_V7vZrJ9FwTgVxoq4Q0hlXr16vrzJRkoHcYcu5GYJFkpw3wxM0yN-A Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:31:56.296058 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee4312b1b3014156b59a2a336ba646ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ee4312b1b3014156b59a2a336ba646ca Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670 Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fdb2d5b068004ddf81152f7d0bc88c8f Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: {"remove_host": {"host": "nonexist_host"}} Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:31:56.298493 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:31:56.299975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 20:31:56.303390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.307285 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eac0e4fc-4883-4272-812a-dbddd20a0f60 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.092967 Oct 04 20:31:56.310173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 156/308] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:56 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:31:56.329642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.333336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:56.344215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.344823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.346466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.347809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.350594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.351539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.700592 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d83c033d-ae32-4c61-9986-a213936d1ef1 tempest-DeleteServersAdminTestJSON-554664500 tempest-DeleteServersAdminTestJSON-554664500-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d/action" status: 202 len: 0 microversion: 2.1 time: 0.630790 Oct 04 20:31:56.710814 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 153/309] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:31:56 2022] POST /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:31:56.723159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:56.754856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f7c52d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.767881 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83b26bb8-d88f-4a89-8ffe-33d757f21dc5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.459199 Oct 04 20:31:56.771782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.772576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 157/310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:56.780787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.786077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.787246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d79b3451-a0b8-427e-a96f-0e71ac3ef89c tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:56.789533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.791355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.795167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.865328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1eac788e-ec57-413a-94eb-422fb9df3b69 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.150645 Oct 04 20:31:56.866841 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 154/311] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.877577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99fb201b-c562-4097-bbcc-a4a3790f74e5 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.938313 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d79b3451-a0b8-427e-a96f-0e71ac3ef89c tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.163758 Oct 04 20:31:56.940393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 158/312] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 20:31:56 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:56.955795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:56.957114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:56.962085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:56.976278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.977057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.977753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:56.978887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:56.980189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:56.981095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.004310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99fb201b-c562-4097-bbcc-a4a3790f74e5 tempest-AggregatesAdminNegativeTestJSON-1453817670 tempest-AggregatesAdminNegativeTestJSON-1453817670-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.135597 Oct 04 20:31:57.005517 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 155/313] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:57.019643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6e0bf70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.026102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.026998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.028900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.031425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.034276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.034276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.090082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.092342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.093674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.093943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b45e4bd3-c86f-4992-9e9c-f44dc4aad0e8 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.086657 Oct 04 20:31:57.104072 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.104664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lazy-loading 'fault' on Instance uuid 826949d3-1d7c-40cd-ad9d-34eaa85cf10d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:31:57.104867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34af3b05-51d6-4cdd-af3b-4b06d462a9d1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.121747 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34af3b05-51d6-4cdd-af3b-4b06d462a9d1 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.024572 Oct 04 20:31:57.130845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 157/315] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.134316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6c15700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.152763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.153535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.154024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.169098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.169622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.170062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.217523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b78d8af5-e54a-4871-9950-7b3dcc481b86 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h2-851029-13" status: 200 len: 471 microversion: 2.1 time: 0.091328 Oct 04 20:31:57.242012 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hosts/n-h2-851029-13 => generated 471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.242012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b178caa2-900c-4adf-8a75-25576ee04ce0 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.364144 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b178caa2-900c-4adf-8a75-25576ee04ce0 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.138532 Oct 04 20:31:57.373623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 159/317] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:57 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:57.381720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Calling method '.version_select at 0x7f54f6d98c10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.397928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.399147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.400220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.427907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.428835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.429620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.469389 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5665a667-c523-4b48-9bd5-9eaf0c3b8d23 tempest-HostsAdminTestJSON-570783699 tempest-HostsAdminTestJSON-570783699-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h1-851029-13" status: 200 len: 603 microversion: 2.1 time: 0.102455 Oct 04 20:31:57.470959 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 160/318] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/os-hosts/n-h1-851029-13 => generated 603 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.479557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.480967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:57.501068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.502119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.502993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:57.503227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.504563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.505832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.506622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.523761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38f56106-e9dd-4518-a2c0-8eca22082ffd tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1453 microversion: 2.1 time: 0.580556 Oct 04 20:31:57.580620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 159/319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:56 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1453 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:57.590970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad5e2779-667f-4670-b54b-073b12808167 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776731179", "availability_zone": "tempest-test_az-86314982"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:57.595361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-ad5e2779-667f-4670-b54b-073b12808167 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid f71722f1-a52d-4ce0-94c5-71121d018e03 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:57.754806 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad5e2779-667f-4670-b54b-073b12808167 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.171823 Oct 04 20:31:57.768064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 160/320] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 4 20:31:57 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.778301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6764938b-3e9a-4a3e-869c-11ed92451b80", "tag": "f19fd326-6c0f-48df-b71d-22d1c13f7a5c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:57.801883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.804314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.805941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.820908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:57.837780 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ea48396-5995-4612-8346-6ce30e5c8d39 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 200 len: 1588 microversion: 2.1 time: 0.364773 Oct 04 20:31:57.839518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] Creating event network-changed:f19fd326-6c0f-48df-b71d-22d1c13f7a5c for instance 6764938b-3e9a-4a3e-869c-11ed92451b80 on n-h1-851029-13 Oct 04 20:31:57.839885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 161/321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:57 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 1588 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:57.849791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:57.850475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:57.852287 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9ae5f712-6580-4ebe-9b7a-9a115c147d7f req-7645e744-6f40-43c3-aefe-e613fe5674a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081599 Oct 04 20:31:57.853672 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 161/322] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:57.876838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b963877b-a11b-4225-a8b6-2211f25d34ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776731179_new", "availability_zone": "tempest-test_az-86314982_new"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:57.890688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.894954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.899889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.902620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:57.907891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:57.909922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:57.930093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:58.004017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:31:58.186419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b963877b-a11b-4225-a8b6-2211f25d34ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.188410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b963877b-a11b-4225-a8b6-2211f25d34ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.189256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b963877b-a11b-4225-a8b6-2211f25d34ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.397045 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b963877b-a11b-4225-a8b6-2211f25d34ec tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 332 microversion: 2.1 time: 0.536010 Oct 04 20:31:58.399568 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 162/323] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 20:31:57 2022] PUT /compute/v2.1/os-aggregates/16 => generated 332 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:58.415900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.416696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:58.435525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.436237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.436767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.437440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.437903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.438333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.632074 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b94dc8c-d9df-408e-aa2a-0dcb65127a5a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 204 len: 0 microversion: 2.1 time: 0.786192 Oct 04 20:31:58.642214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 162/324] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:31:57 2022] DELETE /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 0 bytes in 794 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:31:58.650837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d8c2fc6-5fc2-4fd5-a90f-c3e82dab5258 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.669957 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d8c2fc6-5fc2-4fd5-a90f-c3e82dab5258 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 335 microversion: 2.1 time: 0.025390 Oct 04 20:31:58.682833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 163/325] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/os-aggregates => generated 335 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:58.693136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:58.694417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:31:58.705502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.706302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.707069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.708236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.709002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.710049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.717715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=33 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:58.777871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:58.778698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:58.779530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:58.780318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lazy-loading 'fault' on Instance uuid 826949d3-1d7c-40cd-ad9d-34eaa85cf10d {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:31:59.005161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:59.031086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f39b5e2e-603a-4bbd-b6ce-fb63871fd2b9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.629811 Oct 04 20:31:59.040671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 163/326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:59.061610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd52b73d-521e-4367-8fc9-c9c92cc5a1a0 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:59.251121 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd52b73d-521e-4367-8fc9-c9c92cc5a1a0 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.208750 Oct 04 20:31:59.253923 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 164/327] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:59 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:31:59.297717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:31:59.336300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-36d5d90f-ade8-4768-a3c8-3467de2767ac tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1459 microversion: 2.1 time: 0.646542 Oct 04 20:31:59.341089 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 164/328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:31:58 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1459 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:59.361196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88abab57-bf35-44ed-b8ac-53db7c4f3fae tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-49471048"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:31:59.379184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-88abab57-bf35-44ed-b8ac-53db7c4f3fae tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Generated uuid 9d88056b-7e0b-43d7-9945-fbb3389008ca for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:31:59.673295 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88abab57-bf35-44ed-b8ac-53db7c4f3fae tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.326960 Oct 04 20:31:59.697839 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 165/329] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 20:31:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:59.712792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce010487-de17-4ab9-acbc-8d5e9923c62d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:59.733273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce010487-de17-4ab9-acbc-8d5e9923c62d tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.033274 Oct 04 20:31:59.739699 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 166/330] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:31:59 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:59.760037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b6bae91-d89a-4f04-a46f-728fe5a25125 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:59.963170 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b6bae91-d89a-4f04-a46f-728fe5a25125 tempest-AggregatesAdminTestJSON-37868334 tempest-AggregatesAdminTestJSON-37868334-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.212577 Oct 04 20:31:59.964593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 167/331] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 20:31:59 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:32:00.037431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6ba1280>, body: {"quota_set": {"ram": "5120"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:00.127180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcc10671-2a31-4257-9597-221998e97845 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.136711 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-dcc10671-2a31-4257-9597-221998e97845 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcc10671-2a31-4257-9597-221998e97845 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin] Request method failure captured: Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJg_uHPXNc1kfs4jxXz8bp73Glrknu0Iu3qJ6LVqhWWLzDXFG15rf0VyzMiKrozugY3cQEFZLlJqeAJOssxDAT7cdvamg0XYAb7dvSgDKxcBXnbqb2BrkD_Lxr900L_ax5-SHK42q15_uYlImPxjD1__FU7B7yeEbZEzv_wU_R1J0Uw Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: d345b2da9a4743f48481c1a4686aeb4f Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:32:00.149269 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d345b2da9a4743f48481c1a4686aeb4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d345b2da9a4743f48481c1a4686aeb4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d345b2da9a4743f48481c1a4686aeb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d345b2da9a4743f48481c1a4686aeb4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: d345b2da9a4743f48481c1a4686aeb4f Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8fb4c9dd921941dfa2f25fbfd094739c Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:00.158193 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid timestamp for date invalid_time Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'invalid_time'} Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.159509 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcc10671-2a31-4257-9597-221998e97845 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.161828 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dcc10671-2a31-4257-9597-221998e97845 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184 tempest-InstanceUsageAuditLogNegativeTestJSON-1113251184-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.182218 Oct 04 20:32:00.163663 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 168/332] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Oct 4 20:31:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:32:00.175825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.177433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.200524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.202041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.203926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.205304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.207471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.209095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.252800 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] HTTP exception thrown: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Request method failure captured: Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f HTTP/1.1 Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjyOKpB5kC1Asrb_BEwT2gf8aqXO7hm7NmQX441umQ82o-mizzgCicTcrMBRWDrQbcjr4I7lYVXv_ZOsn-9R1qAQB-DRb37R8YMEfUwTe6M8-ejbuvGO5G10Zmn1dlq5Av_Dg4MwKnTzQxHn2HC1spLulDLjaCHY9kZNaR3UcXxkM Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:00.257621 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8652c21a239e4828841774b892990f1c Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.259801 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '14717528-b8cd-4ff9-841b-da8ad78a852f'} Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.260657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.261883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.266435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Returning 404 to user: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.268071 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a86d8bd7-672f-437d-90cb-a43df5ecd289 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "DELETE /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 404 len: 111 microversion: 2.1 time: 0.114541 Oct 04 20:32:00.269698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 169/333] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:00 2022] DELETE /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:00.280288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.281970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.294049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.296144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.297372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.299084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.300318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.301169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.302341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.302774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.303193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.304668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.310839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.312229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.560656 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4fa44062-33fb-4a31-94e0-abbbdbcea8e7 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5" status: 200 len: 148 microversion: 2.57 time: 1.301263 Oct 04 20:32:00.570549 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 165/334] 10.222.0.36 () {62 vars in 1303 bytes} [Tue Oct 4 20:31:59 2022] PUT /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5 => generated 148 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:00.785687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:00.811291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6f6a7b5-021e-4c9e-a37d-3c48aaebc10c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.539275 Oct 04 20:32:00.816519 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 170/335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:00.828807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.830061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] [instance: 14717528-b8cd-4ff9-841b-da8ad78a852f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.845147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.847105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.848636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.850443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.851773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.852600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-589fbe28-2aa8-42e4-8bc8-5eb953e6a61b tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.853134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.856657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-589fbe28-2aa8-42e4-8bc8-5eb953e6a61b tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6061f171b7074e7da0e9e4f3258e7b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da29c3887bd45d8b73dda2c8573b19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-589fbe28-2aa8-42e4-8bc8-5eb953e6a61b tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Request method failure captured: Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJg8qzI1zOjD5owJDBsEJpTe3MaoSnBcbGFwVcRxML0ptnsbHFYTc2WtzklxF8F77FoCJE4FJbiahTM823lZVIyiDCIVZJuXLm8uoK-maH__ra2CMboYrlligRp2ffFfAGTh4Wk07pD5G0EoPcFdOPKA2oXCyS8Ub42xijrecHHIBok Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4da29c3887bd45d8b73dda2c8573b19a Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:00.863934 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4da29c3887bd45d8b73dda2c8573b19a Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6061f171b7074e7da0e9e4f3258e7b8c Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project Oct 04 20:32:00.866392 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:00.867628 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:32:00.870009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.872150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-589fbe28-2aa8-42e4-8bc8-5eb953e6a61b tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.872150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-589fbe28-2aa8-42e4-8bc8-5eb953e6a61b tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.305598 Oct 04 20:32:00.876208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 166/336] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:00.886174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.888020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:00.889206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] HTTP exception thrown: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Request method failure captured: Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f HTTP/1.1 Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfjyOKpB5kC1Asrb_BEwT2gf8aqXO7hm7NmQX441umQ82o-mizzgCicTcrMBRWDrQbcjr4I7lYVXv_ZOsn-9R1qAQB-DRb37R8YMEfUwTe6M8-ejbuvGO5G10Zmn1dlq5Av_Dg4MwKnTzQxHn2HC1spLulDLjaCHY9kZNaR3UcXxkM Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:00.891509 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b8f23134f1444a994c667625d3ef10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b8f23134f1444a994c667625d3ef10a Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1456554606 Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8652c21a239e4828841774b892990f1c Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AggregatesAdminTestJSON-1456554606-project Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.894505 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '14717528-b8cd-4ff9-841b-da8ad78a852f'} Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:00.899907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. Oct 04 20:32:00.901954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:00.904149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] Returning 404 to user: Instance 14717528-b8cd-4ff9-841b-da8ad78a852f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:00.904149 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4307adce-c20a-4916-8e81-546cd8291663 tempest-AggregatesAdminTestJSON-1456554606 tempest-AggregatesAdminTestJSON-1456554606-project] 10.222.0.36 "GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f" status: 404 len: 111 microversion: 2.1 time: 0.074735 Oct 04 20:32:00.904149 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 171/337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/servers/14717528-b8cd-4ff9-841b-da8ad78a852f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:00.904529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Calling method '.version_select at 0x7f54f6bcdca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:00.915375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.916794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.917941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.920927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.922546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.923839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.984484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:00.985111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:00.985589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:00.986114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lazy-loading 'fault' on Instance uuid 826949d3-1d7c-40cd-ad9d-34eaa85cf10d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:01.297477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:01.310694 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c543608d-61eb-4c87-9089-1fe3480f09af tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1459 microversion: 2.1 time: 0.432385 Oct 04 20:32:01.312797 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 167/338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1459 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:01.319642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73be48fa-7265-4053-9a15-42a0d8773e6d tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:01.322906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-73be48fa-7265-4053-9a15-42a0d8773e6d tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6061f171b7074e7da0e9e4f3258e7b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da29c3887bd45d8b73dda2c8573b19a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73be48fa-7265-4053-9a15-42a0d8773e6d tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Request method failure captured: Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020:32:00 HTTP/1.1 Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJg8qzI1zOjD5owJDBsEJpTe3MaoSnBcbGFwVcRxML0ptnsbHFYTc2WtzklxF8F77FoCJE4FJbiahTM823lZVIyiDCIVZJuXLm8uoK-maH__ra2CMboYrlligRp2ffFfAGTh4Wk07pD5G0EoPcFdOPKA2oXCyS8Ub42xijrecHHIBok Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4da29c3887bd45d8b73dda2c8573b19a Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:01.326374 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4da29c3887bd45d8b73dda2c8573b19a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4da29c3887bd45d8b73dda2c8573b19a Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6061f171b7074e7da0e9e4f3258e7b8c Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project Oct 04 20:32:01.328837 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2022-10-04 20:32:00'} Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:01.329925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:32:01.331337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:01.334453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73be48fa-7265-4053-9a15-42a0d8773e6d tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:01.335769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73be48fa-7265-4053-9a15-42a0d8773e6d tempest-InstanceUsageAuditLogNegativeTestJSON-868203396 tempest-InstanceUsageAuditLogNegativeTestJSON-868203396-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:32:00" status: 403 len: 128 microversion: 2.1 time: 0.021730 Oct 04 20:32:01.344735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 168/339] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 20:32:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A32%3A00 => generated 128 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:01.352020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826949d3-1d7c-40cd-ad9d-34eaa85cf10d", "name": "network-vif-deleted", "tag": "54b68e7f-f875-4d19-b360-73a61a60c22c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:01.371647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:01.372651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:01.373484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:01.395537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] Creating event network-vif-deleted:54b68e7f-f875-4d19-b360-73a61a60c22c for instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d on n-h2-851029-13 Oct 04 20:32:01.402687 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b293ee95-00ff-4bdc-92a6-57e5723b1bd2 req-b95c7235-d6d5-40a7-b4c5-e5f380e16874 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055798 Oct 04 20:32:01.403395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 169/340] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:01.864649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:01.866879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:01.879573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:01.880684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:01.881673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:01.883068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:01.883938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:01.885075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.129224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:02.147096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf9e6783-b8ef-44a1-aced-53c2a39b4a0d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.294523 Oct 04 20:32:02.148140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 170/341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:01 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:02.269602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.270470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.271296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.272577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.273407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.274157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.306063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-360ce4e8-b2b0-41ad-b3e4-6e903a65efdb tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5/detail" status: 200 len: 463 microversion: 2.57 time: 1.408890 Oct 04 20:32:02.315646 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 172/342] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 4 20:32:00 2022] GET /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5/detail => generated 463 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:02.360857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:02.361658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:02.377259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.379181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.380687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.382364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.383327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.384147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.417190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:02.453284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:02.454371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:02.455191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:02.456282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lazy-loading 'fault' on Instance uuid 826949d3-1d7c-40cd-ad9d-34eaa85cf10d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:32:02.556176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e953b401d7cd4ff8b8547760cf0caa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e82b6f1ee143b2b285a424cab7b8f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:02.590153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a548a995-2b27-40ff-807f-544cfc85511a tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 200 len: 1310 microversion: 2.1 time: 0.234442 Oct 04 20:32:02.594398 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 171/343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:02 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 1310 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:03.192473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.193113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.201172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.201649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.202428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.203229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.203703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.204139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.455357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:03.470707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2d8d4bc-2b51-4b5e-addc-dfedd00d3a12 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.282760 Oct 04 20:32:03.483477 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 173/344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:03.642414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.647338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.662788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.663694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.666572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.668271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.670220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.671517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d HTTP/1.1 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:03.717040 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.718615 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '826949d3-1d7c-40cd-ad9d-34eaa85cf10d'} Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:03.719846 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.722021 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.725583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:03.725583 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e402491d-d3d8-4bff-a366-05980c7cc1f9 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 404 len: 111 microversion: 2.1 time: 0.081761 Oct 04 20:32:03.725583 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 172/345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:03.735341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.736161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.746592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.747483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.748458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.749873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.750969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.751939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.781613 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d HTTP/1.1 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:03.787771 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.790585 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '826949d3-1d7c-40cd-ad9d-34eaa85cf10d'} Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:03.792459 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.794713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.796422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:03.796422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-559a2224-5f4a-40e6-924c-c7f864b3bd7c tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 404 len: 111 microversion: 2.1 time: 0.065416 Oct 04 20:32:03.799499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 174/346] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:03 2022] DELETE /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:03.807898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.808962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: 826949d3-1d7c-40cd-ad9d-34eaa85cf10d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.830433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.831611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.832695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.834341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.835270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.836631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.893228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d HTTP/1.1 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:03.895016 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.902004 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '826949d3-1d7c-40cd-ad9d-34eaa85cf10d'} Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:03.904645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. Oct 04 20:32:03.908738 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.915085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance 826949d3-1d7c-40cd-ad9d-34eaa85cf10d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:03.915085 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b9df037-e917-4803-aba3-280ad5815051 tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d" status: 404 len: 111 microversion: 2.1 time: 0.095912 Oct 04 20:32:03.915085 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 173/347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/servers/826949d3-1d7c-40cd-ad9d-34eaa85cf10d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:32:03.925957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:03.928738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:03.943108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.944885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.945703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.947107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:03.947980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:03.949068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 HTTP/1.1 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:03.980628 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:03.983382 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd290913d-911d-4ff5-bb26-c31d002992a7'} Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:03.987990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:03.993725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.000605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:04.000605 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-285cf2eb-b428-4477-885e-42e07dad284f tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 404 len: 111 microversion: 2.1 time: 0.071606 Oct 04 20:32:04.000605 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 175/348] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:32:03 2022] DELETE /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:04.001806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:04.001806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] [instance: d290913d-911d-4ff5-bb26-c31d002992a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:04.008644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:04.012174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:04.012174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:04.012174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:04.012174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:04.012883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:04.034755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] HTTP exception thrown: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Request method failure captured: Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 HTTP/1.1 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfj_glTIbLni3j2pBCd_LEpih9MbSmvRi8VGb__jEN1xaTkzePXPF6txHgQM869R31p2cNgxOHs5vvmZmnv97JqJzM7kq5zXsGWozKfkIC0sgCKa4Q2eqWsQwuLk4fgRJ1BMqwSkfQiPra0Uuquk5XZRSSO6Sy8Xfs7a5Tr-OtXNY0 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:04.037952 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05e82b6f1ee143b2b285a424cab7b8f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 05e82b6f1ee143b2b285a424cab7b8f8 Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957620493 Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e953b401d7cd4ff8b8547760cf0caa4d Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersAdminTestJSON-957620493-project Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:04.042970 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd290913d-911d-4ff5-bb26-c31d002992a7'} Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:04.044275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. Oct 04 20:32:04.046331 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:04.049069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] Returning 404 to user: Instance d290913d-911d-4ff5-bb26-c31d002992a7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:04.049069 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-450b1030-9a16-4ab0-9017-8fe0a6c1a42d tempest-DeleteServersAdminTestJSON-957620493 tempest-DeleteServersAdminTestJSON-957620493-project] 10.222.0.36 "GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7" status: 404 len: 111 microversion: 2.1 time: 0.051490 Oct 04 20:32:04.049069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 174/349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:03 2022] GET /compute/v2.1/servers/d290913d-911d-4ff5-bb26-c31d002992a7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:04.086522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6e0bee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:04.506790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:04.508407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:04.517971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:04.518468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:04.518984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:04.519737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:04.520208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:04.520645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.026429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:05.041534 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb667ff3-4cd5-4fa9-bfe2-431ed40cb638 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.543894 Oct 04 20:32:05.042307 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 175/350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:04 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:05.672901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.675781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.676932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.679789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.680426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.681337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.750958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.751762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.752474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.754375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:05.754985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:05.755733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:05.993952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:06.082057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc9e67cf-e551-4b44-b3f8-3affd99f9739 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5?user_id=cfb91effba6846be973e5a3d164b1491" status: 200 len: 148 microversion: 2.57 time: 1.984833 Oct 04 20:32:06.082057 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 176/351] 10.222.0.36 () {62 vars in 1384 bytes} [Tue Oct 4 20:32:04 2022] PUT /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5?user_id=cfb91effba6846be973e5a3d164b1491 => generated 148 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:06.087428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:06.089423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:06.097113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdca6502-1f59-4e40-9f0d-8c8bd5221f69 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] Calling method '.version_select at 0x7f54f6bcdca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:06.107488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.108636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.109459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.110712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:06.111489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:06.112239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:06.397262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:06.412443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-90e2fda2-befd-456b-ac8d-673aa2673157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.333452 Oct 04 20:32:06.413513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 176/352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:06 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:07.460838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:07.461935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:07.474025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:07.475869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:07.476463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:07.478170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:07.479284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:07.480595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:07.807683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bdca6502-1f59-4e40-9f0d-8c8bd5221f69 tempest-QuotasAdminTestV257-299694606 tempest-QuotasAdminTestV257-299694606-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5?user_id=cfb91effba6846be973e5a3d164b1491" status: 200 len: 190 microversion: 2.57 time: 1.718538 Oct 04 20:32:07.822215 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 177/353] 10.222.0.36 () {60 vars in 1364 bytes} [Tue Oct 4 20:32:06 2022] GET /compute/v2.1/os-quota-sets/3e9ddaa97386424c9d200845aaaa0aa5?user_id=cfb91effba6846be973e5a3d164b1491 => generated 190 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:07.827504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:07.851967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b367825a-7f59-4418-b142-ffa101bca7c5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.399320 Oct 04 20:32:07.854230 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 177/354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:07 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:08.899473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:08.900954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:08.916029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:08.917436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:08.918560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:08.920837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:08.922156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:08.923307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:09.199540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:09.215468 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-886fe808-ca19-41e2-90a9-817cc5b38517 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1475 microversion: 2.1 time: 0.324679 Oct 04 20:32:09.216600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 178/355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:08 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:10.253433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:10.254196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:10.264240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:10.265031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:10.266067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:10.268084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:10.275023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:10.275023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:10.334434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:10.542295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:10.592941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:10.614055 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67eeadb3-8922-4c23-95a1-0dd367107bad tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1474 microversion: 2.1 time: 0.365306 Oct 04 20:32:10.620875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 178/356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:10 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:11.661713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:11.663617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:11.677163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.678212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.679499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.681496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.682645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.683524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.736982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "name": "network-vif-unplugged", "status": "completed", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:11.778151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:11.779652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:11.780800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:11.807324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Creating event network-vif-unplugged:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h2-851029-13 Oct 04 20:32:11.833096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:32:11.859308 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-168611f2-15d5-4c52-8022-82fb7a8c9f1c req-aeb03ed9-2ed2-4dff-9fb2-151fdefda4b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132860 Oct 04 20:32:11.861981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 179/357] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:12.025923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:12.045085 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-821bfa19-6265-4fe0-a9da-0f107449fc31 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1474 microversion: 2.1 time: 0.392524 Oct 04 20:32:12.047416 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 179/358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:11 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:13.093362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:13.104817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:13.135528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:13.136359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:13.137235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:13.141666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:13.143493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:13.144308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:13.465045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:13.483808 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bbe70b2d-208d-47b9-b669-0d86070e8719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1474 microversion: 2.1 time: 0.399654 Oct 04 20:32:13.498706 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 180/359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:13 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:13.893081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:13.927480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:13.927480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:13.927480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:13.949629 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Creating event network-changed:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h2-851029-13 Oct 04 20:32:13.990777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:32:14.040132 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1f14d33d-508b-471c-93c1-73bf1bcc2f66 req-91175ce6-1299-4a63-b7d9-d98974af8281 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157004 Oct 04 20:32:14.041284 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 180/360] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:14.530591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:14.539581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:14.563512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.564651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.565783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:14.572304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:14.573526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:14.574321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:15.191204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:15.203279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa37e365-9b12-4b41-9e06-6c3a6693dca9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1472 microversion: 2.1 time: 0.679971 Oct 04 20:32:15.204950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 181/361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:14 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:15.777891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=13 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:16.247590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:16.248628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:16.281518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.282507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.283353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.284723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:16.285558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:16.286324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:16.487701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eeba4699-e124-4302-9605-aa80d4128aa1 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-570140515", "id": 1720808989, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:16.657654 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eeba4699-e124-4302-9605-aa80d4128aa1 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 1.335921 Oct 04 20:32:16.670945 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 181/362] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:32:15 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:16.800111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:16.834224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9612690-95d9-4c3c-af0e-99c71fda02c4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1472 microversion: 2.1 time: 0.593815 Oct 04 20:32:16.836878 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 182/363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:16 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1472 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:17.522619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf1b06c6-2118-460e-a12a-d9b9708b76c5 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.549611 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf1b06c6-2118-460e-a12a-d9b9708b76c5 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] 10.222.0.36 "GET /compute/v2.1/flavors/1720808989" status: 200 len: 467 microversion: 2.61 time: 0.859191 Oct 04 20:32:17.551137 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 182/364] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Oct 4 20:32:16 2022] GET /compute/v2.1/flavors/1720808989 => generated 467 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:17.584499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0867805-3854-433c-8192-0b8f058dcfab tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:17.724851 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0867805-3854-433c-8192-0b8f058dcfab tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1720808989" status: 200 len: 468 microversion: 2.61 time: 0.147926 Oct 04 20:32:17.725836 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 183/365] 10.222.0.36 () {62 vars in 1219 bytes} [Tue Oct 4 20:32:17 2022] PUT /compute/v2.1/flavors/1720808989 => generated 468 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:17.753153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f39a7bbe-2d74-4b31-a1ee-db308d25eb55 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.791521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:17.815498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f39a7bbe-2d74-4b31-a1ee-db308d25eb55 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 7158 microversion: 2.61 time: 0.071478 Oct 04 20:32:17.830709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 183/366] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/flavors/detail => generated 7158 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:17.868347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcb2d300-7537-486d-9d7f-cc6119159fa0 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.884361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:17.885923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:17.900689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:17.901586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:17.902600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:17.904949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:17.906128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:17.906953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:17.975427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcb2d300-7537-486d-9d7f-cc6119159fa0 tempest-FlavorsV261TestJSON-1188203331 tempest-FlavorsV261TestJSON-1188203331-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.61 time: 0.113497 Oct 04 20:32:17.976928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 184/367] 10.222.0.36 () {60 vars in 1166 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:18.298874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:18.321366 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0074126f-590f-437b-8dae-287d1ca56919 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1469 microversion: 2.1 time: 0.445833 Oct 04 20:32:18.323280 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 184/368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:17 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:18.367146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60510d1c-f514-44e7-9a26-e963caa9d268 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:18.548461 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60510d1c-f514-44e7-9a26-e963caa9d268 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1720808989" status: 202 len: 0 microversion: 2.61 time: 0.222484 Oct 04 20:32:18.557228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 185/369] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 4 20:32:18 2022] DELETE /compute/v2.1/flavors/1720808989 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:32:18.568548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:18.569673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:18.586411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.589623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.590975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:18.598542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:18.598542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:18.598542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.011670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1537374421", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:19.021671 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2cb0fcd0-9f04-4ac2-8161-0537e7e0fc8f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b/action" status: 204 len: 0 microversion: 2.1 time: 0.457450 Oct 04 20:32:19.026849 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 186/370] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:32:18 2022] POST /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b/action => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:32:19.062419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "name": "network-vif-plugged", "status": "completed", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:19.113502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.114444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.123328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.152091 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Creating event network-vif-plugged:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h2-851029-13 Oct 04 20:32:19.180779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:32:19.198849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:19.226013 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e02a9a46-70ef-4f60-a0db-9fedc50e5471 req-dca6c5f5-c054-4ad6-9504-f868600ef821 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193412 Oct 04 20:32:19.238006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 187/371] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:19.248560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d89b2b6c-0ea0-46c3-a6dc-2462ad3a4ea9 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:19.325180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d89b2b6c-0ea0-46c3-a6dc-2462ad3a4ea9 tempest-FlavorsV261TestJSON-1935556253 tempest-FlavorsV261TestJSON-1935556253-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.084694 Oct 04 20:32:19.336647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 188/372] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 20:32:19 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:19.349872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:19.356929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:19.387199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.387588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.388439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:19.392396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:19.395159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:19.407296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.141893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:20.158273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da1304e0-c2c0-4743-9f6b-7d90636c4ecb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1469 microversion: 2.1 time: 0.819494 Oct 04 20:32:20.159596 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 189/373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:19 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1469 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:20.222305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:20.223256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:20.224014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:20.224855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:20.225779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:20.267428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.268382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.269587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.283865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.284801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.285695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:20.342562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:20.357781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:20.361744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:20.423876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:20.428870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:20.685213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-068a08dc-f29f-4d29-9ec4-6c7e6a232348 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.703580 Oct 04 20:32:20.687113 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 185/374] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:20.929593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Calling method '.version_select at 0x7f54f6bcdc10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:20.947711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:20.953405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:20.955364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.039700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.043590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.045974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.095211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2127288917", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:21.117618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.123192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.123796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.152801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:21.178496 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50ae39c2-4063-41a4-b055-92220ce8734d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.997399 Oct 04 20:32:21.181653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 190/375] 10.222.0.36 () {60 vars in 1208 bytes} [Tue Oct 4 20:32:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:21.239110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c35f286-4826-455c-b59d-5c7d55e9623c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.240531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c35f286-4826-455c-b59d-5c7d55e9623c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:21.318721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:21.476584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c35f286-4826-455c-b59d-5c7d55e9623c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:21.518306 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c35f286-4826-455c-b59d-5c7d55e9623c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1217 microversion: 2.1 time: 0.331079 Oct 04 20:32:21.519501 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 191/376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:21.530478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:21.532095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:21.556096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.557000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.557871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:21.559762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:21.560696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:21.561805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:22.643008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:22.660609 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ab95e09-217c-49cd-b9b9-21d373b811fd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1469 microversion: 2.1 time: 1.138933 Oct 04 20:32:22.662014 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 192/377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:21 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1469 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:22.674648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be8eff95-5ed9-43a1-9d97-46fb3cb04924 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1556697252"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:22.682497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.aggregate [None req-be8eff95-5ed9-43a1-9d97-46fb3cb04924 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Generated uuid 71dc4706-bb5e-4351-a350-bd1e28e5de73 for aggregate {{(pid=123542) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:32:22.854139 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be8eff95-5ed9-43a1-9d97-46fb3cb04924 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.189249 Oct 04 20:32:22.856780 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 193/378] 10.222.0.36 () {62 vars in 1205 bytes} [Tue Oct 4 20:32:22 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:22.931526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:22.932300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:22.933628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:22.934946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:22.935709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:22.969244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.970720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.971775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:22.973329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:22.975226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:22.976169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:23.013810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Getting quotas for project 7a53c348cf974050b9ca2401aea6510b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:23.022027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Getting quotas for user 80239f15a949474da642543021a701ef and project 7a53c348cf974050b9ca2401aea6510b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:23.046218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:23.050524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:23.358396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-998272211", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:23.370426 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-583e5710-4b89-4e3c-b4f0-9be9ebb36eea tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681122 Oct 04 20:32:23.378245 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 186/379] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:23.409358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:23.410829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:23.448533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:23.452174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:23.454984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:23.456557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:23.460945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:23.462461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:23.528750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:23.907125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:23.936380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eca6f790-eddf-4780-b7cb-06828ce070de tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1221 microversion: 2.1 time: 0.555939 Oct 04 20:32:23.952185 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 187/380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:23 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1221 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:23.979050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8130bdf-05c8-4dfa-8450-9ef7bb8e3807 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-932650905"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:24.226073 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8130bdf-05c8-4dfa-8450-9ef7bb8e3807 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.278712 Oct 04 20:32:24.227419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 188/381] 10.222.0.36 () {62 vars in 1213 bytes} [Tue Oct 4 20:32:23 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:24.236562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9cac4a0b-9d4d-4db8-9083-4e6a8e65ec8f tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:24.240876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cac4a0b-9d4d-4db8-9083-4e6a8e65ec8f tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:24.567337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9cac4a0b-9d4d-4db8-9083-4e6a8e65ec8f tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:24.592241 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9cac4a0b-9d4d-4db8-9083-4e6a8e65ec8f tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1219 microversion: 2.1 time: 0.361507 Oct 04 20:32:24.593409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 189/382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:24 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:24.645017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:24.648025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:24.672823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.674284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.681027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.682625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.690194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.690194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.924603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:24.927523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:24.928922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:24.931637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:24.935052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:24.965006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.965934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.966726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:24.969849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:24.971361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:24.972497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:25.031694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Getting quotas for project 239f887a70154739880d4022f58e210b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:25.047090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Getting quotas for user db3e20ac90ba4e129c24328a2f0a7d40 and project 239f887a70154739880d4022f58e210b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:25.079999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:25.084648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:25.330480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:25.349176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c39bb45-892f-41b1-aa06-610a47a24a23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1461 microversion: 2.1 time: 0.733940 Oct 04 20:32:25.351388 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 190/383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:24 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1461 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:25.363364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0027f3b3-9d9d-4046-960f-b47eef533201 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:25.382496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0027f3b3-9d9d-4046-960f-b47eef533201 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.027825 Oct 04 20:32:25.384867 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 191/384] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 20:32:25 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:25.395379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:25.396914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:25.402447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0105951-42d6-461a-8208-cea865f2ab9c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.520635 Oct 04 20:32:25.405701 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 194/385] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:25.425461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:25.428050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:25.428874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:25.431061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:25.431907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:25.433031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:25.446538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:25.447700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:25.492387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:25.498201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:25.504780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:25.504780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:25.504780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:25.504780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:25.642010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:25.695557 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc5daafe-fec9-4728-887b-71343aa19629 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1269 microversion: 2.1 time: 0.304729 Oct 04 20:32:25.701048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 192/386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:25 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1269 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:25.728893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c8dff3d-6b38-4196-85d7-7e1a8e26509d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:25.819121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c8dff3d-6b38-4196-85d7-7e1a8e26509d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:25.820522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c8dff3d-6b38-4196-85d7-7e1a8e26509d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:25.824740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c8dff3d-6b38-4196-85d7-7e1a8e26509d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:26.570736 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a221ecc7-9472-4641-ab36-453a8be635a9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1614 microversion: 2.1 time: 1.153053 Oct 04 20:32:26.573172 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 195/387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:25 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1614 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:26.584580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88130da3-2fb8-4ab8-9e37-c40228a710cb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:26.586710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88130da3-2fb8-4ab8-9e37-c40228a710cb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:26.640762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c8dff3d-6b38-4196-85d7-7e1a8e26509d tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.935543 Oct 04 20:32:26.643912 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 193/388] 10.222.0.36 () {62 vars in 1235 bytes} [Tue Oct 4 20:32:25 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:26.667414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:26.686110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:26.719072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.720746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.738652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:26.740264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:26.741086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:26.742143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.038649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-88130da3-2fb8-4ab8-9e37-c40228a710cb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:27.054959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:27.079530 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea4112b3-b98a-4d33-ab5a-977562ebe471 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1223 microversion: 2.1 time: 0.431216 Oct 04 20:32:27.095249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 194/389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:26 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1223 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:27.095249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e28f81e-8df7-4722-b562-8e605f9c2d65 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '.version_select at 0x7f54f6b37c10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:27.099605 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88130da3-2fb8-4ab8-9e37-c40228a710cb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1216 microversion: 2.1 time: 0.520149 Oct 04 20:32:27.101083 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 196/390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:26 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1216 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:27.115008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e28f81e-8df7-4722-b562-8e605f9c2d65 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:27.115008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e28f81e-8df7-4722-b562-8e605f9c2d65 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:27.115008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e28f81e-8df7-4722-b562-8e605f9c2d65 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.152343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b05f12bf-5bee-44de-85ea-b62fe59dabf5 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:27.157803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e28f81e-8df7-4722-b562-8e605f9c2d65 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.072442 Oct 04 20:32:27.165696 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 195/391] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:32:27 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:27.183011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:27.188805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:27.206542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b05f12bf-5bee-44de-85ea-b62fe59dabf5 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:27.208796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b05f12bf-5bee-44de-85ea-b62fe59dabf5 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:27.214089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b05f12bf-5bee-44de-85ea-b62fe59dabf5 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.220293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:27.221585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:27.222580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.227382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:27.228471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:27.236989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:27.790381 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b05f12bf-5bee-44de-85ea-b62fe59dabf5 tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.668491 Oct 04 20:32:27.805547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 197/392] 10.222.0.36 () {62 vars in 1235 bytes} [Tue Oct 4 20:32:27 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:32:27.819292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96b4ab5c-21b3-49d2-b4a7-5b41affae37f tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:27.938591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:27.971368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96b4ab5c-21b3-49d2-b4a7-5b41affae37f tempest-AggregatesAdminTestV241-1692370031 tempest-AggregatesAdminTestV241-1692370031-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.163118 Oct 04 20:32:27.981923 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 198/393] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Oct 4 20:32:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:27.982194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30b080a6-3997-4d47-ac4c-03006a6d8da8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1275 microversion: 2.1 time: 0.807271 Oct 04 20:32:27.988721 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 196/394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:27 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1275 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:28.016299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1013452744", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:28.144916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:28.147905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:28.169318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.174477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.174477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.174477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.175604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.176692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.226935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:28.248982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:28.408078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:28.439158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ca34afb-9457-4624-bc85-a7a992cbb1b6 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1271 microversion: 2.1 time: 0.290845 Oct 04 20:32:28.440589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 197/395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:28 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:28.446571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:28.447548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:28.471197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.477067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.477888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.479943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:28.481212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:28.481799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:28.785767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:28.805184 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65eafe81-d4f0-4264-964a-05167d56bf9f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1220 microversion: 2.1 time: 0.362003 Oct 04 20:32:28.806098 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 198/396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:28 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1220 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:29.025818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:29.031254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:29.059048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.060234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.068303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.068546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.069823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.071283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.716779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:29.717563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:29.718333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:29.721359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:29.722122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:29.754117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.755005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.756312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.760734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:29.760734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:29.760734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:29.848215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:29.860202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:29.866403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:29.895655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:29.900544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:29.964470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:29.985755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2809a266-2696-4fe0-9d88-be36d1f5f285 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1317 microversion: 2.1 time: 0.967088 Oct 04 20:32:29.987306 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 199/397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:29 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:30.011872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:30.013049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:30.030152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.032599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.034124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.036055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.037424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.038586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.137951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c59379eb-7ed7-4964-a055-0afeed0a72f5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.161607 Oct 04 20:32:30.151235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 199/398] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:32:30.164021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:30.165978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:30.179590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.180934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.182297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.184201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:30.185413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:30.186543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:30.256437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:30.281800 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cfd861bc-8fa3-401d-8e1c-312f66bc3a5e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1277 microversion: 2.1 time: 0.292553 Oct 04 20:32:30.282907 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 200/399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:29 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:30.338089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3dafec6-c7f2-4c0a-9875-4d8056da13ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:30.339606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3dafec6-c7f2-4c0a-9875-4d8056da13ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:30.380581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:30.425752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6fa2d1f7-7730-4c46-a9d0-641ca5698a3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1268 microversion: 2.1 time: 0.269044 Oct 04 20:32:30.426894 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 200/400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:30 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:30.569293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f3dafec6-c7f2-4c0a-9875-4d8056da13ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:30.614974 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3dafec6-c7f2-4c0a-9875-4d8056da13ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1213 microversion: 2.1 time: 0.292655 Oct 04 20:32:30.620284 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 201/401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:30 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1213 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:31.033782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:31.039012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:31.075325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.079983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.087906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.089609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.094647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.095830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.572943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Calling method '.version_select at 0x7f54f6c3fee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:31.592566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.594114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.596699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.600053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.604650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.608943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.719789 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91478f30-d735-4ac9-b9fc-eba0ebbc250e tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.635354 Oct 04 20:32:31.731462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 202/402] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:32:31 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:31.739807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:31.740961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:31.753599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.754425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.755483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:31.756781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:31.757619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:31.758386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.170459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:32.207908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-29336d5d-709e-45cd-9f3d-57a0330586ae tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1277 microversion: 2.1 time: 0.484411 Oct 04 20:32:32.209323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 203/403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:31 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1277 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:32.229941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:32.241288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:32.260932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.262327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.279333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.280785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:32.285815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:32.286993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:32.988404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:33.005615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:33.017737 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19fee680-f4f5-4bf7-8e1d-5647b3e4ba84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1317 microversion: 2.1 time: 1.989714 Oct 04 20:32:33.032559 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e04875d-afcc-4d63-a1f3-cddd55d0bcbc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1274 microversion: 2.1 time: 0.821097 Oct 04 20:32:33.039046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 201/404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:31 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1317 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:33.041533 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 204/405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:32 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1274 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:33.062900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:33.064322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:33.112241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.112241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.112241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.115722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.119958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.127280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.478405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:33.504002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26444c4a-4aa1-43d5-ac46-8098413d6491 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1209 microversion: 2.1 time: 0.462897 Oct 04 20:32:33.512856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 202/406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:33 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1209 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:33.540107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ea1f23-cdc1-4fac-b05e-46c2bfeaac78", "tag": "32eb5f97-9481-4222-9e74-bec41e719ae9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:33.615409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.619896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.623803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.677027 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] Creating event network-changed:32eb5f97-9481-4222-9e74-bec41e719ae9 for instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 on n-h2-851029-13 Oct 04 20:32:33.697313 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f0571693-4815-4b91-95d5-bd946634d576 req-db2c7304-9e97-4fb4-bf70-8500ad07ed59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174370 Oct 04 20:32:33.700447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 203/407] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:33.714385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:33.727326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:33.760002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.762437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.765141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:33.768468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:33.773632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:33.778938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a1f9209-f3f1-4e92-9d84-1dcf5dd11f86 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Calling method '.version_select at 0x7f54f6b37ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a1f9209-f3f1-4e92-9d84-1dcf5dd11f86 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a1f9209-f3f1-4e92-9d84-1dcf5dd11f86 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:34.161049 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.164290 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:34.168856 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:34.174888 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a1f9209-f3f1-4e92-9d84-1dcf5dd11f86 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a1f9209-f3f1-4e92-9d84-1dcf5dd11f86 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.103852 Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 205/408] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:32:33 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1111 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.179668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:34.186516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.187367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.188473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.195537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.197136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.198411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.283055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.316040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d569399-0c02-434b-aabc-ee5e2547ab9b tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1277 microversion: 2.1 time: 0.607594 Oct 04 20:32:34.316040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 204/409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:33 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1277 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:34.365050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.365890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:34.379792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.387267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.389133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.390975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.394995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.396740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.760486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.760486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1908992-a156-4184-8b84-a2dd89bbf052 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1274 microversion: 2.1 time: 0.392106 Oct 04 20:32:34.760486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 205/410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1274 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:34.779984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-345baa6d-507a-4d01-b31d-18203067576e tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Calling method '.version_select at 0x7f54f6b9eb80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.783564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-345baa6d-507a-4d01-b31d-18203067576e tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-345baa6d-507a-4d01-b31d-18203067576e tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-hosts/n-d-851029-13/reboot HTTP/1.1 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:34.787093 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'n-d-851029-13'} Oct 04 20:32:34.789525 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:34.790634 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:32:34.792433 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.797698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-345baa6d-507a-4d01-b31d-18203067576e tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:34.801479 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-345baa6d-507a-4d01-b31d-18203067576e tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-851029-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.057993 Oct 04 20:32:34.803887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 206/411] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/os-hosts/n-d-851029-13/reboot => generated 111 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:34.815925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.817963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:34.828197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.828955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.831684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.832453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:34.834538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:34.836097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:34.866821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.903052 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6837d766-fe69-4846-a45b-ffc93399ec29 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1317 microversion: 2.1 time: 0.728616 Oct 04 20:32:34.903052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 206/412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:34.903052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a865c0de-4e8f-4e74-85a0-e309d84018f1 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Calling method '.version_select at 0x7f54f6ded040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.934453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a865c0de-4e8f-4e74-85a0-e309d84018f1 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a865c0de-4e8f-4e74-85a0-e309d84018f1 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:32:34.940028 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:32:34.942377 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:34.943782 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:32:34.945733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a865c0de-4e8f-4e74-85a0-e309d84018f1 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a865c0de-4e8f-4e74-85a0-e309d84018f1 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.053889 Oct 04 20:32:34.949872 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 207/413] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:34.973350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30b0990d-a3c7-41ae-9b0f-b474147d89dd tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Calling method '.version_select at 0x7f54f6b37f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:34.987016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30b0990d-a3c7-41ae-9b0f-b474147d89dd tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30b0990d-a3c7-41ae-9b0f-b474147d89dd tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/n-d-851029-13 HTTP/1.1 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:34.994138 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'n-d-851029-13'} Oct 04 20:32:34.996976 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:34.998381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:32:35.002124 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.008239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30b0990d-a3c7-41ae-9b0f-b474147d89dd tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.008239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30b0990d-a3c7-41ae-9b0f-b474147d89dd tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-851029-13" status: 403 len: 109 microversion: 2.1 time: 0.045629 Oct 04 20:32:35.015405 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 208/414] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/os-hosts/n-d-851029-13 => generated 109 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:35.030780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ab95422-4329-4d3e-a4d6-bab26bd8632c tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Calling method '.version_select at 0x7f54f6ded040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.043377 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9ab95422-4329-4d3e-a4d6-bab26bd8632c tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ab95422-4329-4d3e-a4d6-bab26bd8632c tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:32:35.047807 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:32:35.050378 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.051918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.054053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.057267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ab95422-4329-4d3e-a4d6-bab26bd8632c tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.058239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ab95422-4329-4d3e-a4d6-bab26bd8632c tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039086 Oct 04 20:32:35.060499 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 209/415] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:35.081371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a4ede32-bc6c-418d-a8ee-fcda7c2c41b9 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Calling method '.version_select at 0x7f54f6ce05e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.085792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a4ede32-bc6c-418d-a8ee-fcda7c2c41b9 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a4ede32-bc6c-418d-a8ee-fcda7c2c41b9 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/n-d-851029-13/shutdown HTTP/1.1 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:35.089866 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'n-d-851029-13'} Oct 04 20:32:35.092701 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.094373 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:32:35.096963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.101357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a4ede32-bc6c-418d-a8ee-fcda7c2c41b9 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.101357 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a4ede32-bc6c-418d-a8ee-fcda7c2c41b9 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-851029-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020284 Oct 04 20:32:35.107500 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 210/416] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/os-hosts/n-d-851029-13/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:35.118329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d425523-eacf-45e2-8d01-44eb998526de tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Calling method '.version_select at 0x7f54f6b37ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.147077 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0d425523-eacf-45e2-8d01-44eb998526de tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d425523-eacf-45e2-8d01-44eb998526de tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:32:35.151230 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:32:35.177936 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:35.183062 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:32:35.199289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d425523-eacf-45e2-8d01-44eb998526de tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d425523-eacf-45e2-8d01-44eb998526de tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.043876 Oct 04 20:32:35.202753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 211/417] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b74b2d17-88f3-4427-9dd7-68d3c25f07e4 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Calling method '.version_select at 0x7f54f6dde820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b74b2d17-88f3-4427-9dd7-68d3c25f07e4 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b74b2d17-88f3-4427-9dd7-68d3c25f07e4 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/n-d-851029-13/startup HTTP/1.1 Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.204906 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.208638 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'n-d-851029-13'} Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.213117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:32:35.219044 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.224294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b74b2d17-88f3-4427-9dd7-68d3c25f07e4 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.224294 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b74b2d17-88f3-4427-9dd7-68d3c25f07e4 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-851029-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.028352 Oct 04 20:32:35.224294 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 212/418] 10.222.0.36 () {58 vars in 1194 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/os-hosts/n-d-851029-13/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:32:35.224294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f95009-dec9-4a5e-9502-c6aface2f107 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Calling method '.version_select at 0x7f54f6ba1280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.248800 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-46f95009-dec9-4a5e-9502-c6aface2f107 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f95009-dec9-4a5e-9502-c6aface2f107 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:32:35.262477 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:32:35.264878 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:35.266330 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:32:35.268533 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.270585 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.296920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f95009-dec9-4a5e-9502-c6aface2f107 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.299124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46f95009-dec9-4a5e-9502-c6aface2f107 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.090625 Oct 04 20:32:35.302423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 213/419] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:35.319362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:35.323958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7de38a0a-2cb3-420f-a2cd-528abb1ef548 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6b375e0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7de38a0a-2cb3-420f-a2cd-528abb1ef548 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/os-hosts/n-d-851029-13 HTTP/1.1 Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 51 Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:32:35.334849 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:32:35.337073 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'n-d-851029-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.345763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.348556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7de38a0a-2cb3-420f-a2cd-528abb1ef548 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7de38a0a-2cb3-420f-a2cd-528abb1ef548 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-851029-13" status: 400 len: 199 microversion: 2.1 time: 0.028160 Oct 04 20:32:35.350530 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 214/420] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:32:35 2022] PUT /compute/v2.1/os-hosts/n-d-851029-13 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:32:35.356529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0ffda8d-05ee-44b0-bb52-6fb407d82c6f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1265 microversion: 2.1 time: 0.533289 Oct 04 20:32:35.364635 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 207/421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:34 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1265 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:35.390517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5a84821-3dae-4b94-9191-7500d07cdfcb tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6af8160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:35.396049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.407556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5a84821-3dae-4b94-9191-7500d07cdfcb tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/os-hosts/n-d-851029-13 HTTP/1.1 Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 51 Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:32:35.418847 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:32:35.421292 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'n-d-851029-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.424436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.436034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.441751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5a84821-3dae-4b94-9191-7500d07cdfcb tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.443582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5a84821-3dae-4b94-9191-7500d07cdfcb tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-851029-13" status: 400 len: 189 microversion: 2.1 time: 0.068670 Oct 04 20:32:35.454350 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 208/422] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:32:35 2022] PUT /compute/v2.1/os-hosts/n-d-851029-13 => generated 189 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:32:35.454583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.460402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.461274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.463014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.473106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.474120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.475501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-525bc55a-53f5-4149-a7ec-4baf1150e678 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Action: 'update', calling method: .version_select at 0x7f54f6b20d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:35.485886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-525bc55a-53f5-4149-a7ec-4baf1150e678 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '74ca670b1cf04c85b398ef9cb1a9c925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1cd4cb9f1a45fb96436d4fc1994109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-525bc55a-53f5-4149-a7ec-4baf1150e678 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Request method failure captured: Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/os-hosts/n-d-851029-13 HTTP/1.1 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 50 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhc7k4DYZS8uqlULgfs3JKv9bxSbKZ3huC64WFE5uf4vOQLRoLKPv2xhOQl4AG7BiIygMiz2i6RsP08x0h6E_HH3jb0r85AW88TCKReym-uI0a45NXh6W-tkl1ugmAq1TLhFVGsPPs7g943LoJ30yuDjA-LIBV4YntZh2CFadJW9Qs Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:35.490948 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4e1cd4cb9f1a45fb96436d4fc1994109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 4e1cd4cb9f1a45fb96436d4fc1994109 Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-324518535 Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 74ca670b1cf04c85b398ef9cb1a9c925 Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-324518535-project Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:32:35.496786 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'n-d-851029-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.498616 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:32:35.501999 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.503728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-525bc55a-53f5-4149-a7ec-4baf1150e678 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.506184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-525bc55a-53f5-4149-a7ec-4baf1150e678 tempest-HostsAdminNegativeTestJSON-324518535 tempest-HostsAdminNegativeTestJSON-324518535-project] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-851029-13" status: 403 len: 111 microversion: 2.1 time: 0.041088 Oct 04 20:32:35.507303 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 209/423] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:32:35 2022] PUT /compute/v2.1/os-hosts/n-d-851029-13 => generated 111 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:35.546334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3f5f1f1-a97f-4800-b965-2f3ede778db2 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6b20700>, body: {"status": null, "maintenance_mode": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3f5f1f1-a97f-4800-b965-2f3ede778db2 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/os-hosts/n-d-851029-13 HTTP/1.1 Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 42 Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:32:35.580310 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: {"status": null, "maintenance_mode": null} Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:32:35.586788 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'n-d-851029-13', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi None Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.591005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.594032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3f5f1f1-a97f-4800-b965-2f3ede778db2 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3f5f1f1-a97f-4800-b965-2f3ede778db2 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-851029-13" status: 400 len: 127 microversion: 2.1 time: 0.069851 Oct 04 20:32:35.596408 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 210/424] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 4 20:32:35 2022] PUT /compute/v2.1/os-hosts/n-d-851029-13 => generated 127 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:32:35.609653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6b56670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:35.616501 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.hosts [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Enabling host nonexistent_hostname. Oct 04 20:32:35.639428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Request method failure captured: Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 50 Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhe_Qs0vdb4Rl_YbPpjL4gsTWMo6VB1xBT2DWJQpSsPFOUELuz4OzXQfkVR045l4zlX67Kd-h--b3qUZ_NYv3zWKVEFyY8zElLSU1KR5YxxlDGIvoMOARedsdXb5pvZmbNjxHY467tP4Kia3VduqfGSLZ3FWcztmk-o2r1Jg8kLQlA Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:32:35.645063 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b22c103469f4f15a7795af8b3c87c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 9b22c103469f4f15a7795af8b3c87c4b Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1980119989 Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 37caafcee49a48a187c5870c17248fd0 Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1980119989-project-admin Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.647787 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:32:35.649531 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:35.651714 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:35.654888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:35.666787 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f540c058-cf94-4226-a105-7af8cdce1226 tempest-HostsAdminNegativeTestJSON-1980119989 tempest-HostsAdminNegativeTestJSON-1980119989-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.048392 Oct 04 20:32:35.666787 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 211/425] 10.222.0.36 () {60 vars in 1211 bytes} [Tue Oct 4 20:32:35 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:32:35.792802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:35.792802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:35.814389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.830978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.832226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:35.841707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:35.845311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:35.846112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.180438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:37.204587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-424d77e8-ff0e-4e18-8308-4bf064e21e82 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1274 microversion: 2.1 time: 1.420948 Oct 04 20:32:37.206723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 212/426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1274 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:37.219186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:37.221243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:37.237510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.238460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.240172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.241943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.249485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.249485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.556732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:37.633623 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b05ec89e-7cb2-425b-9e3a-e8f161470bb4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 2.276425 Oct 04 20:32:37.634213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 215/427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:35 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:37.680387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:37.685062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:37.698630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.701152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.702410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:37.704930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:37.705135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:37.706012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.321981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:38.357020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-491d3c96-7a94-44e6-85c9-4d3185f9bf2e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1271 microversion: 2.1 time: 0.708004 Oct 04 20:32:38.362714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 216/428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:37 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1271 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:38.375418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:38.376577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:38.395450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.396367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.397183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.398574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.399456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.400769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.512857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:38.561838 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89e9bbdf-b982-40a8-b9c6-49212e86e64e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1317 microversion: 2.1 time: 1.345249 Oct 04 20:32:38.566576 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 213/429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:37 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1317 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:38.682362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:38.685440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:38.704449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.705862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.707056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:38.708809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:38.711299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:38.712578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.349702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:39.380848 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97d28ba1-ff47-46b6-a849-1b226117c973 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1274 microversion: 2.1 time: 1.016163 Oct 04 20:32:39.382389 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 217/430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:38 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1274 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:39.393596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ea1f23-cdc1-4fac-b05e-46c2bfeaac78", "name": "network-vif-plugged", "status": "completed", "tag": "32eb5f97-9481-4222-9e74-bec41e719ae9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:39.422158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.423032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.424114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.448017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] Creating event network-vif-plugged:32eb5f97-9481-4222-9e74-bec41e719ae9 for instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 on n-h2-851029-13 Oct 04 20:32:39.457848 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6faaa027-a7bb-4c09-981b-d744bd6f975d req-e8da3be7-47d9-4af2-ae5c-b9100c631fbe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072662 Oct 04 20:32:39.460067 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 218/431] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:39.470736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:39.472527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:39.486515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.487552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.488354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.489711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.490907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.492220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.807753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:39.882257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:39.887725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:39.914590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b60d1f25-8c22-48a7-bb35-2560820ca966 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1271 microversion: 2.1 time: 0.451895 Oct 04 20:32:39.938131 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 219/432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:39 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1271 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:39.944431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:39.946573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:39.971450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.972228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.973072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:39.974369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:39.975281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:39.976153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.028556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:40.047619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a128b8b-3b84-4854-b83d-d91596ae50a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 1.374155 Oct 04 20:32:40.048434 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 214/433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:38 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:40.429450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.433688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:40.452743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.454338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.456835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.459341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:40.460261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:40.461046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:40.583994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:40.969069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:40.983323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f4b7c36-eccc-4910-b77f-8fa5aa2fcc9c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1317 microversion: 2.1 time: 1.054117 Oct 04 20:32:40.984258 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 220/434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:39 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1317 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:40.993574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:40.995429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:41.006697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.008011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.009154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.010900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.012686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.013779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.313839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:41.353735 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd44ded2-29cd-4d6c-af64-d4c80c7a4157 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1271 microversion: 2.1 time: 0.366321 Oct 04 20:32:41.355214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 221/435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1271 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:41.366784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:41.376286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:41.396233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:41.400348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.401907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.403229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.405722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:41.406965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:41.408156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:41.449716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:41.480873 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e6c84ec-2b92-458c-b314-97186364a50c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.055394 Oct 04 20:32:41.489533 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 215/436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:40 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:41.648981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:42.032898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:42.032898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:42.057734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.060546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.062058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:42.078761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:42.084810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.091883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.092583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:42.127826 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1b85d75-24f3-4c1c-9c58-977c0f6f9571 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 0.758684 Oct 04 20:32:42.130790 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 222/437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:41 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:42.397643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:42.405048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:42.429956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.431203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.432254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:42.433625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:42.434473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:42.435306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.466395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:43.505758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:43.507007 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-305565a1-2127-4e45-a651-c4cd7ce866c3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1467 microversion: 2.1 time: 1.466284 Oct 04 20:32:43.507007 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 216/438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:42 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1467 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:32:43.507007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:43.507007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:43.516370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.517874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.519057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.520600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.521600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.522797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.543764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71a8bd6e-118b-4f7e-ad7f-71fbab04cd43 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.153581 Oct 04 20:32:43.544645 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 223/439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:42 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:43.903042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf1bf1f-6697-45bf-8cc2-8eebd9ac2386 tempest-AZAdminNegativeTestJSON-2102326734 tempest-AZAdminNegativeTestJSON-2102326734-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:43.906323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf1bf1f-6697-45bf-8cc2-8eebd9ac2386 tempest-AZAdminNegativeTestJSON-2102326734 tempest-AZAdminNegativeTestJSON-2102326734-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'dfe3b17c832a454ab50054f77f227580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61e6c5834104394b4c2a1d28d07f13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf1bf1f-6697-45bf-8cc2-8eebd9ac2386 tempest-AZAdminNegativeTestJSON-2102326734 tempest-AZAdminNegativeTestJSON-2102326734-project] Request method failure captured: Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJho6cxj-mgGxYPknjSjJn1V-XK25em707BRIAwohjs_MrtTC51KtlWuA1eburwC_zGk7ABm0kyULrLE_v-WDqZDkqjvhCwEt8S8A4BW9uv4fUgcryuMeoekCVmsF3w2hGKDDXJq45EmnXd2qWFikuRIHVsVmTPpcqxIz6uxSu_xFfw Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e61e6c5834104394b4c2a1d28d07f13c Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2102326734 Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:43.915036 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e61e6c5834104394b4c2a1d28d07f13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e61e6c5834104394b4c2a1d28d07f13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e61e6c5834104394b4c2a1d28d07f13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e61e6c5834104394b4c2a1d28d07f13c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AZAdminNegativeTestJSON-2102326734 Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e61e6c5834104394b4c2a1d28d07f13c Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2102326734 Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AZAdminNegativeTestJSON-2102326734-project Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dfe3b17c832a454ab50054f77f227580 Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AZAdminNegativeTestJSON-2102326734-project Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:43.918234 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:43.919683 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:43.925091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf1bf1f-6697-45bf-8cc2-8eebd9ac2386 tempest-AZAdminNegativeTestJSON-2102326734 tempest-AZAdminNegativeTestJSON-2102326734-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:43.930743 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cf1bf1f-6697-45bf-8cc2-8eebd9ac2386 tempest-AZAdminNegativeTestJSON-2102326734 tempest-AZAdminNegativeTestJSON-2102326734-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.371101 Oct 04 20:32:43.930743 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 224/440] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:32:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 374 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:43.943244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:43.943244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:43.963159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.964060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.966257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:43.967788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:43.969411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:43.970994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:44.521765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:44.538321 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-942bf0ae-6020-4bf7-a948-c6ddf426e697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.046202 Oct 04 20:32:44.539327 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 217/441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:43 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:44.804637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:44.852606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f40c699f-fcaf-414f-888c-55784813b3be tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 0.931357 Oct 04 20:32:44.853700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 225/442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:43 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:44.864618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:44.866250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:44.890023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:44.891211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:44.892614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:44.894134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:44.895456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:44.896407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:44.932924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:45.557035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:45.562617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:45.584462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.585773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.586997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.589186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.590318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.591184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.959451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:45.989176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-937e0964-f93a-4389-99d6-2f0dbaedfa71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.131233 Oct 04 20:32:46.011979 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 226/443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:44 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:46.821070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6ded040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:46.845354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:46.848201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:46.855996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:46.937225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:46.938569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:46.941220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:46.979366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:46.982212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:46.983888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.002458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0788d05-8404-431a-b01c-9a8daf7b140a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.988503 Oct 04 20:32:47.004571 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 227/444] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:47.025676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:47.027983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:47.048209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.049845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.050859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:47.052753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:47.053802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:47.054790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.114149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:48.128365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:48.135341 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e2da006-f8a9-430d-ae36-cd96f803f93d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1620 microversion: 2.1 time: 3.592894 Oct 04 20:32:48.137700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 218/445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:44 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1620 bytes in 3597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:48.154108 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7163b69f-d2fe-4863-bd43-002a17b32f28 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.147283 Oct 04 20:32:48.157085 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 228/446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:47 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:48.166111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.174426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:48.189396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd4e455-7753-46e0-9b94-ab1002013970", "tag": "f9a87de1-d2d1-4b2b-93f0-ac528e465913"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:48.206473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.210012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.211277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.212941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.216300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.225373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.231563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.237381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.238350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.262790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] Creating event network-changed:f9a87de1-d2d1-4b2b-93f0-ac528e465913 for instance 0fd4e455-7753-46e0-9b94-ab1002013970 on n-h2-851029-13 Oct 04 20:32:48.272486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-88c3a15a-ccd6-4ddd-a22a-c496ef883e4b req-869d6667-74c5-4318-949e-5396ae212a08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132266 Oct 04 20:32:48.273883 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 219/447] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:48.295882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6d18040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.305020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.309210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.313150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.386814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.389324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.390437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.419636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.420445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.421252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.446802 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c81c6a8-6a0d-42fa-9704-b009449290fe tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.167479 Oct 04 20:32:48.451386 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 220/448] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:48.464739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:48.466474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:48.483368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.484576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.485816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:48.486973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:48.487713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:48.488431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.357483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:49.376490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41ea4ec3-fe51-4d95-8ca5-f44397793245 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 1.217974 Oct 04 20:32:49.395013 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 229/449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:49.395423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:49.395807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: .version_select at 0x7f54f6c13a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1177333726", "policies": ["affinity"]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:49.421227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6cbbd12b-9462-46d0-af5c-706af0085fb3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 0.961695 Oct 04 20:32:49.425495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 221/450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:48 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:49.447083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:49.459388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:49.465282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6d18550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:49.485815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.493069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.502312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.549226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.551607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.592145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.624502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.625947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.627134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.646950 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a6d4a40-c6a8-4785-a180-3de3ab175075 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.216223 Oct 04 20:32:49.648534 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 222/451] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:49.659177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:49.660921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:49.678850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.680276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.681382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.685737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.702473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.706161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.765251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:49.786106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:49.815810 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a750aaa-59eb-4edb-8c86-935cf05a6e43 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.432671 Oct 04 20:32:49.817021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 230/452] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 4 20:32:49 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:49.835409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6b37e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:49.851815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.857296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.858811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.905125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.906002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.906891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:49.922542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ffb88ac7-aa7f-487e-ba99-426ba622d4e3 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.100780 Oct 04 20:32:49.940457 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 231/453] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:49.960900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-439aae8d-b2fc-4550-99ec-0eccc0b4aa4a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6ba1280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:49.966340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-439aae8d-b2fc-4550-99ec-0eccc0b4aa4a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:49.968176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-439aae8d-b2fc-4550-99ec-0eccc0b4aa4a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:49.969616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-439aae8d-b2fc-4550-99ec-0eccc0b4aa4a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.017118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-439aae8d-b2fc-4550-99ec-0eccc0b4aa4a tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.066661 Oct 04 20:32:50.032919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 232/454] 10.222.0.36 () {58 vars in 1179 bytes} [Tue Oct 4 20:32:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:50.046510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6ded670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:50.053542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.055438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.058146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.098755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.101261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.102120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.126887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.127814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.128874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.144521 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44b0b513-8e95-491d-b96a-e13adadf3ed9 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108693 Oct 04 20:32:50.147581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 233/455] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:32:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:50.177056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6ba1700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:50.189724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.192290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.195494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.240183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.241123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.242236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.262382 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6e7a0873-44cd-4ae3-b47d-4029baa6f48c tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.104203 Oct 04 20:32:50.264042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 234/456] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:32:50.299826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6b37550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:50.304804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.305386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.306187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.342557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.343809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.344634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.360390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9429303d-8f29-4d0d-8a5b-4505ff4ee111 tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.071572 Oct 04 20:32:50.361581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 235/457] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:32:50 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:50.395203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-620585584", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "27777efb-1e07-421d-84df-00daf501aeaf"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:50.602453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:32:50.877711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:50.893157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-895be33c-8e07-4237-abf4-0921164d0e03 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.242142 Oct 04 20:32:50.897315 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 223/458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:49 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:50.916232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8267455-7584-4784-936c-4339b911d204", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}, {"name": "network-changed", "server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:50.944466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:50.946468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:50.948007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:50.990238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Creating event network-changed:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:32:50.991307 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] Creating event network-changed:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h1-851029-13 Oct 04 20:32:51.009852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-75792be6-50b0-42a3-97e0-161fa718ceea req-0e24616a-a7ec-40de-afba-3600ffaafdcb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109503 Oct 04 20:32:51.011514 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 224/459] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:51.024951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Calling method '.version_select at 0x7f54f6bcdca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:51.030878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:51.032247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:51.033384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:51.067846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:51.069430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:51.070394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:51.092163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:51.093930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:51.095449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:51.146983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71975f95-d028-467e-88a2-2fec543f5a0e tempest-HypervisorAdminTestJSON-823533174 tempest-HypervisorAdminTestJSON-823533174-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.131915 Oct 04 20:32:51.149100 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 225/460] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 20:32:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:51.210628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:51.211845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:51.258367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:51.259388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:51.260275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:51.261652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:51.262592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:51.263490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:52.326580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:52.362297 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-657cbd55-60e9-4352-b376-acef2b52b5bd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 1.210239 Oct 04 20:32:52.363422 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 226/461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:51 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:52.401050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:52.417622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:52.450322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:52.451360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:52.466250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:52.466250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:52.472402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:52.473866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.731820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:32:53.732670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:32:53.733445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:32:53.747849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:32:53.748609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:32:53.835808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:53.836672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:53.837450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.838919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:53.840364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:53.841156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:53.909467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:53.928174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:53.975486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 2 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:32:53.983069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:54.248081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123541) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 20:32:54.293708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:54.318346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2aac8941-4c12-4bf6-a2e0-3e76f536e49e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.953022 Oct 04 20:32:54.318627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:54.334784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:54.336956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 227/462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:52 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:54.361387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:54.363341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:54.378487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:54.379978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:54.381878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:54.383693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:54.385110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:54.387121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:54.657312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:54.669165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:54.736905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=a24e46bc-0ab9-4a3f-9e8b-805008409ed5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:32:54.931040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:54.984651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:54.998333 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed24307d-d059-4917-83b0-cf456c1ee342 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 0.659164 Oct 04 20:32:55.018346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 228/463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:54 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:55.035511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:55.036879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:55.049610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.050978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.052089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.053867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:55.054937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:55.055972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:55.157227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:55.183415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:55.465538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:32:55.486940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:32:55.681728 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c84f014-bf3a-4482-9f3b-9c134d245d8d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.318089 Oct 04 20:32:55.690251 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 236/464] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 5328 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:32:56.363812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:56.383316 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b17c56a-4278-4e5d-aae8-88213047bbee tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 1.362716 Oct 04 20:32:56.384348 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 229/465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:55 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:56.414512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:56.416545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:56.441205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.442567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.443742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.445298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.446399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.447423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.692168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a51d562b-20a2-4115-aaf4-851dc57435e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1523722773", "ram": 512, "vcpus": 1, "disk": 10, "id": 196744814, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:56.814563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:56.840616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed513181-7740-4e4c-a887-f95b7b163e21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 0.448471 Oct 04 20:32:56.855128 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 230/466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:56 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:56.876081 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a51d562b-20a2-4115-aaf4-851dc57435e2 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.167328 Oct 04 20:32:56.876081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 237/467] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:32:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:56.883274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd4e455-7753-46e0-9b94-ab1002013970", "name": "network-vif-plugged", "status": "completed", "tag": "f9a87de1-d2d1-4b2b-93f0-ac528e465913"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:56.904429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.905732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.906884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.909546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:56.925544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:56.930974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Searching by: {'deleted': False, 'project_id': '3d7a2afde38148faab4850e9d2f191bb'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:32:56.939510 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] Creating event network-vif-plugged:f9a87de1-d2d1-4b2b-93f0-ac528e465913 for instance 0fd4e455-7753-46e0-9b94-ab1002013970 on n-h2-851029-13 Oct 04 20:32:56.950038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-394bbabb-5dc2-45f5-8852-e16dd3cd8ceb req-2c383a5d-a167-4c3e-9c53-cf6ead3e2a20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092067 Oct 04 20:32:56.954600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 231/468] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:32:56.977329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.981015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.982398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:56.982584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:56.984180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:56.984898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:56.986117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:56.987601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.009689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.014152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.015362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.018187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.020469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:57.021398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:57.390028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:32:57.689020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6e94c9b-0e14-49d0-92aa-385717cc0e17 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.814780 Oct 04 20:32:57.689735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 238/469] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:32:56 2022] GET /compute/v2.1/servers => generated 1002 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:57.904662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:57.940582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40d8de29-34ea-402f-8285-a9d10595ee05 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 0.980203 Oct 04 20:32:57.949679 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 232/470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:56 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:57.974475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:57.976132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:57.993148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:57.994054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:58.005650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:58.007844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:58.009122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:58.010194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:58.442967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6704ae7d-e0d6-4e84-ab94-9e10d3e15572 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:58.462155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6704ae7d-e0d6-4e84-ab94-9e10d3e15572 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] HTTP exception thrown: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6704ae7d-e0d6-4e84-ab94-9e10d3e15572 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Request method failure captured: Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJh0-X5QO84u5W9YJc6yDocmNAJaRZjOsVx80YLlha0sh4KPsATT_bRGPZlW6Nx7zyjMOJ7jvID9bi5B9LWZ8y3wpFCmHz7ulQtYXrZsWkASq0i-xDQi0oIH_WlW29kpUICIJJ_jqWkvAEqstjJCH_ESBtiZ7nJbeSdpfTpSSpWmd6A Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:32:58.465903 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f004371e038e44b5b6010fccf2433eb0 Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:32:58.468121 n-d-851029-13 devstack@n-api.service[123541]: exception: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'flavor_id': '196744814', 'id': 'hw:cpu_thread_policy'} Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:58.469296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6704ae7d-e0d6-4e84-ab94-9e10d3e15572 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Returning 404 to user: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6704ae7d-e0d6-4e84-ab94-9e10d3e15572 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] 10.222.0.36 "GET /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.777029 Oct 04 20:32:58.471688 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 239/471] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:32:57 2022] GET /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 780 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:58.484564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e72d0a0e-2751-40a0-a2dd-bbe0505ea11f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:58.485852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e72d0a0e-2751-40a0-a2dd-bbe0505ea11f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:58.684572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e72d0a0e-2751-40a0-a2dd-bbe0505ea11f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:58.709352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e72d0a0e-2751-40a0-a2dd-bbe0505ea11f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1218 microversion: 2.1 time: 0.236930 Oct 04 20:32:58.711845 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 240/472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:58 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:58.762113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:58.764017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:58.793555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:58.794899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:58.797145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:58.799140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:58.800245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:58.803178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:58.907165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:58.942331 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4bf3cd38-d765-4a76-9604-6266313bf1a2 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1319 microversion: 2.1 time: 0.990062 Oct 04 20:32:58.943823 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 233/473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:57 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1319 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:32:58.955413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5fb97a2-ff02-4d78-be1b-67b418f1e026 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:32:58.968795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5fb97a2-ff02-4d78-be1b-67b418f1e026 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f004371e038e44b5b6010fccf2433eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36b5dd88054684be32cedf11dc98c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5fb97a2-ff02-4d78-be1b-67b418f1e026 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Request method failure captured: Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/flavors/196744814/os-extra_specs HTTP/1.1 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 66 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJh0-X5QO84u5W9YJc6yDocmNAJaRZjOsVx80YLlha0sh4KPsATT_bRGPZlW6Nx7zyjMOJ7jvID9bi5B9LWZ8y3wpFCmHz7ulQtYXrZsWkASq0i-xDQi0oIH_WlW29kpUICIJJ_jqWkvAEqstjJCH_ESBtiZ7nJbeSdpfTpSSpWmd6A Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:32:58.976195 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f004371e038e44b5b6010fccf2433eb0 Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 20:32:58.978508 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'flavor_id': '196744814', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:32:58.979777 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:32:58.982239 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:32:58.991464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5fb97a2-ff02-4d78-be1b-67b418f1e026 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:32:58.992146 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5fb97a2-ff02-4d78-be1b-67b418f1e026 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] 10.222.0.36 "POST /compute/v2.1/flavors/196744814/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.044334 Oct 04 20:32:58.994046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 234/474] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:32:58 2022] POST /compute/v2.1/flavors/196744814/os-extra_specs => generated 124 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:32:59.005931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:32:59.008094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:32:59.025529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:59.027250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:59.028562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:59.030034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:59.031112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:59.032015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.092390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:00.123769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58aa6183-ec94-4372-a476-cb3cf31e0108 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.409641 Oct 04 20:33:00.139251 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 241/475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:58 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:00.168390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-877a4679-3936-415f-a115-dbebc00dfb6b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:00.279419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:00.294588 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04426684-5fc7-4ea4-be28-46190b7d7999 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.297133 Oct 04 20:33:00.296565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 235/476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:32:58 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:00.305732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:00.307577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:00.320033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.321522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.322834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.330941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.330941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.330941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.435418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-877a4679-3936-415f-a115-dbebc00dfb6b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/196744814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.284986 Oct 04 20:33:00.440828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 242/477] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:00 2022] POST /compute/v2.1/flavors/196744814/os-extra_specs => generated 66 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:00.460357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:00.461936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:00.477256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.478434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.479713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.481883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.483181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.484682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.529410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:00.587651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ab0d3c4-7a48-460c-896a-8bcd018cdcb6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1222 microversion: 2.1 time: 0.288779 Oct 04 20:33:00.598815 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 236/478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:00 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:00.601956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-plugged", "status": "completed", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:00.623515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.624752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.625772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.669219 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] Creating event network-vif-plugged:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:33:00.681271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-253e9ce3-fdd3-4b29-a72d-65932d649866 req-26bb2496-bc0f-4e9e-bd20-9a3b57d63fee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087908 Oct 04 20:33:00.683558 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 237/479] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:00.723657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97e0fb74-2f89-4cbc-94da-bd2d2ff3e551 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:00.729216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97e0fb74-2f89-4cbc-94da-bd2d2ff3e551 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f004371e038e44b5b6010fccf2433eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36b5dd88054684be32cedf11dc98c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97e0fb74-2f89-4cbc-94da-bd2d2ff3e551 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Request method failure captured: Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJh0-X5QO84u5W9YJc6yDocmNAJaRZjOsVx80YLlha0sh4KPsATT_bRGPZlW6Nx7zyjMOJ7jvID9bi5B9LWZ8y3wpFCmHz7ulQtYXrZsWkASq0i-xDQi0oIH_WlW29kpUICIJJ_jqWkvAEqstjJCH_ESBtiZ7nJbeSdpfTpSSpWmd6A Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:33:00.732512 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f004371e038e44b5b6010fccf2433eb0 Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:33:00.734811 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'flavor_id': '196744814', 'id': 'hw:numa_nodes'} Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:00.735976 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:00.738166 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:00.746988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97e0fb74-2f89-4cbc-94da-bd2d2ff3e551 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:00.748535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97e0fb74-2f89-4cbc-94da-bd2d2ff3e551 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] 10.222.0.36 "DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.061342 Oct 04 20:33:00.749486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 238/480] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:00 2022] DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes => generated 124 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:00.796746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01c33613-879b-437d-8e07-e42fc12ca5a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:00.873816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-01c33613-879b-437d-8e07-e42fc12ca5a1 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/196744814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106484 Oct 04 20:33:00.885986 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 239/481] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:00 2022] POST /compute/v2.1/flavors/196744814/os-extra_specs => generated 66 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:00.901764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:00.903848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:00.926140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.927332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.927926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:00.934434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:00.936408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:00.937346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.047643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:33:01.110322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:01.527658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:01.550651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bca36af-110d-4551-aa9a-b386edda6289 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1469 microversion: 2.1 time: 1.107093 Oct 04 20:33:01.559403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 243/482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:00 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1469 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:01.595208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8553860-4633-4398-a3cc-7fab60347691 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:01.607399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8553860-4633-4398-a3cc-7fab60347691 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f004371e038e44b5b6010fccf2433eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36b5dd88054684be32cedf11dc98c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8553860-4633-4398-a3cc-7fab60347691 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Request method failure captured: Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 22 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJh0-X5QO84u5W9YJc6yDocmNAJaRZjOsVx80YLlha0sh4KPsATT_bRGPZlW6Nx7zyjMOJ7jvID9bi5B9LWZ8y3wpFCmHz7ulQtYXrZsWkASq0i-xDQi0oIH_WlW29kpUICIJJ_jqWkvAEqstjJCH_ESBtiZ7nJbeSdpfTpSSpWmd6A Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:33:01.613534 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5d36b5dd88054684be32cedf11dc98c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5d36b5dd88054684be32cedf11dc98c7 Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f004371e038e44b5b6010fccf2433eb0 Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: {"hw:numa_nodes": "1"} Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:33:01.616094 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'flavor_id': '196744814', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:01.617544 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:01.624334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:01.626545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8553860-4633-4398-a3cc-7fab60347691 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:01.626545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8553860-4633-4398-a3cc-7fab60347691 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242 tempest-FlavorsExtraSpecsNegativeTestJSON-1045726242-project] 10.222.0.36 "PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.056208 Oct 04 20:33:01.629254 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 244/483] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:01 2022] PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes => generated 124 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:01.645628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:01.646948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:01.671166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.674455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.685245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.687182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.689586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.690939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.774983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9fff48f-75c2-4d3c-b63c-7717e0db68a5 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 204 len: 0 microversion: 2.1 time: 0.885885 Oct 04 20:33:01.780184 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 240/484] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:33:00 2022] DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:33:01.796097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:01.805881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:01.831771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.833616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.835359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:01.837012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:01.838407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:01.840899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:02.695780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:02.711088 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5a56801-04a5-4bf0-952b-9e88f5e5ee56 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.079341 Oct 04 20:33:02.727334 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 245/485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:01 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:03.215155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:03.243921 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af857428-1785-483c-9835-6017ea68cc1c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1316 microversion: 2.1 time: 1.460163 Oct 04 20:33:03.274640 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 241/486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:01 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1316 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:03.297282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:03.298473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:03.306308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-228988618", "block_migration": true, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:03.312072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:03.318934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:03.324881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.325230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.325771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.327008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.327250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.328479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.329346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.330313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.331007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.333089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:03.336071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:03.337501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:03.536610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:03.644448 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88486520-d498-4a81-9489-6a41b775446e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1270 microversion: 2.1 time: 0.354400 Oct 04 20:33:03.645731 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 242/487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:03 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1270 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:03.687107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lazy-loading 'flavor' on Instance uuid 0fd4e455-7753-46e0-9b94-ab1002013970 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:33:03.707902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e98f0f8c-4e91-4010-a812-6e54084f7249 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:03.737304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e98f0f8c-4e91-4010-a812-6e54084f7249 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] HTTP exception thrown: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e98f0f8c-4e91-4010-a812-6e54084f7249 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Request method failure captured: Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJh2D9qS9z5_Zxky9N8y5uiXvgfPxWvKMzllLtjMshZ9CAs2ztyrLSoyhFxfMnIWDp2A91OwEjvbHl9298K-K_tcFn3HHMHi892wjiFFbps6hWCB-BVSc3E-aETLuYPZgzgXmmAqu6FNNxVZ5dwvgNMAga2vM-5MYTedzBwp6DaGBx8 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:33:03.740577 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f5446879e484494690d885bc4a1f1d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: aff31f2339034651a377dff85702fbfa Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:33:03.743338 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'flavor_id': '196744814', 'id': 'hw:cpu_thread_policy'} Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:03.744748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:03.748589 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.757301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e98f0f8c-4e91-4010-a812-6e54084f7249 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Returning 404 to user: Flavor 196744814 has no extra specs with key hw:cpu_thread_policy. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:03.762437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e98f0f8c-4e91-4010-a812-6e54084f7249 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.103522 Oct 04 20:33:03.770561 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 243/488] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 20:33:03 2022] DELETE /compute/v2.1/flavors/196744814/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:03.795362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1708139835", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "1527132680", "adminPass": "***", "networks": [{"uuid": "4a69d721-5ecf-4825-99a2-8ce83fba70b8"}], "security_groups": [{"name": "tempest-securitygroup--1433479041"}], "key_name": "tempest-keypair-1871138313", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:03.880058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Going to try to live migrate instance to tempest-host-228988618 {{(pid=123541) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:33:03.910338 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] HTTP exception thrown: Compute host tempest-host-228988618 could not be found. Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Request method failure captured: Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970/action HTTP/1.1 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 106 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhTZKkVtSUqy3g7OLXUUR_Cxi6-YjWiGQ_QdCoiF1zKKjOMJ6J29g3ReFls3toH5gTBYarBLg1k8-UNXoRHoRI2mtYqNgxgpHZHWU6afjCgWBX2SD8aP0_2_uMURAv4Daj2JzTLkWun_n3865sblj9OSdrcfSnvnZtCQ1n5dkYDXIM Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5ebb44afc499403faca2ef66149434c9 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:33:03.923943 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ebb44afc499403faca2ef66149434c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5ebb44afc499403faca2ef66149434c9 Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveMigrationNegativeTest-1654719181-project-admin Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a7059c856e8c4c38a199ed099dc18c02 Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveMigrationNegativeTest-1654719181-project-admin Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: {"os-migrateLive": {"host": "tempest-host-228988618", "block_migration": true, "disk_over_commit": false}} Oct 04 20:33:03.926899 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: exception: Compute host tempest-host-228988618 could not be found. Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '0fd4e455-7753-46e0-9b94-ab1002013970', 'body': {'os-migrateLive': {'host': 'tempest-host-228988618', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:33:03.929137 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-228988618 could not be found. Oct 04 20:33:03.934526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-228988618 could not be found. Oct 04 20:33:03.943521 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-228988618 could not be found. Oct 04 20:33:03.946136 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:03.949717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Returning 400 to user: Compute host tempest-host-228988618 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:03.953436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28cdc7be-2c0a-4b6c-96ea-ad5fcbe6331a tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970/action" status: 400 len: 99 microversion: 2.1 time: 1.223840 Oct 04 20:33:03.965976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 246/489] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 4 20:33:02 2022] POST /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970/action => generated 99 bytes in 1238 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:03.975578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:03.979929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:04.021112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:04.022056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:04.027693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:04.029225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:04.030124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:04.031023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:05.299920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] validate_networks() for [('4a69d721-5ecf-4825-99a2-8ce83fba70b8', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:05.558292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:05.580486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65047930-421c-4c58-8d9e-5d29d1fb28a7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1313 microversion: 2.1 time: 1.611729 Oct 04 20:33:05.584805 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 247/490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:03 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1313 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:05.596502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f60f1c3e-bf38-487f-90ec-7f81345b6c56 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:05.605781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f60f1c3e-bf38-487f-90ec-7f81345b6c56 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f60f1c3e-bf38-487f-90ec-7f81345b6c56 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Request method failure captured: Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 27 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJh2D9qS9z5_Zxky9N8y5uiXvgfPxWvKMzllLtjMshZ9CAs2ztyrLSoyhFxfMnIWDp2A91OwEjvbHl9298K-K_tcFn3HHMHi892wjiFFbps6hWCB-BVSc3E-aETLuYPZgzgXmmAqu6FNNxVZ5dwvgNMAga2vM-5MYTedzBwp6DaGBx8 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:33:05.613249 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f5446879e484494690d885bc4a1f1d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: aff31f2339034651a377dff85702fbfa Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: {"hw:cpu_policy": "shared"} Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:33:05.615989 n-d-851029-13 devstack@n-api.service[123541]: exception: Request body and URI mismatch Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'flavor_id': '196744814', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:05.618377 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f60f1c3e-bf38-487f-90ec-7f81345b6c56 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f60f1c3e-bf38-487f-90ec-7f81345b6c56 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025731 Oct 04 20:33:05.625556 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 248/491] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:05 2022] PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:05.636908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:05.638261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:05.652779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:05.660380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:05.660380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:05.660380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:05.660380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:05.661046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:07.082188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:07.113940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:07.133548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f1c12a22-de5a-4a25-821d-78bb7537f291 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1469 microversion: 2.1 time: 1.505567 Oct 04 20:33:07.143534 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 249/492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:05 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1469 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:07.172240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "name": "network-vif-plugged", "status": "completed", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:07.220033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:07.224108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:07.233358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:07.285329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] Creating event network-vif-plugged:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h1-851029-13 Oct 04 20:33:07.310651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8fac9692-7f34-40ee-8cb3-5f9a6a8011f1 req-e0abb49a-c597-4085-a71e-96d218ce2688 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161105 Oct 04 20:33:07.312920 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 250/493] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:07.362773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:07.369122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:07.410968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:07.412903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:07.423578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:07.430085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:07.431733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:07.440426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:08.694026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=32 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:09.206016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:09.210217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:09.226026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:09.230028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:09.230813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:09.241211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:09.332319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a48058c8-77d5-4c80-80d2-88d425fba385 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1466 microversion: 2.1 time: 2.010916 Oct 04 20:33:09.334581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 251/494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:07 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1466 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:09.361660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:09.371863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:09.374249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:09.379905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:09.397662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:09.404366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:09.405348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:09.412414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:09.462281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:09.467573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:09.471154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:09.511566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:09.522835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:09.529366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:09.616366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:09.654775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Getting quotas for user 20b601a437764fb8890a2ca25d72367a and project 2e57e35d48e5408d8a74da8cf5846d19. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:09.722780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:09.738293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:09.763615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:10.224905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b670a244-341b-4696-9b3f-f48cad75d29e tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.451689 Oct 04 20:33:10.244076 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 244/495] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 6472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:10.269737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22475f32-9e56-4926-925a-e3a6b19c966b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22475f32-9e56-4926-925a-e3a6b19c966b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Request method failure captured: Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 49 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJh2D9qS9z5_Zxky9N8y5uiXvgfPxWvKMzllLtjMshZ9CAs2ztyrLSoyhFxfMnIWDp2A91OwEjvbHl9298K-K_tcFn3HHMHi892wjiFFbps6hWCB-BVSc3E-aETLuYPZgzgXmmAqu6FNNxVZ5dwvgNMAga2vM-5MYTedzBwp6DaGBx8 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:33:10.291894 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f5446879e484494690d885bc4a1f1d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f5446879e484494690d885bc4a1f1d30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: f5446879e484494690d885bc4a1f1d30 Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: aff31f2339034651a377dff85702fbfa Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 20:33:10.294572 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'flavor_id': '196744814', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 20:33:10.296120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.298562 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:33:10.307446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22475f32-9e56-4926-925a-e3a6b19c966b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:10.311186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22475f32-9e56-4926-925a-e3a6b19c966b tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.058571 Oct 04 20:33:10.314070 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 245/496] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:10 2022] PUT /compute/v2.1/flavors/196744814/os-extra_specs/hw:numa_nodes => generated 117 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:33:10.346896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:10.351471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:10.399555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:10.401128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:10.408274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:10.414783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:10.416956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:10.420444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:11.824276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:11.855529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ff39df9-7a63-4f41-b902-244b58b9c8fb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1462 microversion: 2.1 time: 1.534703 Oct 04 20:33:11.875148 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 246/497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:10 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1462 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:11.908542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-975965664", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:11.933755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:11.961652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12fb3a26-7537-4aaa-bf82-4fa8b794c92e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 2.625132 Oct 04 20:33:11.968766 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 252/498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:09 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:11.977938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-125234712", "metadata": {"image_type": "test"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:11.984542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:12.017115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:12.018553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:12.019798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:12.025733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:12.033004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:12.034652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:12.097930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:12.219619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Getting quotas for project 239f887a70154739880d4022f58e210b. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:12.237330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Getting quotas for user db3e20ac90ba4e129c24328a2f0a7d40 and project 239f887a70154739880d4022f58e210b. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:13.590477 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-760c75b8-df0e-4be4-ad31-d15352784c3a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "POST /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204/action" status: 202 len: 0 microversion: 2.1 time: 1.608463 Oct 04 20:33:13.592350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 253/499] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:33:11 2022] POST /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:33:13.638964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:13.647082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:13.694459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:13.695387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:13.696178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:13.698118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:13.699013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:13.699772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:14.069979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:14.097390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:14.098321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:14.099276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:14.100013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:14.100761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:14.177214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:14.178911 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7ff4088-96d0-4610-a7b2-40cf5ee3b6d7 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1261 microversion: 2.1 time: 0.584044 Oct 04 20:33:14.183339 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 254/500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:13 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1261 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:14.202715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:14.215356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:14.218538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:14.226120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e1a62f0-53d7-451f-8a71-bb6958544aee tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:14.231811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:14.234376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:14.309184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Getting quotas for project 7a53c348cf974050b9ca2401aea6510b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:14.327910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Getting quotas for user 80239f15a949474da642543021a701ef and project 7a53c348cf974050b9ca2401aea6510b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:14.387165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:14.399653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:14.480096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e1a62f0-53d7-451f-8a71-bb6958544aee tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/196744814" status: 202 len: 0 microversion: 2.1 time: 0.294991 Oct 04 20:33:14.481328 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 255/501] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:14 2022] DELETE /compute/v2.1/flavors/196744814 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:14.734595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2189bf52-0bda-4c6f-a6fa-2930ad6861cb tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841814 Oct 04 20:33:14.739493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 247/502] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:14.763569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:14.770649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:14.785688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:14.786991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:14.801730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:14.802758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-802416186", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "d4133c60-0102-48e4-be66-6bf5189f9cc1"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:14.821801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:14.824183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:14.826521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:15.060976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] validate_networks() for [('d4133c60-0102-48e4-be66-6bf5189f9cc1', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:15.295456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:15.322927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:33:15.371455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:15.372165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:15.376863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:15.385594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:15.399036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:16.210348 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-882c6a7d-6a23-485c-a8c5-e600aa27310f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2/action" status: 202 len: 0 microversion: 2.1 time: 1.468068 Oct 04 20:33:16.212328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 248/503] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:33:14 2022] POST /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2/action => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:16.224473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:16.228663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:16.240728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:16.242033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:16.243786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:16.247636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:16.248994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:16.250190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.114979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:18.143820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e13efa1-3eee-48ed-b6d7-ddac7f4a8190 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 1.927931 Oct 04 20:33:18.158720 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 249/504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:16 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:18.169054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e46bc-0ab9-4a3f-9e8b-805008409ed5", "tag": "201f8485-a296-4877-bf93-e21850f4706f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:18.222912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.224724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.231279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.317692 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] Creating event network-changed:201f8485-a296-4877-bf93-e21850f4706f for instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 on n-h2-851029-13 Oct 04 20:33:18.340305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b4c19a5b-ec1a-4865-9b5d-87d9981c0531 req-34e0dab2-51d5-440a-a97e-5aa363909713 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192284 Oct 04 20:33:18.342619 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 250/505] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:18.371371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af69c015-ef2e-4439-bcd3-6b1326e2c97f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6a62ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.591062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af69c015-ef2e-4439-bcd3-6b1326e2c97f tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.240652 Oct 04 20:33:18.595099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 251/506] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:18 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:18.623842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d036b8c3-9044-41dc-94b5-cd1e70f59f4e tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.727405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d036b8c3-9044-41dc-94b5-cd1e70f59f4e tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280 tempest-FlavorsExtraSpecsNegativeTestJSON-1701744280-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.126655 Oct 04 20:33:18.729109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 252/507] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:18.789839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:18.798039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:18.835122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.836418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.838290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:18.840038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:18.842929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:18.845551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:19.640099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:19.640933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:19.642296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:19.644001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:19.647916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:19.720875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:19.723969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:19.737722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:19.742592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:19.752441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:19.756226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:19.860696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:19.897574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for user 44a42dd2dd73439bbe445de3b2eb9744 and project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:19.986513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:20.006604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:20.035385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:20.070165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd5aebb4-01b2-474e-b3c2-6010b33cfae5 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1270 microversion: 2.1 time: 1.338361 Oct 04 20:33:20.081312 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 253/508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:18 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1270 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:20.114331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:20.121000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:20.166571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.171036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.173373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.181854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.182955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.185513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.215013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:20.408430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-42d4d910-be86-41ea-bae4-0303add6b6e4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.922768 Oct 04 20:33:20.427553 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 256/509] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 5945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:20.444622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea45c7a-5b53-4e36-ab04-bc5feeb81a28", "tag": "93a11930-432b-43ae-bcc5-258edeb0d8c4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:20.504684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.506184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.511148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.550798 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] Creating event network-changed:93a11930-432b-43ae-bcc5-258edeb0d8c4 for instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 on n-h2-851029-13 Oct 04 20:33:20.574611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-be07b995-3904-4645-820a-a49d16dd5473 req-5f5d67e2-db48-4759-a606-33cb45aa2dd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144553 Oct 04 20:33:20.595838 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 257/510] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:20.616551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:20.618193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:20.643534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.654168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.662810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.664694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.666152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.670390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.730259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:20.794909 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2d83602-2b01-4541-82c7-2f5e56d17a01 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1335 microversion: 2.1 time: 0.700648 Oct 04 20:33:20.808074 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 254/511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:20 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1335 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:20.822792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:20.829845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:20.878550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.891854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.892816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:20.896459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:20.897528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:20.902839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:22.194143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:22.224198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-332be2c4-c16f-44cf-bac6-80d6c2d450b3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1471 microversion: 2.1 time: 1.623666 Oct 04 20:33:22.228718 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 258/512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:20 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1471 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:22.254833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:22.257292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87c9decf-7de2-4f2a-97b1-f024240bca73 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6826820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.289816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9edfc17a-8f11-4f6c-8591-6cf169d7c2ab tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 1.484427 Oct 04 20:33:22.322359 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 255/513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:20 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:22.370741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-726b6218-2119-434c-b4dc-f3d75012d087 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.373381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-726b6218-2119-434c-b4dc-f3d75012d087 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:22.460940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87c9decf-7de2-4f2a-97b1-f024240bca73 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.227793 Oct 04 20:33:22.466186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 259/514] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:22.480317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6764938b-3e9a-4a3e-869c-11ed92451b80", "name": "network-vif-deleted", "tag": "f19fd326-6c0f-48df-b71d-22d1c13f7a5c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:22.524458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:22.530733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:22.531539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:22.594794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] Creating event network-vif-deleted:f19fd326-6c0f-48df-b71d-22d1c13f7a5c for instance 6764938b-3e9a-4a3e-869c-11ed92451b80 on n-h1-851029-13 Oct 04 20:33:22.616689 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2dde56f5-e274-49bc-b40f-f65662ad17c8 req-d9c8f1d5-6e94-4a66-a7f0-00a4abec3fa7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142321 Oct 04 20:33:22.621007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 260/515] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:22.642109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:22.644113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:22.675086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:22.682145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:22.685979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:22.687532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:22.688393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:22.693956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:22.927267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-726b6218-2119-434c-b4dc-f3d75012d087 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:22.962192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-726b6218-2119-434c-b4dc-f3d75012d087 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1210 microversion: 2.1 time: 0.637701 Oct 04 20:33:22.985658 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 256/516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1210 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:23.016112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:23.017449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:23.047422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.049193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.053549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:23.055468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.059809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.061038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:23.441047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:23.500337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3de656d5-bd8b-40de-8e87-4cbe9afe0ac8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1323 microversion: 2.1 time: 0.513373 Oct 04 20:33:23.501209 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 257/517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:23.521688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:23.543078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:23.546467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:23.596896 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e08e0c25-636c-464d-8057-f51e3e8f7ab9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1276 microversion: 2.1 time: 0.967488 Oct 04 20:33:23.598203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 261/518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:22 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1276 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:23.614727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.618711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.620808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:23.625785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.628934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:23.630070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:23.632517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.635458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:23.668149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.669515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.670357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:23.671800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:23.675399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:23.681174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:24.267805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.050919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:25.091578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f71a4f65-fa5b-4153-8c53-134caa77a434 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1471 microversion: 2.1 time: 1.588356 Oct 04 20:33:25.103471 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 258/519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:23 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1471 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:25.139001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e928f263-0934-45f5-8b63-330687143211 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6f7c310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:25.268897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:25.298757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e39bedb6-cff6-464e-8821-6214651a4d14 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 1.692600 Oct 04 20:33:25.321120 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 262/520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:23 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:25.373565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:25.389555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:25.418269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:25.423895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:25.424604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e928f263-0934-45f5-8b63-330687143211 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.311350 Oct 04 20:33:25.425165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:25.430318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 259/521] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:25 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:25.439779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:25.441084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:25.441651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:25.464398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:25.467330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:25.501270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:25.518243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:25.520924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:25.523237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:25.524611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:25.529258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:26.840210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:26.888587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abf1f4b0-3fe3-4547-82d7-44a40a1049ca tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1323 microversion: 2.1 time: 1.447363 Oct 04 20:33:26.891976 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 260/522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:25 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1323 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:26.918625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:26.920424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:26.949596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:26.954610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:26.955742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:26.960510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:26.961578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:26.962833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:27.110854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:27.162515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ede08f34-a9f5-4dec-9865-16da53225429 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1206 microversion: 2.1 time: 1.758545 Oct 04 20:33:27.162515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 263/523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:25 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1206 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:27.195042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:27.199813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:27.222528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:27.229500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:27.231777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:27.240380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:27.241744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:27.242901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.553533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:28.637867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c1c983e-7ef6-4577-9bc1-e32cce409a9e tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 1.743715 Oct 04 20:33:28.644892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 261/524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:26 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:28.682159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:28.691234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:28.738183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:28.738183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:28.738856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.742112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:28.750745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:28.752285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.212606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:29.250946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06217506-108c-424d-85a7-6b96f83e24e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1471 microversion: 2.1 time: 2.095921 Oct 04 20:33:29.252162 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 264/525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:27 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1471 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:29.272703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5e36241-52f8-4a94-a6a0-89c39696d144 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f69d1310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.431572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:29.441886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:29.462982 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5e36241-52f8-4a94-a6a0-89c39696d144 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.207839 Oct 04 20:33:29.477112 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 265/526] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:29 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:29.490271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4e32749-59b0-4198-aaab-d58d42653d84 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 0.825301 Oct 04 20:33:29.494383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 262/527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:28 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:29.496698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-plugged", "status": "completed", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.510184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.547091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:29.567328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.571606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.582082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.625164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.627285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.627285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.628414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.641222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.646405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.658388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] Creating event network-vif-plugged:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:33:29.702173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-636b4394-76f9-4715-92aa-bff241ec2969 req-cfb10a79-ab64-4b2f-9b89-d20055b0b361 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207861 Oct 04 20:33:29.718226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 266/528] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:29.728584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.736271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:29.784234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.791322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.792504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.796523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.801601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.806655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.808304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:29.961844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:30.313769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:30.357627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0202cfc7-67b1-4ea4-9e85-6c6bf1f23387 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1268 microversion: 2.1 time: 0.637082 Oct 04 20:33:30.362288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 267/529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:29 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1268 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:30.387201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:30.392941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:30.423435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:30.428241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:30.429926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:30.437298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:30.438648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:30.441932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:30.473000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:30.560821 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53329eed-9fa5-4a03-9302-ea8925618633 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.061796 Oct 04 20:33:30.572131 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 263/530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:29 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:30.644073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:30.646814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:30.764292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:30.772348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:30.779666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:30.806752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:30.814414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:30.819307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.399100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:31.433200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8980dfdf-54d7-46bd-a80c-bdbc01611a93 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 1.068336 Oct 04 20:33:31.439563 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 268/531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:30 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.459176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba36c76c-3e20-402b-8f0f-c26d99dd267b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f685f790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.601671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:31.630754 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4c66a9c-2b1c-4d4a-85ed-4dfbac990484 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1471 microversion: 2.1 time: 1.041317 Oct 04 20:33:31.632673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 264/532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:30 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1471 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.642725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.644387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:31.650187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba36c76c-3e20-402b-8f0f-c26d99dd267b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.208654 Oct 04 20:33:31.657270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.659477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.660627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.662563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.663743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.672762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.673616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 269/533] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.709602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.711873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:31.740149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.749544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.751252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.755583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.755583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.755583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.410530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:32.415931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:32.444296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66c4980d-8ea9-4803-b3d0-3ef1423ae4f4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 0.803481 Oct 04 20:33:32.445886 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 265/534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:32.451552 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3cefbef0-7e82-42c4-b628-8a154107e354 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1268 microversion: 2.1 time: 0.775505 Oct 04 20:33:32.469080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.471362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:32.479633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 270/535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1268 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:32.494640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.500897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.507102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.508934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.511246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.516102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.519068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24e46bc-0ab9-4a3f-9e8b-805008409ed5", "name": "network-vif-plugged", "status": "completed", "tag": "201f8485-a296-4877-bf93-e21850f4706f"}, {"server_uuid": "1ea45c7a-5b53-4e36-ab04-bc5feeb81a28", "name": "network-vif-plugged", "status": "completed", "tag": "93a11930-432b-43ae-bcc5-258edeb0d8c4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:32.586842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.587987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.591161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.660015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Creating event network-vif-plugged:201f8485-a296-4877-bf93-e21850f4706f for instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 on n-h2-851029-13 Oct 04 20:33:32.661765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] Creating event network-vif-plugged:93a11930-432b-43ae-bcc5-258edeb0d8c4 for instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 on n-h2-851029-13 Oct 04 20:33:32.679784 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-915a403f-cd83-4b83-b6b2-729c48eec7eb req-cd9039d0-cde3-4fc2-91d5-278789184a19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.197676 Oct 04 20:33:32.720807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 271/536] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:32.770988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.786027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:32.830460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.856817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.864204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.874959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:32.882397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:32.885510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:32.943315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:33.658134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:33.681998 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59935d1a-dd48-4618-b61c-79b562b194c8 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.227451 Oct 04 20:33:33.697383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 266/537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.709461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.717908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:33.745152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.756246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.760719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:33.762605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.763666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.771828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:34.116488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:34.156138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abe5349b-8480-482e-a476-34800e72ab26 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 1.431831 Oct 04 20:33:34.173123 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 272/538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.198777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85737df0-ffd0-413d-b09e-a7d4d657587e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6794dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.408310 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85737df0-ffd0-413d-b09e-a7d4d657587e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.214696 Oct 04 20:33:34.422723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 273/539] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.434471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.466559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:34.516817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:34.530040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:34.535571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:34.537330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:34.541400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:34.582186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.059536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:35.088925 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ba41de8-a2e6-4b4b-88b2-367c458e94e1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1476 microversion: 2.1 time: 1.393718 Oct 04 20:33:35.090763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 267/540] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1476 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:35.110829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.124122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:35.138924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:35.143826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:35.146550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.150719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:35.152040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:35.169530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.873710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:35.913286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79bb7e0e-30f9-489b-a67e-a12f674f834c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1318 microversion: 2.1 time: 1.501397 Oct 04 20:33:35.943421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 274/541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1318 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:35.967762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93551c99-9a83-47bd-acc7-bbd8e88081aa", "tag": "6d226e99-d5aa-4da8-8417-630a3114fd14"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:35.988417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:35.989736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:35.990842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.038711 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] Creating event network-changed:6d226e99-d5aa-4da8-8417-630a3114fd14 for instance 93551c99-9a83-47bd-acc7-bbd8e88081aa on n-h1-851029-13 Oct 04 20:33:36.067524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-931bcfb8-a66a-45e0-8796-ad3e09e54638 req-42be6e64-2084-4a71-b97e-5644cec5aa06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121220 Oct 04 20:33:36.070816 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 275/542] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:36.090746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.098943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:36.135048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.141130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.143064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.145542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.154315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.155695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.282414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:36.858735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:36.913255 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3527c374-4f8d-4674-b838-8a3b16b069f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.820356 Oct 04 20:33:36.914291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 268/543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:35 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:36.971940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.973122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:36.997356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:37.003263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.008051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.011840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:37.016303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.017563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.019744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:37.241563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:37.290888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54d8551c-4fe3-40f3-a2f0-37266ded2466 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.214140 Oct 04 20:33:37.303684 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 276/544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:36 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:37.323657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54ad39c9-ff7b-430e-9c60-f0ec5eae82b3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67945e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:37.509017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54ad39c9-ff7b-430e-9c60-f0ec5eae82b3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.202289 Oct 04 20:33:37.519290 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 277/545] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:37 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:37.537911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:37.553522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:37.573211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.574596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.574596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:37.599146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:37.600730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:37.601774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.715396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:38.751300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:38.752288 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6b4da49-1a5e-4832-ada2-e246ece7752f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1476 microversion: 2.1 time: 1.231331 Oct 04 20:33:38.753139 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 278/546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:37 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1476 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:38.760769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dd9f54-f84d-472a-b1e3-35cc089ba3ea", "tag": "c71fbfe3-34b0-477b-a59c-d0a836252426"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:38.781543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.790749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.793623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.799217 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d098a35b-bb56-473b-98a7-62e3178c0fe1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 1.834231 Oct 04 20:33:38.800594 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 269/547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:36 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:38.824395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:38.825600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:38.849059 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] Creating event network-changed:c71fbfe3-34b0-477b-a59c-d0a836252426 for instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea on n-h1-851029-13 Oct 04 20:33:38.918483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.918483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.918483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.918483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.919813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-33a0f2fe-2277-4bf2-8852-6e11262833a7 req-65b7f778-65b3-472d-86b3-540428c76646 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104628 Oct 04 20:33:38.919985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.919985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.920264 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 279/548] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:38.920264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:38.920264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:38.920264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.920264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.921000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.921000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.921000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.921000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.391083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:39.408321 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b0a9ecf-2da9-4aff-881b-35a3da0a517d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 0.539517 Oct 04 20:33:39.424453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 280/549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:38 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.424738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:39.432626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.432626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:39.438793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.439856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.440519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a560bcc-d794-4ee7-8d27-9e01e1b81ee8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1468 microversion: 2.1 time: 0.636628 Oct 04 20:33:39.442724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.444640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.445699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.447610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.452470 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 270/550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:38 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1468 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.469456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66e58a05-35b0-48a8-aea8-f8ed6dfc655d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6a94940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.666818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66e58a05-35b0-48a8-aea8-f8ed6dfc655d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.210008 Oct 04 20:33:39.669621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 271/551] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.681432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.684034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:39.707683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.709377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.710915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.712877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:39.714108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:39.715689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:39.919321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:39.967638 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f4443f0-41df-413b-af37-7f974da946c2 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 0.555112 Oct 04 20:33:39.986418 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 281/552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.989515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f4f61e-3c5d-4f41-8179-571555cc0d2f", "tag": "b2e62de5-f735-4fd1-be70-5969ebc19e55"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:40.038103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:40.039275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:40.040746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:40.063642 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] Creating event network-changed:b2e62de5-f735-4fd1-be70-5969ebc19e55 for instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f on n-h2-851029-13 Oct 04 20:33:40.076154 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cf1ad31f-0cba-4cb4-b108-7544538fb78a req-46c4dc16-5409-4834-a869-1dced3e78694 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104043 Oct 04 20:33:40.092869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 282/553] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:40.122967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:40.125619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:40.163850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:40.166415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:40.166415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:40.167537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:40.180708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:40.190089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.396254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:41.454181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1dfd60af-7295-49ea-b950-d7ee808e1cf1 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 200 len: 1467 microversion: 2.1 time: 1.781947 Oct 04 20:33:41.462849 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 272/554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 1467 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:41.486616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:41.490555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:41.511809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.513733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.515030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.518271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.520042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.521567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.722842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:41.768356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5a2883d-e974-48ff-9a44-9f86ccef877a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1476 microversion: 2.1 time: 1.661942 Oct 04 20:33:41.772606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 283/555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:40 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1476 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:41.811498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:41.816639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:41.844633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.846296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.849775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.855750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.862705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.862705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.675490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:42.709117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19808d17-001b-4581-9742-64a8daec6df0 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 1.239739 Oct 04 20:33:42.711633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 273/556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:41 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:42.731867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9669b72-a4f5-4fbd-b843-2a3b318f5ae4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f694a940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:42.764714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:42.787783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-305a230c-e1c4-46e8-a80b-fa86a531aa00 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.012043 Oct 04 20:33:42.802711 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 284/557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:41 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:42.802711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:42.803181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:42.829084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.841557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.842745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.844892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.846103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.847242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.891868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9669b72-a4f5-4fbd-b843-2a3b318f5ae4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.178360 Oct 04 20:33:42.904859 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 274/558] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:42 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:42.917990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:42.940367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:42.941922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Searching by: {'reservation_id': 'r-48ljaqrx', 'deleted': False, 'project_id': '3d7a2afde38148faab4850e9d2f191bb'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:33:42.962934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.971275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.972680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.974286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.976761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.978381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.225911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:43.265201 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a03ecb56-f028-47d2-bf87-b89a7988a019 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 0.471613 Oct 04 20:33:43.265201 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 285/559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:42 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:43.395685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:33:43.632359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Calling method '.version_select at 0x7f54f6867af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:43.647884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.649933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.651482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.705470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.709819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.721509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.762830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.764409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.773072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.788492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1526d291-6927-4fc7-b5d9-be4038f451d2 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.521731 Oct 04 20:33:43.791018 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 286/560] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:43.820849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:43.820849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:43.823284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.824562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.825649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.827416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.829805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.830944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:43.876019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:43.915467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:43.917425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:43.919221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.417055 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02d5f041-b447-4bd7-9e91-5274006ee7ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-48ljaqrx" status: 200 len: 2928 microversion: 2.1 time: 1.508685 Oct 04 20:33:44.419982 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 275/561] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 4 20:33:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-48ljaqrx => generated 2928 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:44.438455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.441884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:44.448062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:44.468039 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d3845890-0cc7-4a59-a5ae-1997d4268475 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1476 microversion: 2.1 time: 0.674534 Oct 04 20:33:44.469908 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 287/562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1476 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:44.485384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Calling method '.version_select at 0x7f54f68264c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.494615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.500353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.501777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.506212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.510737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.511495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.516383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.517433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.520519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.564885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.566465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.568969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.691199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.692940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.694395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.714054 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e08b560a-7ce6-4e95-8053-8dae45afc56b tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-851029-13/servers" status: 200 len: 592 microversion: 2.1 time: 0.239686 Oct 04 20:33:44.731281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 288/563] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/os-hypervisors/n-h2-851029-13/servers => generated 592 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:44.746162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.747979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:44.762434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.763936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.765125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.767057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.768016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.768817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.064352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:45.091727 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ad8afc3-4108-4205-8beb-d552f6103b70 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 0.669635 Oct 04 20:33:45.124907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 276/564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:45.140727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0e070a8-ff09-42eb-be7c-f8841f7f4dec tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6c15f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.296556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0e070a8-ff09-42eb-be7c-f8841f7f4dec tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.169770 Oct 04 20:33:45.317923 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 277/565] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:45.331366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.332433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:45.365040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.366202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.367088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.368621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.369416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.370141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.449556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:45.475459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d49b0e7-1ee1-491b-b676-4c0981de0db9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 0.739369 Oct 04 20:33:45.478120 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 289/566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:45.484209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.515999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_groups [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Querying cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) for 2 instances {{(pid=123541) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:33:45.518030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.519933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.521327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.692005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4558464b-9a94-423f-a5e6-b2f4473968fb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/27777efb-1e07-421d-84df-00daf501aeaf" status: 200 len: 266 microversion: 2.1 time: 0.211951 Oct 04 20:33:45.699267 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 290/567] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/os-server-groups/27777efb-1e07-421d-84df-00daf501aeaf => generated 266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:45.730392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Calling method '.version_select at 0x7f54f6806ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.734187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.735092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.751594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.802046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.803198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.804237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.835086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.836438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.838039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.851485 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5524e9d6-7177-408e-80d6-626bd03a92a1 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.134723 Oct 04 20:33:45.853400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 291/568] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:45.875229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.876519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:45.889213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.900286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.901104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:45.902039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:45.902794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:45.903463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.332742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:46.359169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d284c20a-c181-447c-b7a1-e1ca0d69c0fd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.039127 Oct 04 20:33:46.395359 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 278/569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:46.414393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.416138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:46.429331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:46.434301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.435237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.436014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.437325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.438135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.439214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.492211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f355ef3-8aee-4eb1-940e-2bb1be3e0fee tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1476 microversion: 2.1 time: 0.614327 Oct 04 20:33:46.493929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 292/570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:46.515725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Calling method '.version_select at 0x7f54f69d1dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.537028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.538048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.538831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.594596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.596105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.596341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.624452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba80ef02-cd75-49c1-bb52-5417ed356739 tempest-HypervisorAdminUnderV252Test-750574800 tempest-HypervisorAdminUnderV252Test-750574800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-851029-13/search" status: 200 len: 105 microversion: 2.1 time: 0.127392 Oct 04 20:33:46.643834 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 293/571] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-851029-13/search => generated 105 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:46.657773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.659474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:46.679115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.680694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.682390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.684359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.685749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.686802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.292852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20a6592e-2c3a-41d7-840b-dee51063484e tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1621 microversion: 2.1 time: 0.889465 Oct 04 20:33:47.298144 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 279/572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1621 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:47.328722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb83fe09-ad24-408e-87cc-690f89b8392b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6966d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:47.513070 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb83fe09-ad24-408e-87cc-690f89b8392b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.212119 Oct 04 20:33:47.518768 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 280/573] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:47 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:47.551110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:47.588662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:47.590257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:47.593034 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a4efce4-8e29-459e-acf9-4e57ac71ff62 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 0.942477 Oct 04 20:33:47.604515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.605837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.607244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.608891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.610318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.611391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.628480 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 294/574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:47.655492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:47.657353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:47.679639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.681559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.682705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.684769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:47.702096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:47.709020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:47.796669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:48.638049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:48.651456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6002b4d8-7a00-4351-8b11-14ad487341b8 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 200 len: 1620 microversion: 2.1 time: 1.018529 Oct 04 20:33:48.652582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 295/575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:47 2022] GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 1620 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:48.666295 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-01df1aa9-f6ee-47b1-87e5-63795be68ad0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.144373 Oct 04 20:33:48.681469 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 281/576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:47 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:48.684201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:48.685874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:48.705873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:48.726186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:48.735911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.736814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.737626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.739036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.739888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.740666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.750131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.751134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.751930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.753267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.754109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.754921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:49.805969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:49.810351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:49.848961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-14e15e57-c7ba-4eb6-b0b4-87f4a26997a8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1475 microversion: 2.1 time: 1.160334 Oct 04 20:33:49.856320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 282/577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:48 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1475 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:49.868095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be03482d-f131-4cd3-814b-322cacce41e4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f680aa60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:49.901006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:49.957428 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d16e0889-312b-4389-a97b-ec824a982bb1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.295341 Oct 04 20:33:49.983680 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 296/578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:48 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:50.015007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93551c99-9a83-47bd-acc7-bbd8e88081aa", "name": "network-vif-plugged", "status": "completed", "tag": "6d226e99-d5aa-4da8-8417-630a3114fd14"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:50.077440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.078932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.080149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.080336 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be03482d-f131-4cd3-814b-322cacce41e4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.216268 Oct 04 20:33:50.083115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 283/579] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:49 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:50.100180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:50.104159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:50.125908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.127238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.128347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.130005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.131771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.132838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.138234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] Creating event network-vif-plugged:6d226e99-d5aa-4da8-8417-630a3114fd14 for instance 93551c99-9a83-47bd-acc7-bbd8e88081aa on n-h1-851029-13 Oct 04 20:33:50.152687 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-52b6a483-39b4-4896-a299-aa48278eff4e req-a0e0caae-c65b-419e-8310-fbe1af3daee5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166397 Oct 04 20:33:50.164569 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 297/580] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:50.213782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: .version_select at 0x7f54f68264c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1326908064", "policies": ["anti-affinity"]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:50.311324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:50.333508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:50.594139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:50.636118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:50.647713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:50.689272 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fcc0b1ee-beb0-4a1c-a025-17c0a282a11c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.509134 Oct 04 20:33:50.691695 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 298/581] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 4 20:33:50 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:50.704580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:50.706771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:50.765550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.767258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.769215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.779191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.780213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.780908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.140961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:51.140961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9058aff0-f695-4dc1-ab98-93b6d58b1b9c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1318 microversion: 2.1 time: 0.904932 Oct 04 20:33:51.140961 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 284/582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:50 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:51.140961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.142138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:51.142138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.142138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.142138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.164412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.164412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.164412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.800486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:51.838151 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48476bff-65fd-423d-bfda-9676d797c6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.140149 Oct 04 20:33:51.847150 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 299/583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:50 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:51.860732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:51.875459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.881579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:51.901601 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95f2e61e-03f3-4868-9f0a-1549409505e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1475 microversion: 2.1 time: 0.879605 Oct 04 20:33:51.901601 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 285/584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:50 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1475 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:51.929728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f73e0a02-3ca9-49bf-aac6-08972f31aed0 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f696e670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.934052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.935074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.943995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.947922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.952902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.958047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:52.105298 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f73e0a02-3ca9-49bf-aac6-08972f31aed0 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.217229 Oct 04 20:33:52.112572 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 286/585] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:52.153167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1329715849", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "53bbeaa0-cac8-4d0c-a0a9-d8a3f552fd34"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:52.368060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:52.579478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:52.620496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58c8193a-d978-486f-a13f-9b39e34cbf98 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 0.776905 Oct 04 20:33:52.634068 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 300/586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:52.644071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.656726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:52.670985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.674381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.674381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:52.674381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.697266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.700554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.122493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:53.249182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:53.274554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9eecb210-f9e5-4332-b1c3-748e7e129ed4 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1468 microversion: 2.1 time: 0.638219 Oct 04 20:33:53.302973 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 301/587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:52 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1468 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:53.322922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "name": "network-vif-unplugged", "status": "completed", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.360987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.365161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.366155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.417796 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Creating event network-vif-unplugged:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h2-851029-13 Oct 04 20:33:53.441905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:33:53.506893 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c31575e3-de60-4702-8ff5-e27a2c49a09a req-a0ed9013-8992-4929-a4a1-ca20103db2c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201149 Oct 04 20:33:53.508077 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 302/588] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:53.525172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:53.526605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:53.554640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.556018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.559854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.561683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:53.568103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:53.580550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:53.854128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:54.013848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:54.016020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:54.029883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:54.035037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:54.035996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:54.190994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.193381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.194551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.196979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.198224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.203891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.311549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:54.327529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:54.387766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 2 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:54.401911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:54.565974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:54.619686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1affc5c5-db0e-431e-82d1-86c0a677d758 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.109101 Oct 04 20:33:54.623112 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 303/589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:53 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:54.659734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.660886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:54.688426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.689714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.690789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.692653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.695173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.699171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123542) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 20:33:54.700235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.781311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:54.800682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:55.160794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:55.172862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:55.206876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=44ee9be3-b277-4ab4-bfaf-498945328c9c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:55.442198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:55.461685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:55.548756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:55.576882 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc660b17-7bb7-4ea9-b850-495852ad0a92 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1475 microversion: 2.1 time: 0.951034 Oct 04 20:33:55.590851 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 304/590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1475 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:55.621553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d4c4da8-e79d-4590-b35c-2a1895a4a978 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67943a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:55.702173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:55.735192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'server_group_members'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:55.868036 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d4c4da8-e79d-4590-b35c-2a1895a4a978 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.253021 Oct 04 20:33:55.869203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 305/591] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:55 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:55.894599 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c837278a-da37-49df-852d-e283be07d664 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.777899 Oct 04 20:33:55.904296 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 287/592] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 3790 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:33:55.931640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:55.943969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:55.948560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f4f61e-3c5d-4f41-8179-571555cc0d2f", "name": "network-vif-plugged", "status": "completed", "tag": "b2e62de5-f735-4fd1-be70-5969ebc19e55"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:55.999187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.005013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.005013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.005013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.008493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.015671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.022535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.026530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.037736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.092404 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] Creating event network-vif-plugged:b2e62de5-f735-4fd1-be70-5969ebc19e55 for instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f on n-h2-851029-13 Oct 04 20:33:56.113337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7140c4ea-cbb7-4b65-bbae-09cc1e61ffab req-176b7f0a-be0a-4a62-a27b-b5e0dfb7e0b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205180 Oct 04 20:33:56.119535 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 288/593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:56.143455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:56.152318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:56.203141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:56.207703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.213612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.215986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.224650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:56.227418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:56.231742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.551095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lazy-loading 'flavor' on Instance uuid 93551c99-9a83-47bd-acc7-bbd8e88081aa {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:33:57.339392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea40dc2e-bc15-450a-8443-f807bd6586c7 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa/action" status: 202 len: 0 microversion: 2.1 time: 1.456308 Oct 04 20:33:57.370376 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 306/594] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:33:55 2022] POST /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa/action => generated 0 bytes in 1489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:57.450359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:57.468862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:57.499468 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c99d41a9-b6f6-44ee-8413-05dabb430a40 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.373387 Oct 04 20:33:57.504594 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 289/595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:56 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:57.525476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:57.525763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.528184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.529890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:57.531060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.598433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.604240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.604240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.604240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.604240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.606792 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Creating event network-changed:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h2-851029-13 Oct 04 20:33:57.627070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.641874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:33:57.714214 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d3bb09e1-a8c5-41e4-9860-07857328a541 req-69e927e9-34d8-4eec-9adf-8895f97ec929 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327634 Oct 04 20:33:57.720230 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 307/596] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:57.749160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:57.776701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:57.779650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Searching by: {'deleted': False, 'project_id': '3d7a2afde38148faab4850e9d2f191bb'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:33:57.861532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.862692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.865592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.868894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.884202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.885971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.007481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:33:58.171986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b551bad-f368-41bb-bb52-99c040070e1d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.446877 Oct 04 20:33:58.179105 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 308/597] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:33:57 2022] GET /compute/v2.1/servers => generated 1664 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:58.185226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:58.187054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:58.203139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.204833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.207576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.210189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.212002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.213070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:59.369764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:59.395750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-320c9be8-c38a-4e62-8005-f3df7fb116de tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1310 microversion: 2.1 time: 1.884977 Oct 04 20:33:59.396928 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 290/598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:57 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1310 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.433362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cda329a1-5f34-424c-a743-dc3902562249 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f677c8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:59.484823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:59.504566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-af966c31-98de-47d6-b97c-3e32bdb07841 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1473 microversion: 2.1 time: 1.327380 Oct 04 20:33:59.506766 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 309/599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:58 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1473 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.534187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:59.544833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:59.628461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:59.636142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:59.640514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:59.642872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:59.647807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:59.649999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:59.650877 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cda329a1-5f34-424c-a743-dc3902562249 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.242139 Oct 04 20:33:59.657599 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 291/600] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.685011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdcda2a1-b4b4-42d1-9ee1-5def68f72f3d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:59.689481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bdcda2a1-b4b4-42d1-9ee1-5def68f72f3d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:00.540121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bdcda2a1-b4b4-42d1-9ee1-5def68f72f3d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:00.615535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bdcda2a1-b4b4-42d1-9ee1-5def68f72f3d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1219 microversion: 2.1 time: 0.949523 Oct 04 20:34:00.628276 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 292/601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1219 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:00.658311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dd9f54-f84d-472a-b1e3-35cc089ba3ea", "name": "network-vif-plugged", "status": "completed", "tag": "c71fbfe3-34b0-477b-a59c-d0a836252426"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:00.676246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:00.720257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.723877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.728466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.780826 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] Creating event network-vif-plugged:c71fbfe3-34b0-477b-a59c-d0a836252426 for instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea on n-h1-851029-13 Oct 04 20:34:00.803585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-41dbba1b-2aa6-4bd9-b67d-a2ec72f06d3d req-ecf2d1d9-e920-43ff-a504-9b7cb1d3918a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168059 Oct 04 20:34:00.811781 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 293/602] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:00.835479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:00.841082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:00.875453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.876923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.880316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.885830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.888882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.895465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:01.509961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:01.547539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c798fe06-bb8a-449c-ab6d-d3e74c0b63f1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1459 microversion: 2.1 time: 2.023626 Oct 04 20:34:01.599297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 310/603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1459 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:01.653146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:01.653146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:01.713239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.714333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.714987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:01.716361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.717231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.745481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.006570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:02.065509 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6882233c-6c6d-4104-9ebc-462148d2ec67 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1391 microversion: 2.1 time: 1.245558 Oct 04 20:34:02.088029 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 294/604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:00 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1391 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:02.124704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:02.126822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:02.159618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.164447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.168225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.171236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.172682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.174172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.767872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:03.793952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7605e821-bec8-4020-9a05-97c529fa828c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1493 microversion: 2.1 time: 2.192582 Oct 04 20:34:03.795980 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 311/605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:01 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1493 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:03.806049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9041fdf-8386-41d8-a9fd-a036a12da607 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f69d1550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:03.969447 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9041fdf-8386-41d8-a9fd-a036a12da607 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.170923 Oct 04 20:34:03.979403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 312/606] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:03 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:03.996271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:03.997782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:04.013186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:04.014383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:04.015126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:04.016395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:04.017187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:04.017952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:04.066860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:04.111025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f5c19dd-db21-4419-b0fa-31470f5b7983 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1470 microversion: 2.1 time: 2.019897 Oct 04 20:34:04.122864 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 295/607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1470 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:04.142338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:04.144460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:04.170223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:04.176104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:04.177310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:04.183567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:04.184766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:04.186041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:04.239225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:04.707029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:04.748319 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e42c845-bb66-481e-813b-8b1801a9d9a2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1271 microversion: 2.1 time: 0.622868 Oct 04 20:34:04.756756 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 296/608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:04 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1271 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:05.162174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47b2e3a6-9779-49a9-8c63-12fd17e29de3 tempest-InstanceUsageAuditLogTestJSON-1025920288 tempest-InstanceUsageAuditLogTestJSON-1025920288-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:05.224666 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47b2e3a6-9779-49a9-8c63-12fd17e29de3 tempest-InstanceUsageAuditLogTestJSON-1025920288 tempest-InstanceUsageAuditLogTestJSON-1025920288-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:34:02" status: 200 len: 318 microversion: 2.1 time: 0.465173 Oct 04 20:34:05.226995 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 297/609] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 20:34:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A34%3A02 => generated 318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:05.238055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:05.239842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:05.266102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.267756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.269743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.272152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.274485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.276170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.979989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:06.016647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b71387c-79a2-49d1-881d-7af529224325 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1588 microversion: 2.1 time: 0.786996 Oct 04 20:34:06.023870 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 298/610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:05 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1588 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:06.362833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:06.365540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:06.380797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.383024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.384345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.386153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.387552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.388726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.035685 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf9e0629-d096-4ef7-82dd-3f5477d4a052 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1612 microversion: 2.1 time: 3.054266 Oct 04 20:34:07.046713 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 313/611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:03 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1612 bytes in 3057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.047561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:07.055128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.068106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.071078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.072432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.074165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.075105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.075913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.131386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:07.308524 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e66acbb-aded-495b-b15b-c0f38f30b40a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1646 microversion: 2.1 time: 1.281406 Oct 04 20:34:07.313384 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 299/612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:06 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1646 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.319203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb06b027-e654-4712-9595-2b385d1ef615 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f677c430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.468341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcedf6c3-bba2-4b49-9e5c-2f73b86a5110 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2/action" status: 204 len: 0 microversion: 2.1 time: 0.428380 Oct 04 20:34:07.469599 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 314/613] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:07 2022] POST /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2/action => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:07.506604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb06b027-e654-4712-9595-2b385d1ef615 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1423 microversion: 2.1 time: 0.190159 Oct 04 20:34:07.518087 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 300/614] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1423 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.536903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75888647-358b-4945-b2d2-427dd5b106e1 tempest-InstanceUsageAuditLogTestJSON-1025920288 tempest-InstanceUsageAuditLogTestJSON-1025920288-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.559670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.564428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.597416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.599710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.604082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.608671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.611671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.617548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.693585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75888647-358b-4945-b2d2-427dd5b106e1 tempest-InstanceUsageAuditLogTestJSON-1025920288 tempest-InstanceUsageAuditLogTestJSON-1025920288-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.210678 Oct 04 20:34:07.712620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 315/615] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:07.740292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.747756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.767507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.776235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.783038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.785350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.794065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.795733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.917674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:08.172353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.213920 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ab924b8-06e2-4827-8e17-322c4997e84c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1277 microversion: 2.1 time: 0.699067 Oct 04 20:34:08.227189 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 301/616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1277 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:08.254012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "name": "network-vif-plugged", "status": "completed", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:08.302908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.312893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.316967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.371617 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Creating event network-vif-plugged:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h2-851029-13 Oct 04 20:34:08.404217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:34:08.461433 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e52d321b-dbf4-4c0d-97e9-b93e057d056c req-9d11cda6-75ac-404b-8b1a-aa6770fbae5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230233 Oct 04 20:34:08.473156 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 302/617] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.488562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.503807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.507982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.514229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.526543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.530863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.530863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.638308 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2cd91a9-2117-4cca-b41f-ce92b52658d4 tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.162072 Oct 04 20:34:08.652544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 303/618] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.675009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce56aaf7-4793-4e3b-b830-d9311d2e3385 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.959231 Oct 04 20:34:08.682846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.685192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.706971 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 316/619] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea/os-interface => generated 284 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.713459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.716218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.717522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.722979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.724309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.728981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.730215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.730808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.753111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.759144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.763178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.765217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.770575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.772491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.165722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e54609e-10e8-4b9d-bbac-edf59181d134 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1646 microversion: 2.1 time: 1.500268 Oct 04 20:34:10.168717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:10.185399 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 304/620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1646 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:10.196530 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f4216b1-840c-46f6-9776-f3c58b67ea74 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1470 microversion: 2.1 time: 1.485737 Oct 04 20:34:10.201807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 317/621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1470 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:10.233909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18389ec0-0ba8-4f38-a385-cf65d174eef1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6826af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:10.392057 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18389ec0-0ba8-4f38-a385-cf65d174eef1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1432 microversion: 2.1 time: 0.187892 Oct 04 20:34:10.393526 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 318/622] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:10 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1432 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:10.416182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851029-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:10.421945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:10.442755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.443887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.445038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.446639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.447768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.448777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.513294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Lazy-loading 'flavor' on Instance uuid 93551c99-9a83-47bd-acc7-bbd8e88081aa {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:10.544452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 93551c99-9a83-47bd-acc7-bbd8e88081aa while it is in vm_state suspended Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Request method failure captured: Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa/action HTTP/1.1 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 98 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhTZKkVtSUqy3g7OLXUUR_Cxi6-YjWiGQ_QdCoiF1zKKjOMJ6J29g3ReFls3toH5gTBYarBLg1k8-UNXoRHoRI2mtYqNgxgpHZHWU6afjCgWBX2SD8aP0_2_uMURAv4Daj2JzTLkWun_n3865sblj9OSdrcfSnvnZtCQ1n5dkYDXIM Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5ebb44afc499403faca2ef66149434c9 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:34:10.548774 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ebb44afc499403faca2ef66149434c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ebb44afc499403faca2ef66149434c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5ebb44afc499403faca2ef66149434c9 Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1654719181 Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveMigrationNegativeTest-1654719181-project-admin Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a7059c856e8c4c38a199ed099dc18c02 Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveMigrationNegativeTest-1654719181-project-admin Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: {"os-migrateLive": {"host": "n-h2-851029-13", "block_migration": true, "disk_over_commit": false}} Oct 04 20:34:10.551592 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'os-migrateLive' instance 93551c99-9a83-47bd-acc7-bbd8e88081aa while it is in vm_state suspended Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '93551c99-9a83-47bd-acc7-bbd8e88081aa', 'body': {'os-migrateLive': {'host': 'n-h2-851029-13', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 20:34:10.552949 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:10.556413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 93551c99-9a83-47bd-acc7-bbd8e88081aa while it is in vm_state suspended Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 93551c99-9a83-47bd-acc7-bbd8e88081aa while it is in vm_state suspended Oct 04 20:34:10.560409 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:10.566422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 93551c99-9a83-47bd-acc7-bbd8e88081aa while it is in vm_state suspended {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:10.568556 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65f23259-dc75-4fd2-8f98-41ac6e50b15f tempest-LiveMigrationNegativeTest-1654719181 tempest-LiveMigrationNegativeTest-1654719181-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa/action" status: 409 len: 155 microversion: 2.1 time: 0.172481 Oct 04 20:34:10.570238 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 319/623] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:10 2022] POST /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa/action => generated 155 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:10.579272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:10.581176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:10.619830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.621432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.623383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.628008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.629438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.631137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.854969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1278353609", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3fe9fa00-ea40-44c6-8d74-c6204519a84b"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:10.960133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] validate_networks() for [('3fe9fa00-ea40-44c6-8d74-c6204519a84b', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:11.981029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:12.015471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b3ba6b0-e3be-4990-91f8-acefffa8d7b8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 1.442921 Oct 04 20:34:12.016578 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 320/624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:10 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:12.059329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.066963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.068233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.069309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.071143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.072375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.073466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.123981 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-209caf7e-9641-4d8f-a4b0-b7fa1eaeb498 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.086729 Oct 04 20:34:12.126086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 321/625] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:34:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:12.139908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-091faccc-e7b1-4bad-b533-4dfda820c613 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6761940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.257589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-091faccc-e7b1-4bad-b533-4dfda820c613 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 200 len: 1432 microversion: 2.1 time: 0.129100 Oct 04 20:34:12.259157 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 322/626] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:12 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 1432 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:12.268671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.270080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:12.284214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.285496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.286530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.287905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.289271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.290345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.376219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:13.191107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-919f3315-0dc2-43c9-aa60-3b5632ce4ed9 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 204 len: 0 microversion: 2.1 time: 0.929289 Oct 04 20:34:13.192815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 323/627] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:12 2022] DELETE /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 0 bytes in 932 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:13.210279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:13.212054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:13.257620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.263390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.264993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.268719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.270090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.272870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.259242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:14.283257 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2138136f-867c-488f-ac17-d5feb185bedb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1470 microversion: 2.1 time: 1.087733 Oct 04 20:34:14.291049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 324/628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1470 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:14.300659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.306596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:14.316853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.317843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.318405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.319316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.320119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.326572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.375290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lazy-loading 'flavor' on Instance uuid 75f4f61e-3c5d-4f41-8179-571555cc0d2f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:14.411057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123541) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:34:14.500624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:14.502071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:14.503086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:14.504320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:14.505086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:14.559409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.560387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.561504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.563178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.564033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.564790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.686826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:14.716026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for user 07dfa4ed8d314142a365c3e67fe5b334 and project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:14.763665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:14.768263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:15.033397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee4a5982-812d-4d65-a9f4-988dc6c8464a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.840915 Oct 04 20:34:15.034726 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 305/629] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:34:15.076670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:15.077006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:15.124937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.127573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.136225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.140142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.145024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.147541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.525903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:16.544997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5de28f21-d3b3-420a-a517-76654d5284cf tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1466 microversion: 2.1 time: 1.505519 Oct 04 20:34:16.563508 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 306/630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:15 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1466 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:16.602262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ee9be3-b277-4ab4-bfaf-498945328c9c", "tag": "dea2a79d-77f9-484d-b232-19d202747864"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.673783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.675160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.678598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.744944 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] Creating event network-changed:dea2a79d-77f9-484d-b232-19d202747864 for instance 44ee9be3-b277-4ab4-bfaf-498945328c9c on n-h1-851029-13 Oct 04 20:34:16.761048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-59a9284c-2dcc-4597-88b5-6135dd6e2c3e req-f6888433-3923-4b1f-b668-b00a0b528ecf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193532 Oct 04 20:34:16.763366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 307/631] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:16.783456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.784788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:16.803541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.806182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.807360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.810991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.814093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.815347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.118386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.129596 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-beaba125-6967-4745-909a-4b7a46fa1d7b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 0.357973 Oct 04 20:34:17.130348 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 308/632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:17.140882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.142499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.156642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.159658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.160474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.161421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.162265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.163003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.435880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.440478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.454084 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb53fe0f-9fa9-4840-b34a-5c03c8a45f64 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1465 microversion: 2.1 time: 0.321346 Oct 04 20:34:17.456914 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 309/633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:17.482336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.483880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.599545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.615419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.619102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.622764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-876ac25b-60d7-4ffe-ad26-16b3ac294798 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1262 microversion: 2.25 time: 0.162847 Oct 04 20:34:17.624046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 310/634] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:17.633962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.635714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.648840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.649886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.651700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.654582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.655951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.657349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.677253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:18.853235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.871168 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66ca5928-8ca5-4d03-98cf-6ec05c0b58f9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1470 microversion: 2.1 time: 1.244374 Oct 04 20:34:18.873676 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 311/635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1470 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:18.886256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-unplugged", "status": "completed", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.910561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.911876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.913043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.948472 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] Creating event network-vif-unplugged:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:34:18.976064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7c61d2a2-5df4-40ed-b7f4-987b92ff83a6 req-868fd04f-fbf0-409d-8efb-698320d153bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098105 Oct 04 20:34:18.979065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 312/636] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.995860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.997690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:19.014505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.015747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.016831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.025958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.025958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.025958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.834252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:19.872841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5133b93-9096-4f00-a324-d16092001adc tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1588 microversion: 2.1 time: 0.890814 Oct 04 20:34:19.879260 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 313/637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1588 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:19.923837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dd9f54-f84d-472a-b1e3-35cc089ba3ea", "tag": "c71fbfe3-34b0-477b-a59c-d0a836252426"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.978047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.980999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.986485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.045600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] Creating event network-changed:c71fbfe3-34b0-477b-a59c-d0a836252426 for instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea on n-h1-851029-13 Oct 04 20:34:20.071423 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6a22a4a2-2bf4-401e-b87c-44afe793b83a req-0be00d92-e288-4f76-96cd-3fae49d948c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186257 Oct 04 20:34:20.073441 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 314/638] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.096038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-605e03a1-8b75-4dda-9c64-7ec5f745ce53 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67e3d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.320819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-605e03a1-8b75-4dda-9c64-7ec5f745ce53 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163" status: 200 len: 784 microversion: 2.1 time: 0.234852 Oct 04 20:34:20.325710 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 315/639] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163 => generated 784 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.363216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.368634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:20.425240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.433835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.437244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.441143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.447821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.456161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.310338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.344536 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d10fc8a6-6ccb-4212-ba47-20cc9aa63262 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 1.012608 Oct 04 20:34:21.348141 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 316/640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:21.360115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.362234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:21.379077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.381279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.382761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.385138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.386591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.388831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.875540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.903989 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0811e49-4381-4a0d-8dd6-94273b2fc64c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 200 len: 1423 microversion: 2.1 time: 0.553380 Oct 04 20:34:21.908868 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 317/641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 1423 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:21.920169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.921944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:21.935307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.937326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.938631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.941874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.943548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.945397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.084989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:22.145371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.187896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.197006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.199467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e056a2a-03d3-421d-8073-d5efee417031 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1332 microversion: 2.25 time: 0.287677 Oct 04 20:34:22.203417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 318/642] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1332 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:22.295171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8733460-26b3-42c2-98aa-0dba3731185f", "tag": "a221cf1e-e46f-497c-963f-8c61abc62d9d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.295171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.307059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.308530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.349493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] Creating event network-changed:a221cf1e-e46f-497c-963f-8c61abc62d9d for instance b8733460-26b3-42c2-98aa-0dba3731185f on n-h2-851029-13 Oct 04 20:34:22.370063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6322a74d-488a-4e03-bd02-c77ef447ffe9 req-98506295-a36a-44c9-9d41-1b9577b1d723 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164219 Oct 04 20:34:22.388724 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 319/643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.408101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.410183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:22.424766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.439108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.439108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.439108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.439108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.439903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.852992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2ac7616-fbcd-4c00-844d-039b942715f0 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f/action" status: 202 len: 0 microversion: 2.1 time: 8.559769 Oct 04 20:34:22.859584 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 325/644] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:14 2022] POST /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f/action => generated 0 bytes in 8563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:22.877000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d79f6be5-8ddd-49ed-a22e-f2ecf3ddaf97 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.901489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:22.919295 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d79f6be5-8ddd-49ed-a22e-f2ecf3ddaf97 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062193 Oct 04 20:34:22.920381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 326/645] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.945326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93551c99-9a83-47bd-acc7-bbd8e88081aa", "name": "network-vif-unplugged", "status": "completed", "tag": "6d226e99-d5aa-4da8-8417-630a3114fd14"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:23.000928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.002281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.003455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.051074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] Creating event network-vif-unplugged:6d226e99-d5aa-4da8-8417-630a3114fd14 for instance 93551c99-9a83-47bd-acc7-bbd8e88081aa on n-h1-851029-13 Oct 04 20:34:23.062572 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4e06f03e-f469-4258-8c2b-3622f52d77f1 req-c263bd92-4374-4912-8061-c85a6a61d124 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128567 Oct 04 20:34:23.067798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 327/646] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:23.081898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.096908 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7b5d7ae0-1879-4ebd-be89-b6c54c0607f7 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1462 microversion: 2.1 time: 0.723958 Oct 04 20:34:23.097789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 320/647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1462 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:23.105084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93551c99-9a83-47bd-acc7-bbd8e88081aa", "name": "network-vif-deleted", "tag": "6d226e99-d5aa-4da8-8417-630a3114fd14"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:23.125393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.126741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.128307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.156988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] Creating event network-vif-deleted:6d226e99-d5aa-4da8-8417-630a3114fd14 for instance 93551c99-9a83-47bd-acc7-bbd8e88081aa on n-h1-851029-13 Oct 04 20:34:23.170893 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-072c44fb-e987-49b0-81f2-89ff09b0f7c2 req-7ce1ede9-72d2-468a-92d6-599900063cb6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067008 Oct 04 20:34:23.172568 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 321/648] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:23.184050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.191816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.214366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.219015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.221379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.226695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.227619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.231636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.491981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db65fc47-5692-4fee-ac83-a97117f8ec77 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Action: 'create', calling method: .version_select at 0x7f54f6652310>, body: {"keypair": {"name": "tempest-keypair-1366642245", "type": "ssh", "user_id": "054caffe653448ea9dba98d1914521e5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJC/uTlZ4j05a1W+98XDCA6q+rp7P992QER+YpkHp1OZiVw8mO2VmYKsQy8Mti3+kkzdmeA+PjGLNwaQJW2iIdQ/KKunBunpLAbbqUTA4/6nJppLujwFPh7uzeaEgKTQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:23.526504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-db65fc47-5692-4fee-ac83-a97117f8ec77 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:23.535445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-db65fc47-5692-4fee-ac83-a97117f8ec77 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for user c57a90f5bcbd4fe0b581c6f64b41168c and project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:23.718735 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db65fc47-5692-4fee-ac83-a97117f8ec77 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.651903 Oct 04 20:34:23.722007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 328/649] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 20:34:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 657 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:34:23.734249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.736488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.752240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.753704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.754854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.756944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.758307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.759139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.760297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.792170 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e08e1db1-120c-44fc-b9ca-5a6a56db2572 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 0.616657 Oct 04 20:34:23.794100 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 322/650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:23.803632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6f1c451-5be6-4c38-ac71-4c701493efe2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6b204c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:24.354222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:24.395463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3feb8b61-083e-42f6-b91e-d3ab4a4bd0c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.663568 Oct 04 20:34:24.396521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 329/651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:24.415368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:24.418133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 93551c99-9a83-47bd-acc7-bbd8e88081aa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:24.443471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.445487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.448634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.453113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.454528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.455842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.510629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] HTTP exception thrown: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Request method failure captured: Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa HTTP/1.1 Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhPWJRLlTPMBpDj9PH550-6mfLoZ6FMxLqHYtCYT17blsu2WC_SrVLEPzISsWmodJGK6MmkiUKttMPpkMnMZFw74LgN9MgXJIdZIfdHtWF5l6mo6XxwNr3Hp6eIBclJervqk_53tlBWhrxLG-fhO3x8FfWQ2SzVcoMltcl0nV0b6iw Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a53c348cf974050b9ca2401aea6510b Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:34:24.521616 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a53c348cf974050b9ca2401aea6510b Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveMigrationNegativeTest-1250587100-project Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 80239f15a949474da642543021a701ef Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveMigrationNegativeTest-1250587100-project Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. Oct 04 20:34:24.525129 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '93551c99-9a83-47bd-acc7-bbd8e88081aa'} Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:24.526897 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. Oct 04 20:34:24.529595 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:34:24.545007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Returning 404 to user: Instance 93551c99-9a83-47bd-acc7-bbd8e88081aa could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:24.545007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e16e2fdf-3a5f-4514-ad2b-17e145aa00a1 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa" status: 404 len: 111 microversion: 2.1 time: 0.135970 Oct 04 20:34:24.545007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 330/652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:24 2022] GET /compute/v2.1/servers/93551c99-9a83-47bd-acc7-bbd8e88081aa => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:24.550788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:24.556509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:24.573148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.575304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.577066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.578890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.580285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.582982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.636251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:25.249613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.276602 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bba2947-e78c-4097-8a93-e3a92835cc64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1462 microversion: 2.1 time: 0.738004 Oct 04 20:34:25.278036 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 331/653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:24 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1462 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:25.287209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:25.288865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:25.300604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.301955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.303174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.305015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.306609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.307849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.738103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.756150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.759926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.762249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b29b6538-35a9-4a05-8624-8c8e55e59c88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.481850 Oct 04 20:34:25.763733 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 332/654] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:25 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:25.773779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a1533f1-6e39-47a2-8753-23aaeaa20dcb tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Action: 'create', calling method: .version_select at 0x7f54f66a3670>, body: {"keypair": {"name": "tempest-keypair-725894614", "type": "ssh", "user_id": "054caffe653448ea9dba98d1914521e5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuSpJTjQaxD+sXArnv5wp5iowxa5VaKjKbW0gJTSZWVCvhge5WhPt5JW7ThY2GnZRp7OopdFNq5j/j1L0dMCN9kyA0AIMs6qv8H2b7qkk2o2piV08l04jLGJoAjKO/CHQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:25.806589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6a1533f1-6e39-47a2-8753-23aaeaa20dcb tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:25.814972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6a1533f1-6e39-47a2-8753-23aaeaa20dcb tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for user c57a90f5bcbd4fe0b581c6f64b41168c and project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:25.933780 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a1533f1-6e39-47a2-8753-23aaeaa20dcb tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.167565 Oct 04 20:34:25.935983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 333/655] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 20:34:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:34:25.946143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:25.947603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:25.959962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.961289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.962184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.963581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.965220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.966491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.043455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:26.055342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:26.429985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6f1c451-5be6-4c38-ac71-4c701493efe2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "DELETE /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 204 len: 0 microversion: 2.1 time: 2.633565 Oct 04 20:34:26.437746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 323/656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] DELETE /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 0 bytes in 2637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:26.442211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.443653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:26.457383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.457983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.458814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.460931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.462167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.463348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.533409 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1a6aca3-aa0f-4ea6-be5a-5f7db6a39e79 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 204 len: 0 microversion: 2.1 time: 0.594769 Oct 04 20:34:26.534542 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 334/657] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:25 2022] DELETE /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:26.552521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ee9be3-b277-4ab4-bfaf-498945328c9c", "name": "network-vif-plugged", "status": "completed", "tag": "dea2a79d-77f9-484d-b232-19d202747864"}, {"server_uuid": "b8733460-26b3-42c2-98aa-0dba3731185f", "name": "network-vif-plugged", "status": "completed", "tag": "a221cf1e-e46f-497c-963f-8c61abc62d9d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:26.582492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.586459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.587628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.615616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Creating event network-vif-plugged:dea2a79d-77f9-484d-b232-19d202747864 for instance 44ee9be3-b277-4ab4-bfaf-498945328c9c on n-h1-851029-13 Oct 04 20:34:26.616613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] Creating event network-vif-plugged:a221cf1e-e46f-497c-963f-8c61abc62d9d for instance b8733460-26b3-42c2-98aa-0dba3731185f on n-h2-851029-13 Oct 04 20:34:26.647008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-155daff6-6cf0-407d-be39-e0b763de2c30 req-39cb868a-a611-4295-93f7-ce8355a25d2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091979 Oct 04 20:34:26.657189 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 335/658] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:26.679236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f4022e61-b795-42e1-897c-c163b66e39d8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'create', calling method: .version_select at 0x7f54f665e280>, body: {"keypair": {"name": "tempest-keypair-260979865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1TJNF4Q+vD/8RWA2bcYSlrWIDsFQJWeEIf1tdDaFaRcugMgcdyHqwSYbD3vYbGRZXxBI5opiEvRVLa3HKNhGoDzBUeDprG14/AbCfH/LmWxkbmxjwliAw7a2kWpzhV9g=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:26.741135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f4022e61-b795-42e1-897c-c163b66e39d8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:26.758054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f4022e61-b795-42e1-897c-c163b66e39d8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:26.970694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.971918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f4022e61-b795-42e1-897c-c163b66e39d8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310682 Oct 04 20:34:26.973638 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 336/659] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:34:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:26.985664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.987627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:26.988705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3e50be6-ae46-44c0-8c30-df5decd7c789 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 0.555390 Oct 04 20:34:26.989788 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 324/660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:27.000382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b51d44f-422c-4dc1-8c77-b9712080bf5c tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Calling method '.version_select at 0x7f54f6bcdc10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.004428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.012461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.012461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.012461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.012461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.013119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.013291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:27.031099 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b51d44f-422c-4dc1-8c77-b9712080bf5c tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1366642245?user_id=054caffe653448ea9dba98d1914521e5" status: 200 len: 512 microversion: 2.10 time: 0.038270 Oct 04 20:34:27.033655 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 325/661] 10.222.0.36 () {60 vars in 1340 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1366642245?user_id=054caffe653448ea9dba98d1914521e5 => generated 512 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:27.046093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f4f61e-3c5d-4f41-8179-571555cc0d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "b2e62de5-f735-4fd1-be70-5969ebc19e55"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:27.073045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.074252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.075137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.364985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] Creating event network-vif-unplugged:b2e62de5-f735-4fd1-be70-5969ebc19e55 for instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f on n-h2-851029-13 Oct 04 20:34:27.374689 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8473affe-36ea-4c71-8820-2f965f8e1794 req-b1304c69-fba7-425a-96c2-bd329c29682d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.338208 Oct 04 20:34:27.376744 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 326/662] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:27.383612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:27.390270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e68d9b5-a8e7-471b-a2e2-8ed2957d494d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67b5ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.408914 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-620651f0-c4e7-4e10-8f24-08ca2f83dfdf tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.432661 Oct 04 20:34:27.422761 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 337/663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:27.424220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.443311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:27.453652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.455848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.456718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.458179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.459245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.460638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.463932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1e68d9b5-a8e7-471b-a2e2-8ed2957d494d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] HTTP exception thrown: Image not found. Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e68d9b5-a8e7-471b-a2e2-8ed2957d494d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Request method failure captured: Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 HTTP/1.1 Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhV0fkY2Rrs6V8wAISWocB5lGptuWWPgtE3je4GcQjV-IhlopbDNurWvoQsXINOUfO3_wTcwjr2-JvctkW4M1NDg2Ng2WRJCBJY8K-0WcCwIsPHlDiBq0inMcFwPS4YlWaX73bo1EpubL03joxp2iuPd18dAZrtGCQHC-Pqp-Q-4No Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 239f887a70154739880d4022f58e210b Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:34:27.478794 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/239f887a70154739880d4022f58e210b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_239f887a70154739880d4022f58e210b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 239f887a70154739880d4022f58e210b Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: db3e20ac90ba4e129c24328a2f0a7d40 Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5'} Oct 04 20:34:27.481382 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:34:27.483017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:34:27.493619 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 could not be found. Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:27.496269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e68d9b5-a8e7-471b-a2e2-8ed2957d494d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:27.498339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e68d9b5-a8e7-471b-a2e2-8ed2957d494d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 404 len: 62 microversion: 2.1 time: 0.110777 Oct 04 20:34:27.503700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 327/664] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:27.510723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.511632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:27.526730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.527601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.528411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.529805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.530622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.531435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.611293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=36 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:27.903695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:27.919897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-517cc27e-3aea-4d91-8029-ed7b06e2a50c tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1475 microversion: 2.1 time: 0.506696 Oct 04 20:34:27.922035 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 338/665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1475 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:27.931413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fd69117-d0aa-4a24-b92e-b5747de57379 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Action: 'create', calling method: .version_select at 0x7f54f667d430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2078474519", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs8a5Ug8SXiutIr4lrUkyLSqFxmM4v3p/l0MpjKV6lkbeEQ7mm/inKkNp+sGwlttiZoTWYNg/lDKeLd4MspMvsEnnLShpZD1VmJaxasGyPWmbsjabkTFn7jwQHQW91D+g=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:27.971146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2fd69117-d0aa-4a24-b92e-b5747de57379 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:27.980481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2fd69117-d0aa-4a24-b92e-b5747de57379 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Getting quotas for user c57a90f5bcbd4fe0b581c6f64b41168c and project 859254632cc24f4a8d8e6051077344fa. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:27.997585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.013801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.016393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.018006 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-546fe3db-bb9c-4e8b-85d9-e782c9eb9b99 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.524802 Oct 04 20:34:28.019697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 328/666] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:28.030314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a91c95-59fa-498f-9811-a3e5d072ed89", "tag": "566d8a68-cd52-485f-aea0-d2499f8e2741"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:28.052173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.054162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.055308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.073444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] Creating event network-changed:566d8a68-cd52-485f-aea0-d2499f8e2741 for instance 28a91c95-59fa-498f-9811-a3e5d072ed89 on n-h2-851029-13 Oct 04 20:34:28.081972 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b2d6537a-c4f1-45b6-b018-cb9d9655f603 req-bef00d82-f6c1-4ebe-b33d-57574d175ad6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059640 Oct 04 20:34:28.083019 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 329/667] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:28.092140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1294380391"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:28.096243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.109682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.111111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.111790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.113490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.114338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.115166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.115341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fd69117-d0aa-4a24-b92e-b5747de57379 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.191463 Oct 04 20:34:28.129330 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 339/668] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 20:34:27 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:34:28.142866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.146013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.158137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.159529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.160472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.161916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.162931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.163657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.447377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.489362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bedb37dd-3e08-4d32-87c3-e13a13fcf1b0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 0.333494 Oct 04 20:34:28.489362 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 340/669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.489362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d57972bf-c1e3-4035-9a00-df92b3f1fd84 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Calling method '.version_select at 0x7f54f661ba60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.489362 n-d-851029-13 devstack@n-api.service[123541]: WARNING oslo_db.sqlalchemy.utils [None req-d57972bf-c1e3-4035-9a00-df92b3f1fd84 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:34:28.510556 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d57972bf-c1e3-4035-9a00-df92b3f1fd84 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs?user_id=054caffe653448ea9dba98d1914521e5" status: 200 len: 725 microversion: 2.10 time: 0.034325 Oct 04 20:34:28.510556 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 341/670] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/os-keypairs?user_id=054caffe653448ea9dba98d1914521e5 => generated 725 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:28.522245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.522245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.531144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.531647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.532080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.532812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.533271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.533696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.913217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.929676 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b28e76cc-ee8f-4ec9-ad31-503abb62f4b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.416516 Oct 04 20:34:28.933087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 342/671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.939887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44943cf5-3118-49c3-9e98-80f397710525 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Calling method '.version_select at 0x7f54f66a7670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.012113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-490e8524-287e-4fc1-b1f9-618a470d38f4 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "POST /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204/action" status: 202 len: 0 microversion: 2.1 time: 0.926330 Oct 04 20:34:29.024976 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 330/672] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:28 2022] POST /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204/action => generated 0 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:34:29.035938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.038321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.054029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.054029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.055165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.056589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.057466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.058283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.084941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44943cf5-3118-49c3-9e98-80f397710525 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2078474519" status: 204 len: 0 microversion: 2.10 time: 0.152197 Oct 04 20:34:29.093470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 343/673] 10.222.0.36 () {60 vars in 1325 bytes} [Tue Oct 4 20:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2078474519 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:34:29.101980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f17afd9b-5139-48fb-93bb-a0e0d6d55e60 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f667d0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.209372 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f17afd9b-5139-48fb-93bb-a0e0d6d55e60 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.115163 Oct 04 20:34:29.210529 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 344/674] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:29.222185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.223479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.241525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.242579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.243465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.244813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.245696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.246515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.369452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.403705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e316d0e-bfa6-4fb9-ad74-78c2cecbaabe tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1475 microversion: 2.1 time: 0.375741 Oct 04 20:34:29.405885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 331/675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1475 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:29.415105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0fcc7ecb-90b4-4099-b465-288dd9a61283 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Calling method '.version_select at 0x7f54f696e4c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.531144 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0fcc7ecb-90b4-4099-b465-288dd9a61283 tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725894614?user_id=054caffe653448ea9dba98d1914521e5" status: 204 len: 0 microversion: 2.10 time: 0.122624 Oct 04 20:34:29.539098 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 332/676] 10.222.0.36 () {60 vars in 1340 bytes} [Tue Oct 4 20:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725894614?user_id=054caffe653448ea9dba98d1914521e5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:34:29.548042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f4f61e-3c5d-4f41-8179-571555cc0d2f", "tag": "b2e62de5-f735-4fd1-be70-5969ebc19e55"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:29.566618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.576714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.577384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.578388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.593406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.596692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.599129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-652f36c1-4939-483d-9efc-c23baca72fea tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.386396 Oct 04 20:34:29.601583 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 345/677] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:29.603992 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] Creating event network-changed:b2e62de5-f735-4fd1-be70-5969ebc19e55 for instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f on n-h2-851029-13 Oct 04 20:34:29.611405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.612910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.623196 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-084cbfbd-8f46-478a-b626-a0d9649cb50d req-b61520c9-0af5-4ac2-98e6-d665beb16b14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079298 Oct 04 20:34:29.625349 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 333/678] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:29.629917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.632513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.637005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.637005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.637005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.637005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.657750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-efb2b030-4195-4286-a216-e283bce7982b tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] Calling method '.version_select at 0x7f54f6a4ae50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.873818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-efb2b030-4195-4286-a216-e283bce7982b tempest-KeyPairsV210TestJSON-277678047 tempest-KeyPairsV210TestJSON-277678047-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366642245?user_id=054caffe653448ea9dba98d1914521e5" status: 204 len: 0 microversion: 2.10 time: 0.236901 Oct 04 20:34:29.875753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 334/679] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366642245?user_id=054caffe653448ea9dba98d1914521e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:34:29.973171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.975691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:30.007020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.008111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.010460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.013150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.014348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.014947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.055086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.088779 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-457e4927-81fa-4b22-9212-cb135670e1e9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1319 microversion: 2.1 time: 0.484779 Oct 04 20:34:30.110268 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 346/680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:30.233408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de700b83-c834-4b8b-80be-80f27caa4651 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6794430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:30.337508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de700b83-c834-4b8b-80be-80f27caa4651 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.111631 Oct 04 20:34:30.339078 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 347/681] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:30.426033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.441607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98c624cd-8f72-4067-b21f-79c765152c68 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.475400 Oct 04 20:34:30.459005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:30.464709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 335/682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:30.464953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:30.464953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.464953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.464953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.465466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.465466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.465749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.538260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.539292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.540004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.540894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lazy-loading 'fault' on Instance uuid 0fd4e455-7753-46e0-9b94-ab1002013970 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:30.632645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.652605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2c3a7c5-2d44-4a91-876e-f69f9746a9fd tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1309 microversion: 2.1 time: 0.213186 Oct 04 20:34:30.654867 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 348/683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1309 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:30.659862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:30.659862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:30.674105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.675568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.676444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.678552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.679803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.680885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.014929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.036194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:31.042620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.047191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.051341 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7b1f3a6f-9c10-40f3-8030-0dc9f20c7cee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.406668 Oct 04 20:34:31.054035 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 336/684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:34:31.161056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.162325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.174994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.176057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.176896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.179035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.180597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.181415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.368238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0824d8b-52c3-4d63-8cb3-3c4239af0cf8 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67e3b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.515139 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0824d8b-52c3-4d63-8cb3-3c4239af0cf8 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.155157 Oct 04 20:34:31.536772 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 337/685] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:31.549515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.551876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.561602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.571790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.573176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.574411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.578237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.584318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.588226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.594100 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d36637e0-7f85-4a00-9d4f-84b13d788699 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1469 microversion: 2.1 time: 0.442081 Oct 04 20:34:31.595279 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 349/686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:31.643818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.647794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.687158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.688552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.689886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.692042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.695091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.697516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.208329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.218791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.230169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58578b1a-d27f-4eec-928c-aaebb2860349 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.688853 Oct 04 20:34:32.233815 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 338/687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:32.258981 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b0e2f27-a0bf-4aba-9b3a-714c4675e569 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1469 microversion: 2.1 time: 0.623657 Oct 04 20:34:32.260524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.263182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:32.263824 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 350/688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:32.274086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd4e455-7753-46e0-9b94-ab1002013970", "name": "network-vif-deleted", "tag": "f9a87de1-d2d1-4b2b-93f0-ac528e465913"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:32.279469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.280147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.281591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.284148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.285263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.286491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.305317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.307482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.308110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.340690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] Creating event network-vif-deleted:f9a87de1-d2d1-4b2b-93f0-ac528e465913 for instance 0fd4e455-7753-46e0-9b94-ab1002013970 on n-h2-851029-13 Oct 04 20:34:32.351869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b86a5260-b1ff-4b62-af88-81bf8a4039ac req-a20d288d-ca8f-4146-927a-829ba4988990 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085450 Oct 04 20:34:32.353453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 351/689] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:32.364065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd485c04-ad13-4f11-9ddd-d2504f3c6bc6 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '.version_select at 0x7f54f6806d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.367941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.369001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.370122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.371263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lazy-loading 'fault' on Instance uuid 0fd4e455-7753-46e0-9b94-ab1002013970 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:32.373004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd485c04-ad13-4f11-9ddd-d2504f3c6bc6 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.373927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd485c04-ad13-4f11-9ddd-d2504f3c6bc6 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.374994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd485c04-ad13-4f11-9ddd-d2504f3c6bc6 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.394654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd485c04-ad13-4f11-9ddd-d2504f3c6bc6 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1196 microversion: 2.1 time: 0.038786 Oct 04 20:34:32.405562 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 352/690] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/os-migrations => generated 1196 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:32.425645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.428098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:32.441688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.442811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.443647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.446577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.447514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.448695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.481388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80239f15a949474da642543021a701ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a53c348cf974050b9ca2401aea6510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.519517 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e72fd0f4-47bd-4580-aa08-634567f6468a tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 200 len: 1309 microversion: 2.1 time: 0.262390 Oct 04 20:34:32.522983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 339/691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:32.545627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.570628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.571989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Searching by: {'reservation_id': 'r-d8aimhii', 'deleted': False, 'project_id': '3d7a2afde38148faab4850e9d2f191bb'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:34:32.581109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.582266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.583430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.585055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.586039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.587399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.835791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:34:32.889317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.910054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.914542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.918222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-410a94f9-02ec-491d-8ada-9ff459178858 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.502801 Oct 04 20:34:32.920678 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 353/692] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:32.931571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2302c42d-2ee0-4744-8ddf-2af91fe9dfa0 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.936220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:32.963261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2302c42d-2ee0-4744-8ddf-2af91fe9dfa0 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038610 Oct 04 20:34:32.966653 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 354/693] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:33.001015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a3fa1b9-511c-4f6b-b737-31874f57a40e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f661b3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.122491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.151841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.153806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.155097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.172490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a3fa1b9-511c-4f6b-b737-31874f57a40e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.203635 Oct 04 20:34:33.177734 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 355/694] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:33.193721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcba2db1-97a1-499d-8398-c4ce398aa863 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1581476126", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:33.344472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcba2db1-97a1-499d-8398-c4ce398aa863 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.168043 Oct 04 20:34:33.348948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 356/695] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Oct 4 20:34:33 2022] POST /compute/v2.1/flavors => generated 499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:33.365277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.368247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.389181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.391013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.393557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.395996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.399331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.403277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.493057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08bd6e48-9214-49dd-872d-bd66fdaa7f6f tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-d8aimhii" status: 200 len: 2931 microversion: 2.1 time: 0.965642 Oct 04 20:34:33.497615 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 340/696] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/servers/detail?reservation_id=r-d8aimhii => generated 2931 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:33.512215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dbcbced5-153e-4b46-829f-7eb9ecfdf2cd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.552059 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dbcbced5-153e-4b46-829f-7eb9ecfdf2cd tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047375 Oct 04 20:34:33.586764 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 341/697] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:34:33.640685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.724851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.server_groups [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Querying cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) for 2 instances {{(pid=123542) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:34:33.726691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.727649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.728585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.808156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3c84625-5aad-49bc-82f2-0d8a5e0f758b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/53bbeaa0-cac8-4d0c-a0a9-d8a3f552fd34" status: 200 len: 271 microversion: 2.1 time: 0.218980 Oct 04 20:34:33.809776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 342/698] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/os-server-groups/53bbeaa0-cac8-4d0c-a0a9-d8a3f552fd34 => generated 271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:33.825382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.827469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] [instance: 0fd4e455-7753-46e0-9b94-ab1002013970] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.841700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.842548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.844056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.845764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.847344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.848079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.864380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.883871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] HTTP exception thrown: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Request method failure captured: Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 HTTP/1.1 Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhPWJRLlTPMBpDj9PH550-6mfLoZ6FMxLqHYtCYT17blsu2WC_SrVLEPzISsWmodJGK6MmkiUKttMPpkMnMZFw74LgN9MgXJIdZIfdHtWF5l6mo6XxwNr3Hp6eIBclJervqk_53tlBWhrxLG-fhO3x8FfWQ2SzVcoMltcl0nV0b6iw Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a53c348cf974050b9ca2401aea6510b Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:34:33.887090 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a53c348cf974050b9ca2401aea6510b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a53c348cf974050b9ca2401aea6510b Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1250587100 Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveMigrationNegativeTest-1250587100-project Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 80239f15a949474da642543021a701ef Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveMigrationNegativeTest-1250587100-project Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. Oct 04 20:34:33.891284 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '0fd4e455-7753-46e0-9b94-ab1002013970'} Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:33.892795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. Oct 04 20:34:33.895582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:34:33.902357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] Returning 404 to user: Instance 0fd4e455-7753-46e0-9b94-ab1002013970 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:33.902357 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c946499-1711-4679-a956-ba2e6d717f19 tempest-LiveMigrationNegativeTest-1250587100 tempest-LiveMigrationNegativeTest-1250587100-project] 10.222.0.36 "GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970" status: 404 len: 111 microversion: 2.1 time: 0.076592 Oct 04 20:34:33.902357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 343/699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/0fd4e455-7753-46e0-9b94-ab1002013970 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:33.905021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.912046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.912266 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb55337f-ad19-46cd-bd24-38cca8fc1f83 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.553548 Oct 04 20:34:33.912266 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 357/700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:33.921542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.922773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.923533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.924870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.925717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.926204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.981608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.983070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.995640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.006088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.007420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.010326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.012127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.016250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.516209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0955a9c4-0976-49e8-bf21-f1bf879d72ac tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 200 len: 1622 microversion: 2.1 time: 0.615431 Oct 04 20:34:34.538115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 344/701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 1622 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:34.576903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-528392471", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "cd8dfbed-021b-4a86-b724-2018457d1200"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:34.591038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.615494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.619324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.622080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ddbadf8-8e9b-4e5e-b2b7-14efcea31133 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.652593 Oct 04 20:34:34.623550 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 358/702] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:34.661880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-427af6a7-cd77-4e6e-80cf-cb15f3f75697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6669040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:34.763839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:34.798049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-427af6a7-cd77-4e6e-80cf-cb15f3f75697 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.171171 Oct 04 20:34:34.815281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 359/703] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:34.827472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:34.829178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:34.841819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.843208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.844359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.846115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.847357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.848459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.315108 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d026170-371a-47df-a2d6-de38c8f30a43 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1622 microversion: 2.1 time: 0.497503 Oct 04 20:34:35.323958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 360/704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1622 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:35.345095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.347014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.377988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.379149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.379980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.381614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.382544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.384464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.394371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:35.428836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:35.429630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:35.430463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:35.431352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:35.431941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:35.455497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.456633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.457300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.458740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.460063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.461549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.506579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:35.518979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:35.568285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:35.580806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:35.812421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.857115 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a24d08b-cfb4-494b-83cd-f21dd444f6ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.530421 Oct 04 20:34:35.859817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae5626f8-abfe-4265-9281-1efe93bb37d5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307654 Oct 04 20:34:35.866376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 345/705] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:35.877175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 361/706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:35.878709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-754604050", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "17ea1f23-cdc1-4fac-b05e-46c2bfeaac78"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:35.900444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.901967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.916227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.917109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.917847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.919625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.920453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.934065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.042548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:36.740090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.786537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.795933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.796885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:36.797601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:36.798436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:36.799244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:36.801848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:36.807155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92a2cfbc-2553-472c-9921-c28eccade59e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.928100 Oct 04 20:34:36.808731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 362/707] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:36.820233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fe349bb-1027-48a7-8ae3-3d25c1a14b1e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f665e820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.868635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.873975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.875054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.876520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.881868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.883962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.966768 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0fe349bb-1027-48a7-8ae3-3d25c1a14b1e tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.150596 Oct 04 20:34:36.982787 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 363/708] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:36.989717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f9194b5-0fbf-4144-b95b-19d36bca2eca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.001367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f9194b5-0fbf-4144-b95b-19d36bca2eca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.008706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:37.018485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:37.049332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:37.055276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:37.123037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f9194b5-0fbf-4144-b95b-19d36bca2eca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:37.137751 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f9194b5-0fbf-4144-b95b-19d36bca2eca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1278 microversion: 2.1 time: 0.159641 Oct 04 20:34:37.139100 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 364/709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:37.148179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.149338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.171448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.172847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.174737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.176439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.177433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.179008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.401365 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-785210b3-1356-43fa-a2d5-e2d91944734c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525223 Oct 04 20:34:37.421713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 346/710] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:37.434727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7a9e2e5-eae7-486c-b0ff-c1a2c44842ad tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.435960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7a9e2e5-eae7-486c-b0ff-c1a2c44842ad tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.589341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7a9e2e5-eae7-486c-b0ff-c1a2c44842ad tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:37.605655 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7a9e2e5-eae7-486c-b0ff-c1a2c44842ad tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1216 microversion: 2.1 time: 0.181381 Oct 04 20:34:37.607266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 347/711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:37.620903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:37.627545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a91c95-59fa-498f-9811-a3e5d072ed89", "name": "network-vif-plugged", "status": "completed", "tag": "566d8a68-cd52-485f-aea0-d2499f8e2741"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:37.637373 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96e78848-0011-4227-9e27-929d90d6d266 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.496251 Oct 04 20:34:37.639622 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 365/712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:37.656007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.657496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.658646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.712391 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] Creating event network-vif-plugged:566d8a68-cd52-485f-aea0-d2499f8e2741 for instance 28a91c95-59fa-498f-9811-a3e5d072ed89 on n-h2-851029-13 Oct 04 20:34:37.718282 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d313a229-17cb-4b22-ac3a-eb26bf0c4234 req-14ad0f09-5794-4688-9539-2c2a36bc18ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108602 Oct 04 20:34:37.719958 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 348/713] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:37.865870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.878481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.913918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.920055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.920897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.922329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.923267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.957376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.997881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-668623c5-a711-427a-afe3-2e67d761dd1a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67b5820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.196766 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-668623c5-a711-427a-afe3-2e67d761dd1a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.204969 Oct 04 20:34:38.198759 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 349/714] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:38.210480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.212237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:38.231273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.235969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.235969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.235969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.236792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.237586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.463771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.481049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8fe98be-f54c-4747-a178-17e885fe9100 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1282 microversion: 2.1 time: 0.279116 Oct 04 20:34:38.481970 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 350/715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:38.604657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.647484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65946ad3-eadf-4746-b18f-4314dac26673 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.653176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65946ad3-eadf-4746-b18f-4314dac26673 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:38.660764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.685439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.689547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7eb77a1-dac9-4fab-8935-8ad8f2b4da60 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.829067 Oct 04 20:34:38.689547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 366/716] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:38.735866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.738602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:38.752211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.753521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.754944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.757287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.760081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.761444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.859621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65946ad3-eadf-4746-b18f-4314dac26673 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.876215 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65946ad3-eadf-4746-b18f-4314dac26673 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1216 microversion: 2.1 time: 0.236717 Oct 04 20:34:38.877754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 351/717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1216 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:39.181013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:39.199549 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5715250-7cd8-4d4a-9385-e55019e33e67 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.476584 Oct 04 20:34:39.200900 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 367/718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:39.227652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6347a687-9c4e-4058-8211-b6858cb341e3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6b201f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.325698 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6347a687-9c4e-4058-8211-b6858cb341e3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.104927 Oct 04 20:34:39.327658 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 352/719] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:39.531059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.534454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.566408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.567275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.568340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.570159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.571282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.572328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.735588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:39.742005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.743242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.758186 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c85b89b1-806a-46e3-a27a-ec73d0b84375 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1330 microversion: 2.1 time: 0.239235 Oct 04 20:34:39.759873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 368/720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1330 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:39.774124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.778911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.781248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.783154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.802718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.802718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.865302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-plugged", "status": "completed", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:39.889057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.890182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.890807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.916145 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] Creating event network-vif-plugged:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:34:39.924362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a49a2f1e-706c-4382-b577-aa8afd0f2dc6 req-37d478b1-c85c-4441-a932-43d8cbbf5a3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071166 Oct 04 20:34:39.932641 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 369/721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:39.949542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.949542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.988594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.991010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.992686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.994317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.995202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.995996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.286618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.304882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.330871 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-242e5532-679a-4629-86ea-981896dcee87 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1220 microversion: 2.1 time: 0.390041 Oct 04 20:34:40.333393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 370/722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1220 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:40.341478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.353217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:40.353591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.360364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:40.361127 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29a7331a-a606-42bd-8686-cb5dda69e452 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1362 microversion: 2.25 time: 0.622356 Oct 04 20:34:40.370307 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 353/723] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1362 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:40.394414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.396573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac9e2fc3-8293-4a1d-9cbc-e18a57dc9937 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6bcdca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:40.400066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.401667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.403383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.405215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.412100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.506508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac9e2fc3-8293-4a1d-9cbc-e18a57dc9937 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.133012 Oct 04 20:34:40.515143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 354/724] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:40 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:40.801121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.816501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:40.817633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:40.843667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d58bc8b1-0b9b-4b7d-94fb-298d29b0ee3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.502460 Oct 04 20:34:40.843667 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 371/725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:40 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:40.845352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.846311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.847185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.848535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.849409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.850347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.984862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.002116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58d7e09c-90b7-4f9b-8367-78a31a4e95e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1330 microversion: 2.1 time: 0.192523 Oct 04 20:34:41.003312 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 355/726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:40 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:41.384025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.385086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.427262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.438601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.442783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.445204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.445452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.449374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.452636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.455278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.504157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.506962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.515210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.519474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.528402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.530636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.982310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.016446 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47197e13-b59d-4e0e-90e4-b664a479ad71 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1268 microversion: 2.1 time: 0.628165 Oct 04 20:34:42.026727 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 372/727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1268 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.040030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d7f6562-af82-4d29-99e5-9044b8cc0178 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f65c6040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.198178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d7f6562-af82-4d29-99e5-9044b8cc0178 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.178162 Oct 04 20:34:42.199899 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 373/728] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.260613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.276205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.280481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.283692 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97ca164f-1738-45b9-98a3-febeb82e8c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1558 microversion: 2.25 time: 0.881182 Oct 04 20:34:42.300186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 356/729] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1558 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:34:42.314549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.317309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:42.333941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.335840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.340226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.340226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.340226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.341521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.016939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.046855 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c03ba7fd-1d43-475c-895e-79cde63c202f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.747081 Oct 04 20:34:43.047976 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 357/730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:43.067534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.080267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:43.113497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.114572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.118793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.121263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.123095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.126174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.162213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-148579573", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:43.342465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:43.343859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:43.345057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:43.346031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:43.347253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:43.370509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.372160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.374493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.376729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.381406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.381406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.422414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Getting quotas for project b6fbe92b2e1d4746a370e163eb3a8a28. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:43.432800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Getting quotas for user 4b23fda1792f41e3b16873a2c73aa09f and project b6fbe92b2e1d4746a370e163eb3a8a28. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:43.460243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:43.465635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:43.528809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.578878 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffc6d28a-3752-400e-b23b-3f6d47b564ff tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1336 microversion: 2.1 time: 0.519286 Oct 04 20:34:43.603119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 358/731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1336 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:43.806725 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-702221fc-1987-42bd-bcd4-2a6d14f6b3de tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.587873 Oct 04 20:34:43.807933 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 374/732] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:34:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:34:43.841049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.842598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:43.884926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.892557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.894016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.909611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.911083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.917178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.481672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.487937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:44.496842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:44.524133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.527887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.533091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.534996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.539889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.541172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.218134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.235310 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db042e26-8db6-4996-8c8f-e9f4cd5e830b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1274 microversion: 2.1 time: 1.419907 Oct 04 20:34:45.238361 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 375/733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1274 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:45.262157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93614e70-b5c1-4b75-aba2-90a0e10f57b0 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6652c10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.452355 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93614e70-b5c1-4b75-aba2-90a0e10f57b0 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.211481 Oct 04 20:34:45.468234 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 376/734] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:45.484013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.486329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:45.824284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid 28a91c95-59fa-498f-9811-a3e5d072ed89 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:45.889644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.922964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.926120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.994461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efc647fa-9ccb-4656-ae21-90f633a0c1b8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1452 microversion: 2.91 time: 0.523630 Oct 04 20:34:45.995490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 377/735] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1452 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:46.013470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.049648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.054089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c60d2503-5fa5-42e5-94b0-700cdbbea875 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 2053 microversion: 2.25 time: 2.445535 Oct 04 20:34:46.056261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 359/736] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 2053 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:46.073227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.076366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.093874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.096825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.097795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.104372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.104372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.104761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.104927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.106789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.111550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.112940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.113844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.114699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.733542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:46.760593 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65157380-65f3-4b46-961e-67d66808dafe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 0.702258 Oct 04 20:34:46.777608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 360/737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:46.809385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.815641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.832082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.836819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.838171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.840256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.841165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.846363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.907839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:46.943982 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95dd6d4d-0d7c-450d-9801-ec031d70f67c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1503 microversion: 2.1 time: 0.937643 Oct 04 20:34:46.945031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 378/738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1503 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:46.956976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.963246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.970602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:46.991932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.998918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.007272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.012469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.014185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.027458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.287456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.315777 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43a778c6-d849-4c13-968a-4861e34f3fb3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1274 microversion: 2.1 time: 0.368648 Oct 04 20:34:47.318818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 379/739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:47.760285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Action: 'update', calling method: .version_select at 0x7f54f66a7d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:47.980611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=27 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:47.983812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.985105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.997058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.998708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.999587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.005370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.023823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid 28a91c95-59fa-498f-9811-a3e5d072ed89 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:48.036480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:48.074100 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7e035af-153a-479e-aeb6-4a62eb3de6db tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 2053 microversion: 2.25 time: 1.293703 Oct 04 20:34:48.088300 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 361/740] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 2053 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:48.122208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7a688af-164a-40f9-a249-b79ef7788c65 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6b20dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.257222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7a688af-164a-40f9-a249-b79ef7788c65 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.158955 Oct 04 20:34:48.290299 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 362/741] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:48.313058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:48.342031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.342785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.343479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.365718 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] Creating event network-changed:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:34:48.388585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6ded4d07-7511-4d25-a110-e3be89e69326 req-7d2e6cb1-43cd-475a-85ad-b2627172048f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086015 Oct 04 20:34:48.394132 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 363/742] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:48.408763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.410561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.426573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.427391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.429644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.431494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.432549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.433749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.696361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3181a30e-d066-4196-857a-edefd7f76031 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b" status: 200 len: 240 microversion: 2.36 time: 1.372807 Oct 04 20:34:48.713767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 380/743] 10.222.0.36 () {62 vars in 1303 bytes} [Tue Oct 4 20:34:47 2022] PUT /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b => generated 240 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:48.740138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.744252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.775385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.781689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.781689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.781689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.782433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.783142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.783987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.815015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.823630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.849870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1be94c97-f414-4ec6-a5ed-1966a3faea4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1448 microversion: 2.91 time: 0.451562 Oct 04 20:34:48.856051 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 364/744] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1448 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:48.873497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.874731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.900042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:48.907552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.919632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.924743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.924743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.924743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.924743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.506372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.514181 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7878014d-2018-4703-b3b6-31fd0d2883c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 0.798241 Oct 04 20:34:49.555811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 381/745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:49.566652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.575245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.576807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.578134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.581103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.583783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.585568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.594871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.624187 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-777118ee-3d9d-4dcd-8441-34bd96c16417 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1493 microversion: 2.1 time: 0.765832 Oct 04 20:34:49.626578 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 365/746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1493 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:49.637327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.638473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:49.648317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-977fb984-90c7-4c09-b835-0076208fadfc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088409 Oct 04 20:34:49.664024 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 382/747] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:49.670126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Calling method '.version_select at 0x7f54f662cc10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.673790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.674960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.676329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.680638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.682120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.684166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.973920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.977773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.978368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.979316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.981479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.985396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.082911 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-440c0d47-8b97-4146-8cd7-979f7d88e232 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b/detail" status: 200 len: 672 microversion: 2.36 time: 0.427671 Oct 04 20:34:50.088909 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 383/748] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b/detail => generated 672 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:50.100333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cafb6056-8e98-4993-a3ff-ccddd67b2349 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f65dd790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.105358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:50.135695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1c69215-36f0-482f-a621-9adb0efe1a58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.506899 Oct 04 20:34:50.138095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 366/749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:50.150480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7cc9bce-cfa3-49c8-addb-dbeb2b0fa5ad tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '.version_select at 0x7f54f696e0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.161353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7cc9bce-cfa3-49c8-addb-dbeb2b0fa5ad tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.165149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7cc9bce-cfa3-49c8-addb-dbeb2b0fa5ad tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.165149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7cc9bce-cfa3-49c8-addb-dbeb2b0fa5ad tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.216408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7cc9bce-cfa3-49c8-addb-dbeb2b0fa5ad tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1196 microversion: 2.1 time: 0.075682 Oct 04 20:34:50.231577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 367/750] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/os-migrations => generated 1196 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:50.231577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": "auto"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:50.239844 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cafb6056-8e98-4993-a3ff-ccddd67b2349 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.148741 Oct 04 20:34:50.253277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:50.255166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 384/751] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:50.269848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.270871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.272800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.273129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.274142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:50.274334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.275328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.276415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.285988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.287814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.288734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.290250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.290617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.291357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.449717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'flavor' on Instance uuid 28a91c95-59fa-498f-9811-a3e5d072ed89 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:50.564905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:34:50.602917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:50.629184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:50.635865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:50.653195 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3b7e492-f99c-4d9b-8679-615523b09fdf tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1504 microversion: 2.91 time: 0.393898 Oct 04 20:34:50.654453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 385/752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:50.679122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.679122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:50.679122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.679682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.680284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.681512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.682199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.682976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.967215 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43c8bd9a-9176-4f74-9a86-d4eacf5b4546 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 200 len: 1646 microversion: 2.1 time: 0.310391 Oct 04 20:34:50.972876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 386/753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 1646 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:50.991854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.993611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.006518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.008374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.009875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.011632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.013562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.014911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.028789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:51.378916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.394824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-14b4fd9a-eabd-4d63-8b5b-8254cb3fa70b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 0.424503 Oct 04 20:34:51.398278 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 387/754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:51.413424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Action: 'update', calling method: .version_select at 0x7f54f65d4790>, body: {"quota_set": {"ram": "2048"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:51.619081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.620189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.620868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.622380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.623453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.624498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.649204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:51.691551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.692052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.692680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.693619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.694165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.694690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.143022 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87dce168-779d-4369-a316-0a42e26f21b9 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b?user_id=94d50535089f4860b769ae56f57b7075" status: 200 len: 240 microversion: 2.36 time: 0.741900 Oct 04 20:34:52.153239 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 388/755] 10.222.0.36 () {62 vars in 1384 bytes} [Tue Oct 4 20:34:51 2022] PUT /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b?user_id=94d50535089f4860b769ae56f57b7075 => generated 240 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:52.168408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.171683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:52.183011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.183824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.184618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.186815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.188469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.189314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.894370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:52.925548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-527f6099-1a18-4be5-8ee5-2356c2be40f6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.770034 Oct 04 20:34:52.937699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 389/756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:52 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:52.950635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f491ffa0-1bbd-45bc-b835-f3da9c033d30 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f662cd30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.108536 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f491ffa0-1bbd-45bc-b835-f3da9c033d30 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.174887 Oct 04 20:34:53.109836 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 390/757] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:52 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.121945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1206820555", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "d4133c60-0102-48e4-be66-6bf5189f9cc1"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:53.327542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] validate_networks() for [('d4133c60-0102-48e4-be66-6bf5189f9cc1', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:54.959217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:54.963687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:54.963687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:54.963687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:54.963687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:54.984522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.987117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.988237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.990959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.992013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.992940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:55.042379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:55.055683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for user 44a42dd2dd73439bbe445de3b2eb9744 and project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:55.090321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:55.095269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:55.634639 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e6086bf-8be4-4b10-adcf-2141d4b680e7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522501 Oct 04 20:34:55.636103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 391/758] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:55.656194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:55.660783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:55.671679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:55.672900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:55.674257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:55.675966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:55.677228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:55.678720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:55.837903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:55.859888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:55.863772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:55.875705 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eed12e37-23f1-4d80-af76-47f9cf8d8ff9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1510 microversion: 2.91 time: 0.237373 Oct 04 20:34:55.877316 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 392/759] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:55 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:55.888935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-147ebff1-b38d-48e0-bdec-2afd62df85c4 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] Calling method '.version_select at 0x7f54f665e430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.045349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-147ebff1-b38d-48e0-bdec-2afd62df85c4 tempest-QuotasAdminTestV236-850507250 tempest-QuotasAdminTestV236-850507250-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b?user_id=94d50535089f4860b769ae56f57b7075" status: 200 len: 282 microversion: 2.36 time: 0.164900 Oct 04 20:34:56.046860 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 393/760] 10.222.0.36 () {60 vars in 1364 bytes} [Tue Oct 4 20:34:55 2022] GET /compute/v2.1/os-quota-sets/f9253fba3a8543068d8a058510ccee5b?user_id=94d50535089f4860b769ae56f57b7075 => generated 282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:56.057762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.064743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.077887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.078813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.079853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.080988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.081772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.082653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.622862 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04f40355-a457-4ff2-a889-3c5fbc81effb tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89/action" status: 202 len: 0 microversion: 2.25 time: 6.401193 Oct 04 20:34:56.631488 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 368/761] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:34:50 2022] POST /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89/action => generated 0 bytes in 6405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:56.645812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.659288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.679159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.682367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.683375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.692835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.694171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.695229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.848404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.894785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2c789c7-a7d3-4fe8-8836-a6197d805e64 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 0.827384 Oct 04 20:34:56.894785 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 394/762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:56.894785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cdd8063c-160f-467d-8a31-f0936e77c27b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f69d1dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.003357 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cdd8063c-160f-467d-8a31-f0936e77c27b tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.124375 Oct 04 20:34:57.007848 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 395/763] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.036479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7", "tag": "b4d9bf17-aed8-4190-ae8e-d3e0779f0372"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:57.083278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.084864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.085385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.136213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] Creating event network-changed:b4d9bf17-aed8-4190-ae8e-d3e0779f0372 for instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 on n-h1-851029-13 Oct 04 20:34:57.154036 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ba9e86d7-44ca-4b4c-8375-95674bdb9aeb req-f00d47cf-a6fa-456f-89dc-c64284dc9d11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128793 Oct 04 20:34:57.163965 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 396/764] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:57.180055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5dadb83-28f7-481e-8500-6f23e0b3c886 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.187825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5dadb83-28f7-481e-8500-6f23e0b3c886 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.190500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.203163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aec3f0ac-bb44-4559-9865-c416c925ea4a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.575955 Oct 04 20:34:57.225783 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 369/765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.246190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.255634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.284492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.285404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.285934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.287653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.288311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.288965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.348009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5dadb83-28f7-481e-8500-6f23e0b3c886 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.394005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5dadb83-28f7-481e-8500-6f23e0b3c886 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1211 microversion: 2.1 time: 0.229146 Oct 04 20:34:57.396768 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 397/766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1211 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.409162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.410729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.425503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.426948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.428128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.429804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.431153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.432299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.711984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.735518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.739445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.752056 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f09e965-10fa-4900-8412-cfa84bc57a45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1510 microversion: 2.91 time: 0.350999 Oct 04 20:34:57.754102 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 398/767] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:57.764504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-plugged", "status": "completed", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:57.791923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.793639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.794865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.828508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] Creating event network-vif-plugged:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:34:57.843003 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-69a2ed14-e0de-4722-9269-276e6a466ef8 req-347c5f6d-ee27-498e-b03e-d620cc19c8be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082394 Oct 04 20:34:57.845021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 399/768] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:57.879765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.937736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.940489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.943449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.969080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.986222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10546a20-90c7-4c61-bf89-6b8b4c7b78a1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.744142 Oct 04 20:34:57.992102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.997552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.998894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.001968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.004683 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 370/769] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:58.014562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.015908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.045186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90b3cdc4-7608-44f6-bce2-cb8f28cfe934 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f696e0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.228706 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90b3cdc4-7608-44f6-bce2-cb8f28cfe934 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.204486 Oct 04 20:34:58.235871 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 371/770] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:58.271041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.274701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:58.296828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.297719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.298509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.300791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.301973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.303490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.289175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.315988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-576ef18b-35b2-45de-9942-497dae22551e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 1.052897 Oct 04 20:34:59.317289 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 372/771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.321719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.336997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.341157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.354035 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ff25656-e498-411e-a18b-f851e7f97e3e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 1.436574 Oct 04 20:34:59.356450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.357864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.358166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 400/772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.360188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.361945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.363021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.363742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.379443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.384062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.402172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.403841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.404843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.406503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.407311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.408108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.497435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.517297 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3e1045c-8ad7-40b8-9710-e235baedeb53 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1263 microversion: 2.1 time: 0.196836 Oct 04 20:34:59.518509 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 373/773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1263 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.525052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.526413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.550455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.551931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.554039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.555243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.556053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.557301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.578375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.594483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.599347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.607868 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33dfa53e-e96d-4fca-8b1d-f2b2e66a3f10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1510 microversion: 2.91 time: 0.240907 Oct 04 20:34:59.609494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 401/774] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:59.620499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4543787-d25f-447e-8d7c-1ac3307c20de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6794160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.752061 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4543787-d25f-447e-8d7c-1ac3307c20de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.139906 Oct 04 20:34:59.769100 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 402/775] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:00.073702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.087772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.091667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.094555 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d2c0ddf-2906-4a53-a451-b6fd355aa8b5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.574716 Oct 04 20:35:00.095958 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 374/776] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:00.373410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.375795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.397517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.403683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.409032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.413807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.415348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.421011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.422471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.429630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.434560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.436179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.438115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.447643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.449202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.450510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.445219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.479290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd463106-b29a-4d1b-a76b-cbe16cfb2d86 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 1.115490 Oct 04 20:35:01.485032 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 403/777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.517071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.518482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.555479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.556858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.559397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.561700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.566075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.569292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.574117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.588153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f14764af-785f-4f1a-95ab-5dfe0adfa994 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1378 microversion: 2.1 time: 1.196870 Oct 04 20:35:01.595813 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 375/778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1378 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:01.645527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.676017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.745526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.752632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.757182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.760806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.763769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.768210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.916030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.935879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10a85a76-e6db-4bf0-b3a7-217ba6355b29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1281 microversion: 2.1 time: 0.446306 Oct 04 20:35:01.951161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 404/779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.951161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdde67a8-008a-488c-b173-2b470837c716 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6806dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.044557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.095239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.101840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.126758 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67bff912-f111-4411-8749-e2a7f0c6cf54 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1531 microversion: 2.91 time: 0.520557 Oct 04 20:35:02.132688 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 376/780] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1531 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:02.135762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdde67a8-008a-488c-b173-2b470837c716 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.195113 Oct 04 20:35:02.144827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.153533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.160054 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 405/781] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:02.185559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.187058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.188273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.190973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.195655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.198166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.966746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.971330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.996372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.998988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.003464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.006987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.013572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.015178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.200770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.231676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.235454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.238533 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-690500c0-5b54-481e-bd43-be21d9c24eb4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 1.103606 Oct 04 20:35:03.240554 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 377/782] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:03.249730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.250846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.263524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.264801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.265943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.267691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.268893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.270060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.392953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lazy-loading 'services' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:03.604211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31d23969-3ea6-4a0f-b65d-aca8948c9892 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1938 microversion: 2.91 time: 1.409399 Oct 04 20:35:03.620807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 406/783] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1938 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:03.665742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.666641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.675591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.678496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.679895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.682414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.684419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.685101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.479766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:04.523452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58c3d5eb-355c-4ae4-b863-57a2033210c2 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 1.280284 Oct 04 20:35:04.540151 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 378/784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:04.567909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.569737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.590466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.591815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.594371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.598820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.600600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.601452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.639170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:04.664137 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d968831-f9cc-4911-8b90-1bef98d0cefd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1528 microversion: 2.1 time: 1.040063 Oct 04 20:35:04.665236 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 407/785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1528 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:04.709859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41512a00-f56f-4ad2-ab2f-d1f3ace66e6d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6c13820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.859975 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41512a00-f56f-4ad2-ab2f-d1f3ace66e6d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.178966 Oct 04 20:35:04.868702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 408/786] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:04.879978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.889403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.938577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.941502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.945648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.947380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.950602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.952971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.018620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:05.276266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lazy-loading 'services' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:05.374435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0140f7a5-baa2-477b-a3c2-4697b1ca768a tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1938 microversion: 2.91 time: 0.503130 Oct 04 20:35:05.377824 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 409/787] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1938 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:05.425750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.429888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.454391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.455624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.456727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.459009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.460185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.461204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.547493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.563062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:05.591977 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a023c794-9cf3-45a6-b07c-0eeb6815e325 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 1.033110 Oct 04 20:35:05.594261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 379/788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:05.607437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.622697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.653205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.656029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.658774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.663362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.666572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.673867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.450951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.472269 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6a11383-2ae4-4849-88c8-e3b45cb02e67 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1528 microversion: 2.1 time: 0.875304 Oct 04 20:35:06.487494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 380/789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1528 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.515199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.522696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.523914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.524943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.526637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.527743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.528698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.593441 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-801f5428-e4b1-4b1c-9617-71121a29a989 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.103783 Oct 04 20:35:06.595650 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 381/790] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:35:06.604957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a91c95-59fa-498f-9811-a3e5d072ed89", "name": "network-vif-unplugged", "status": "completed", "tag": "566d8a68-cd52-485f-aea0-d2499f8e2741"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:06.623405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.624585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.625576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.650137 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] Creating event network-vif-unplugged:566d8a68-cd52-485f-aea0-d2499f8e2741 for instance 28a91c95-59fa-498f-9811-a3e5d072ed89 on n-h2-851029-13 Oct 04 20:35:06.665017 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3f185779-8188-4cd8-8453-6097a40eb600 req-068b8b07-243c-4742-91a3-1fadf6320c93 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066441 Oct 04 20:35:06.666833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 382/791] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:06.676847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.678219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.680001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.692209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.699623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.699623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.699623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.699623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.700888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.715475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.727790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.734494 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f270835-bbbf-4928-91ae-66907814057d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 1.335089 Oct 04 20:35:06.737710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 410/792] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:06.756843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b19d4c4d-f88f-4e72-b9f2-4e323de8cd73 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f653d670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.919542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b19d4c4d-f88f-4e72-b9f2-4e323de8cd73 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.177343 Oct 04 20:35:06.923008 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 411/793] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.933069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875089be-27da-4346-9b00-9dbf9e0c29db", "tag": "16698709-0ed6-4fc5-b6f6-032962863637"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:06.959446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.960893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.963222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.000014 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] Creating event network-changed:16698709-0ed6-4fc5-b6f6-032962863637 for instance 875089be-27da-4346-9b00-9dbf9e0c29db on n-h2-851029-13 Oct 04 20:35:07.015505 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5c36359a-d6c5-4522-96b3-faa7fcd0ac3f req-cbaf3b94-4194-4e3b-aeb6-5d5d470eb1b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088363 Oct 04 20:35:07.018196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 412/794] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:07.030037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59d7c221-bd28-44e8-82ff-a05ed2f44860 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:07.197998 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59d7c221-bd28-44e8-82ff-a05ed2f44860 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/cd8dfbed-021b-4a86-b724-2018457d1200" status: 202 len: 0 microversion: 2.1 time: 0.176636 Oct 04 20:35:07.200069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 413/795] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:07 2022] DELETE /compute/v2.1/flavors/cd8dfbed-021b-4a86-b724-2018457d1200 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:07.223927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:07.225145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:07.247009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.248570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.249494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.251181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.252154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.252967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.260759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.296455 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6f21591-5009-43ab-b662-f0aa91d5b9af tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.626823 Oct 04 20:35:07.299277 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 383/796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:07.329076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:07.336535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:07.348424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.349755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.350867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.353546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lazy-loading 'flavor' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:07.363742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.366247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.371671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.497527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=33 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:07.743512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:08.043129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.057053 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ff1c400-f6c8-4ff0-aa70-eea3a309439d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 0.751446 Oct 04 20:35:08.071461 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 384/797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:07 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:08.101961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1d196a6-3faa-4e50-83dc-e0f747df9c3e tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.149178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1d196a6-3faa-4e50-83dc-e0f747df9c3e tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.076060 Oct 04 20:35:08.150934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 385/798] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:08.164112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.165694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.182534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.184514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.199386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.199386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.199386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.200541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.663055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.678238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.680249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.681700 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51ef477f-5a2d-4641-b5e7-cd20f9f4b098 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.528908 Oct 04 20:35:08.692415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 386/799] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:08.692415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7ab4933-e8bc-4b6f-9f6c-b8d7d3f8218a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f653dd30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.385565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9ec2269-cf89-4999-a2d4-d669af9bce08 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action" status: 202 len: 0 microversion: 2.91 time: 2.184111 Oct 04 20:35:09.407011 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 414/800] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:35:07 2022] POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action => generated 0 bytes in 2207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:09.438112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:09.444826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.460614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.461571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.462428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.463277 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7ab4933-e8bc-4b6f-9f6c-b8d7d3f8218a tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.777087 Oct 04 20:35:09.464093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.464949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.479658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.481357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 387/801] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.487941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.489706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.545602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.546760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.547738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.548778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.549756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.550560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.905370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.921206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Old instance type tempest-test_resize_flavor_-1581476126, new instance type m1.heat {{(pid=123541) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:35:09.937204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:09.938367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:09.940216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:09.941578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:09.942943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:09.950501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:10.103533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:10.136782 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cdcedd6f-a71d-4fa8-8433-a3a143dad976 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.667258 Oct 04 20:35:10.153828 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 388/802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:10.191426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a91c95-59fa-498f-9811-a3e5d072ed89", "tag": "566d8a68-cd52-485f-aea0-d2499f8e2741"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:10.214110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.227360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.234296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.269888 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] Creating event network-changed:566d8a68-cd52-485f-aea0-d2499f8e2741 for instance 28a91c95-59fa-498f-9811-a3e5d072ed89 on n-h2-851029-13 Oct 04 20:35:10.285140 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-13071cc2-97e7-4f37-93cc-ae52f2775c0e req-26df0830-dcad-4c12-88c3-7dc191ea0e95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119369 Oct 04 20:35:10.286337 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 389/803] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:10.297490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:10.299413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:10.319643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.320568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.321487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.327560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.328778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.329391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.598476 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-becd0f36-5540-42e2-9be5-095bf59cec52 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003/action" status: 202 len: 0 microversion: 2.1 time: 1.163708 Oct 04 20:35:10.599798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 415/804] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:09 2022] POST /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003/action => generated 0 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:10.645285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:10.659064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:10.709293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.731033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.731033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.731033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.731033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.731595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.088009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.147648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.161510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.184464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abc7b947-5aba-47c0-b8b1-d31e2815cb07 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.563500 Oct 04 20:35:11.187111 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 416/805] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:10 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:11.218739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.221865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.257173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.264187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.267525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.268089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.269518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.271713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.273203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.295136 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7fea8f3-d89b-4d03-9545-037ee670b4a9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 1.006353 Oct 04 20:35:11.296428 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 390/806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:10 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.316265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7dad030d-6173-4ff3-84c0-0f0683d94347 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f653d3a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.535730 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7dad030d-6173-4ff3-84c0-0f0683d94347 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.235162 Oct 04 20:35:11.536908 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 391/807] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.579387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.580678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.654435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.655861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.656306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.657727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.658596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.671448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.734573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.764521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.775196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.775196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c031c130-9f93-4174-83fc-eec7941765cd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.583094 Oct 04 20:35:11.775196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 417/808] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:11.784752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7", "name": "network-vif-plugged", "status": "completed", "tag": "b4d9bf17-aed8-4190-ae8e-d3e0779f0372"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:11.806391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.807633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.808937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.858204 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] Creating event network-vif-plugged:b4d9bf17-aed8-4190-ae8e-d3e0779f0372 for instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 on n-h1-851029-13 Oct 04 20:35:11.879281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fdce8d31-a4be-42b5-b8d0-39cbb2855eac req-a9ed7568-37c4-488a-826c-75ace3dd0742 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092680 Oct 04 20:35:11.879281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 418/809] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:11.884801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.886167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.943338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.956036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.958277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.960129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.961272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.962314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.109706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.137011 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c9fa30d-ff30-4d82-91ed-ac2f2e023325 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1537 microversion: 2.1 time: 0.598166 Oct 04 20:35:12.142565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 392/810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1537 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:12.648864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.656940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.657995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.658818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.660351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.661631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.662445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.699675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.719452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e77ba487-64a5-4ae3-97d6-0d55a96d3687 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.842265 Oct 04 20:35:12.721523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 419/811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:12.728558 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c41dd59-0fb0-490c-b41b-cb88eba4cde7 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.583363 Oct 04 20:35:12.740134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 393/812] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:12.741987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.744453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:12.759281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.759281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:12.760284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.760284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.762157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.766721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.767011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.767300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.771494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.771494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.771494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.772792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.773517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.779612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.905124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.924983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.928512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.941996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eed4d347-f4ad-4f49-9e91-fea7a5602bd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.213703 Oct 04 20:35:12.957235 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 420/813] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:12.986837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-faa77bf5-d22d-45a5-a65a-d20ecc0b03bc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f662c700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.080090 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-faa77bf5-d22d-45a5-a65a-d20ecc0b03bc tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1429 microversion: 2.1 time: 0.120164 Oct 04 20:35:13.081032 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 421/814] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:13.093351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.096316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:13.096863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.097754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.100810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.103107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.103680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.104468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.115581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50346972-0922-40d7-ad4b-95f34f9e37a3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 0.382649 Oct 04 20:35:13.137583 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 394/815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:13.158940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.160587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.167788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22ee0def-0340-4154-8c5e-06635ba7e541 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-851029-13" status: 200 len: 581 microversion: 2.1 time: 0.084055 Oct 04 20:35:13.169277 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 422/816] 10.222.0.36 () {58 vars in 1174 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/os-services?host=n-d-851029-13 => generated 581 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:13.180849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.196722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.196722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.196722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.196722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.197396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.197781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.212924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.214391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.215521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.217435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.218279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.219989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.277547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30af5a2c-1591-4f7f-9330-7d81b7eff4d2 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.093010 Oct 04 20:35:13.277547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 423/817] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:13.285037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.286178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.295694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.296651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.297390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.298377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.299306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.300325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.530107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:13.548061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:13.552223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:13.584877 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a62db42-40b7-4c15-9dbb-4af07d879a2f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.439531 Oct 04 20:35:13.586450 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 395/818] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:13.607630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.615957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.617320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.618403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.620434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.621683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.622736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.650584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:13.671465 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d667c431-50dc-4ff7-ab4e-bacaba5c1a95 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1537 microversion: 2.1 time: 0.391901 Oct 04 20:35:13.688175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 424/819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1537 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:13.701845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d6f3135-1993-4cd3-811b-273d01fae989 tempest-ServicesAdminTestJSON-611448534 tempest-ServicesAdminTestJSON-611448534-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.113008 Oct 04 20:35:13.703884 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 396/820] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/os-services => generated 949 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:13.771576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.772893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.788364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.789290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.789890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.790838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.791494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.792179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.986345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.988083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.004942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.007637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.008884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.010921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.011457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.012399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.120907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.137816 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0e26965d-812d-40c8-bbc5-8648a893178e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1316 microversion: 2.1 time: 0.376574 Oct 04 20:35:14.151831 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 425/821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.154525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.174740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875089be-27da-4346-9b00-9dbf9e0c29db", "name": "network-vif-plugged", "status": "completed", "tag": "16698709-0ed6-4fc5-b6f6-032962863637"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:14.190441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.191375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.194874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.197966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.201936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.213991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21623353-454a-4c09-af9e-f2aa32e2c709 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.235056 Oct 04 20:35:14.217221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] Creating event network-vif-plugged:16698709-0ed6-4fc5-b6f6-032962863637 for instance 875089be-27da-4346-9b00-9dbf9e0c29db on n-h2-851029-13 Oct 04 20:35:14.227832 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 397/822] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:14.228206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-396c3b2a-fed2-444b-955f-74e465e77d0a req-386a8baf-9bfb-4321-98e2-8023eb8dc17f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086587 Oct 04 20:35:14.229747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 426/823] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:14.252169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.253243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c833a3c-f0ce-4950-99b3-2a7f51e3239c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6568430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.253592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.280707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.281357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.282186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.284083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.284995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.285792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.375082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c833a3c-f0ce-4950-99b3-2a7f51e3239c tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1438 microversion: 2.1 time: 0.142292 Oct 04 20:35:14.376371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 398/824] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.407408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53c0c095-0ebe-4b3f-9356-43d8b002e992 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f6b20ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.537901 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53c0c095-0ebe-4b3f-9356-43d8b002e992 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 200 len: 1438 microversion: 2.1 time: 0.138911 Oct 04 20:35:14.541284 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 399/825] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 1438 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.584043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.585734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.602200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.603633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.604783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.606910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.608031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.609086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.641075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.663325 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04c80cd0-86f3-419f-bab8-e827588b190b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 0.430605 Oct 04 20:35:14.664847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 427/826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.675347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.676341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.688931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.690179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.691021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.693133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.694077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.694984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.137471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.142723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.157717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad45fc7d-c260-444e-a5f9-6b2da53495af tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1479 microversion: 2.1 time: 0.595416 Oct 04 20:35:15.158963 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 400/827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1479 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:15.159406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.163884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.167150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31df4880-c0fd-4236-8a6a-89532bca9f26 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.500229 Oct 04 20:35:15.169092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 428/828] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:15.175542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.177771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.183619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=84 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:15.197124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.198619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.200887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.202703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.204047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.205241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.210053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.211408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.222454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.223540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.224831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.226247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.227187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.227973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.566587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.581506 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d3e31669-72c6-4ccc-8e3d-37b75ab1fa05 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1466 microversion: 2.1 time: 0.396672 Oct 04 20:35:15.585173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 429/829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1466 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:15.595026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.596575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.597227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.610109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.611761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.613424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.615393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.616833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.617202 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72772cc3-7662-4447-af4d-9f89b419abe8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1537 microversion: 2.1 time: 0.454101 Oct 04 20:35:15.618505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.625563 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 401/830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1537 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:15.644880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.646790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.661273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.662368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.662992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.664797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.665994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.666918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.764364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.789869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.793381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.804490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a119853-54c8-4cc9-a0f4-bb26c4fc634d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.216852 Oct 04 20:35:15.805589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 430/831] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:15.815281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.826890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.829553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.830558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.831481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.833527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.834493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.835399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.094646 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db386e98-3948-4b9d-9850-173430b46a4c tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1619 microversion: 2.1 time: 0.458307 Oct 04 20:35:16.096239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 402/832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1619 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.215234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.220362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.225881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.242192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.246182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.247081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.248452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.249635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.250454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.270956 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38e2696d-f46e-4438-bf14-bf4143a93115 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1311 microversion: 2.1 time: 0.461476 Oct 04 20:35:16.272674 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 431/833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1311 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.315633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.317784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.349755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.351100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.352096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.353712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.355176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.366641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.390831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:16.802091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.828012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cba9b4f6-a12f-4b18-bcfe-76841cd40c51 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1466 microversion: 2.1 time: 0.626013 Oct 04 20:35:16.835858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 403/834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1466 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.840362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2125557967", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["17ea1f23-cdc1-4fac-b05e-46c2bfeaac78"]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:16.923309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.943721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.946903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.949621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1854e56-9614-46e3-92dc-af6a0a39015b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.674836 Oct 04 20:35:16.964763 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 432/835] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:16.966921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:16.979018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.980623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.996364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.001027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.001027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.003005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.004659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.006976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.755173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:17.813793 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-081053ce-09d9-4d9a-abe6-e74d0ae25e76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1537 microversion: 2.1 time: 0.843176 Oct 04 20:35:17.815578 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 433/836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1537 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:17.837000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.838748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:17.852487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.853722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.855425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.861516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.861516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.861516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.469852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:18.469852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:18.469852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:18.471552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:18.471552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:18.493230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.519192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.520123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.521431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.522938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.523786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.524599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.539198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.545758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.558284 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-27bf7a5b-f9a4-454f-afdd-def29bc8ab8b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.738980 Oct 04 20:35:18.561320 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 434/837] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:18.574556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91510893-b4f6-495c-bba8-2e9ca1799dcb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f67949d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.616208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:18.635528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:18.681667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:18.686167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:18.994600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74f6920f-7e63-48fa-a02d-563e4c51851e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162805 Oct 04 20:35:18.996277 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 404/838] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:19.028416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:19.031787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.187225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.187225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.187225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.187225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.189404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.189404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.189404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:19.713282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:19.736130 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70b54e21-3eaa-4ba2-a254-1e41ca0aba28 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1494 microversion: 2.1 time: 0.737278 Oct 04 20:35:19.737658 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 405/839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1494 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:19.748695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:19.750568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.765474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.767223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.768399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.770478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.773236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.774534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.096806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.123049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.127584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.130701 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73650848-f35b-4d1c-83de-fa42ea9733d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.389937 Oct 04 20:35:20.132313 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 406/840] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:19 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:20.141912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-unplugged", "status": "completed", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:20.160328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.161928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.162637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.187380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] Creating event network-vif-unplugged:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:35:20.202104 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-52955910-9b5f-4cb1-abc3-8180f823eef0 req-cde51906-83a2-41c3-824e-625abb969148 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066541 Oct 04 20:35:20.203269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 407/841] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:20.216392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.218892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.241372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.242696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.244053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.245785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.246793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.247384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.682352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.700327 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-978595b9-f93d-40d7-8b30-1807a12e23cf tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1537 microversion: 2.1 time: 0.494655 Oct 04 20:35:20.701506 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 408/842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1537 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.711847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7001e55a-f5be-4b68-b481-18a1f878de58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.713482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7001e55a-f5be-4b68-b481-18a1f878de58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.904062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7001e55a-f5be-4b68-b481-18a1f878de58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.925907 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7001e55a-f5be-4b68-b481-18a1f878de58 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1217 microversion: 2.1 time: 0.221977 Oct 04 20:35:20.927557 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 409/843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.937604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.939190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.953109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.954597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.955298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.956941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.958480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.959324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.190858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:21.211736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:21.215455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:21.233302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ce4b70e-510f-4f6e-a266-2f695e81997c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.302076 Oct 04 20:35:21.234620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 410/844] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:21.258004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:21.258004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.275474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.276565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.277475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.279258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.280300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.281107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.765047 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-456199df-57ab-430d-99ed-8a68e9e8a323 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1647 microversion: 2.1 time: 0.527956 Oct 04 20:35:21.766415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 411/845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:21 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1647 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:21.776137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:21.777156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.790870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.792823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.794184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.796866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.798157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.798810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.089238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91510893-b4f6-495c-bba8-2e9ca1799dcb tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "DELETE /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729" status: 204 len: 0 microversion: 2.1 time: 3.524503 Oct 04 20:35:22.090950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 435/846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] DELETE /compute/v2.1/images/936b68ae-28bf-4c42-9740-d9fe1267b729 => generated 0 bytes in 3528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:22.098927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.100682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.118840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.119741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.120748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.122133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.123070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.123903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.171785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.195681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.199605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.203089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f69659e8-f084-47f9-9447-764b870c2c36 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.433934 Oct 04 20:35:22.205052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 412/847] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:21 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:22.240560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.248590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.261180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.262103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.263000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.264996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.266149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.267297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.563541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.585850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd02b461-74dc-43f9-8ed6-d00efa7e3a19 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.487468 Oct 04 20:35:22.585850 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 436/848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.591196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.592058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.601221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.602138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.603241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.604996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.606279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.607099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.637567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e3ae2b1-341d-4a83-9663-bb840abef5a1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1647 microversion: 2.1 time: 0.429606 Oct 04 20:35:22.639095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 413/849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1647 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.647812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a74c0db-0645-4f40-8248-7f16ec9744de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '.version_select at 0x7f54f654ba60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.720453 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7a74c0db-0645-4f40-8248-7f16ec9744de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] HTTP exception thrown: Image not found. Oct 04 20:35:22.724784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a74c0db-0645-4f40-8248-7f16ec9744de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Request method failure captured: Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 HTTP/1.1 Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhV0fkY2Rrs6V8wAISWocB5lGptuWWPgtE3je4GcQjV-IhlopbDNurWvoQsXINOUfO3_wTcwjr2-JvctkW4M1NDg2Ng2WRJCBJY8K-0WcCwIsPHlDiBq0inMcFwPS4YlWaX73bo1EpubL03joxp2iuPd18dAZrtGCQHC-Pqp-Q-4No Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 239f887a70154739880d4022f58e210b Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:35:22.726853 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/239f887a70154739880d4022f58e210b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_239f887a70154739880d4022f58e210b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 239f887a70154739880d4022f58e210b Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: db3e20ac90ba4e129c24328a2f0a7d40 Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5'} Oct 04 20:35:22.729803 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 to delete Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.732012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 could not be found. Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:22.734691 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a74c0db-0645-4f40-8248-7f16ec9744de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:22.743871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a74c0db-0645-4f40-8248-7f16ec9744de tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "DELETE /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5" status: 404 len: 62 microversion: 2.1 time: 0.096776 Oct 04 20:35:22.746034 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 414/850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] DELETE /compute/v2.1/images/4c9f741a-1b7e-4bd1-9d0a-585b96bf82b5 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:22.747616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0284a39-34f0-4e83-b69a-6a2b9e774a91 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1269 microversion: 2.1 time: 0.160391 Oct 04 20:35:22.759421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 437/851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.760044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.760044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.760355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.767105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.768537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.769400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.770949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.772072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.772887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.776054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.794728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.795778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.800646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.802418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.809448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.843023 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9f03cef-7fe4-4e49-b562-2be515bd517a tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.086165 Oct 04 20:35:22.843023 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 438/852] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:22.857339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.858146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.875484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.876373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.877081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.878455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.880079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.880846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.938498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:22.986786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.005222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.009068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.019840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-efac16b8-0a18-4125-8ecf-2e7fcb97fb26 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.274969 Oct 04 20:35:23.021829 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 415/853] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:23.033054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:23.034445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.051954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.055614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.055614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.055614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.058368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.059577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.439274 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96540e6d-86d9-4409-b734-b5dfa99988c5 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db/action" status: 202 len: 0 microversion: 2.1 time: 0.414701 Oct 04 20:35:23.440890 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 416/854] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:23 2022] POST /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:23.452225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.453787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.466651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.474347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.474560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-072ab1dd-6f63-41a7-ba25-f8ce7a35f4d3 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 204 len: 0 microversion: 2.1 time: 0.627007 Oct 04 20:35:23.475272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.475427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 439/855] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:22 2022] DELETE /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:23.475567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.475567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.475567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.772294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6826dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:23.777944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.778992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.778992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.779348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.795315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.795667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.798061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.798061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.798928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.801438 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ee2a000-09ef-48cc-bb0a-d294b5e0ec73 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1568 microversion: 2.25 time: 0.358014 Oct 04 20:35:23.804077 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 417/856] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:23.814423 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] HTTP exception thrown: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:23.822582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.824476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Request method failure captured: Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d HTTP/1.1 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 56 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJkLBryzXsWDSSzdKSKo-QN9D5zD8z6Gzeks_fo_d5iwUg3ZXQhDTuRsbDpzor2ufcXm_HkbdjGR5U9_kDYl1I7dWBdTKQuExysolnsc8z61Sz_EMSWam1pRo5CdrgU8BCTs0SPyJGpTr013Qwk9YVF44bjMHVjHATaMeiCv-ceCRbU Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:35:23.827629 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b45cc495678048a688866dddd4159477 Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:35:23.836383 n-d-851029-13 devstack@n-api.service[123541]: exception: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a17afad8-24af-4779-b17e-6415e9d04d7d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.839385 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:23.845436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Returning 404 to user: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b4c854c-ddb4-4e77-ac14-d639f65a27c0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d" status: 404 len: 110 microversion: 2.53 time: 0.362953 Oct 04 20:35:23.847968 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 440/857] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:23 2022] PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d => generated 110 bytes in 368 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:23.851409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.852802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.853254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.854399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.855654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.857440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.858450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.859662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.864667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.867068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.867068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.867683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.868511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.869228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.172128 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6321bfea-f5be-4e3b-b457-61141d955b98 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1652 microversion: 2.1 time: 0.365886 Oct 04 20:35:24.172868 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 418/858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1652 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.174467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.181444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.182568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.188985 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0900ac2a-9506-4e55-965f-50388810bc0d tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1472 microversion: 2.1 time: 0.348668 Oct 04 20:35:24.190011 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 441/859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.205468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.205468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.205468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.205468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.206063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.206063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.213832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.214963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.223403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.224104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.224676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.225833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.226423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.227122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.369772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.385781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac4257da-51e6-4987-b1b3-509aa38ee116 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1277 microversion: 2.1 time: 0.176862 Oct 04 20:35:24.386930 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 442/860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.406288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Action: 'update', calling method: .version_select at 0x7f54f6b5ab80>, body: {"status": "disabled"} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:24.413957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.414896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.415710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.429964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.431176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.432000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.443689 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] HTTP exception thrown: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Request method failure captured: Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d HTTP/1.1 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 22 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJkLBryzXsWDSSzdKSKo-QN9D5zD8z6Gzeks_fo_d5iwUg3ZXQhDTuRsbDpzor2ufcXm_HkbdjGR5U9_kDYl1I7dWBdTKQuExysolnsc8z61Sz_EMSWam1pRo5CdrgU8BCTs0SPyJGpTr013Qwk9YVF44bjMHVjHATaMeiCv-ceCRbU Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:35:24.447234 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b45cc495678048a688866dddd4159477 Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: {"status": "disabled"} Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: exception: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.450311 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a17afad8-24af-4779-b17e-6415e9d04d7d', 'body': {'status': 'disabled'}} Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.459713 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:24.462624 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Returning 404 to user: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-759d9714-7ce6-4a6e-a9d1-7075cb2bf38a tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d" status: 404 len: 110 microversion: 2.53 time: 0.061305 Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 443/861] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:24 2022] PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:24.466298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.467355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.475591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.476642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.477289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.478585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.479484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.480276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.513544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.529296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f64ccc85-5134-48ea-8fcf-d83d44f7ea7d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.354414 Oct 04 20:35:24.530458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 419/862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.540193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Action: 'update', calling method: .version_select at 0x7f54f65688b0>, body: {"status": "enabled"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:24.547814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.548718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.549659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.571950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.572811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.573595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.588193 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] HTTP exception thrown: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Request method failure captured: Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d HTTP/1.1 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 21 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJkLBryzXsWDSSzdKSKo-QN9D5zD8z6Gzeks_fo_d5iwUg3ZXQhDTuRsbDpzor2ufcXm_HkbdjGR5U9_kDYl1I7dWBdTKQuExysolnsc8z61Sz_EMSWam1pRo5CdrgU8BCTs0SPyJGpTr013Qwk9YVF44bjMHVjHATaMeiCv-ceCRbU Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:35:24.592608 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0ff2c30a61bc41e980251408daf0964b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0ff2c30a61bc41e980251408daf0964b Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335 Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b45cc495678048a688866dddd4159477 Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: {"status": "enabled"} Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: exception: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.595442 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a17afad8-24af-4779-b17e-6415e9d04d7d', 'body': {'status': 'enabled'}} Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.597175 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:24.600093 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:24.602486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. Oct 04 20:35:24.602486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:24.602486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Returning 404 to user: Service a17afad8-24af-4779-b17e-6415e9d04d7d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:24.602486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30b56c6e-a495-4d4f-a89d-21402475a1d0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d" status: 404 len: 110 microversion: 2.53 time: 0.063066 Oct 04 20:35:24.602486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 420/863] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:24 2022] PUT /compute/v2.1/os-services/a17afad8-24af-4779-b17e-6415e9d04d7d => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:24.613472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.616520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.623742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.624774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.625930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.627471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.632502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.632502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.632907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.633951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.644111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40486ada-b78c-49de-b69f-79a3417aab29 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.191011 Oct 04 20:35:24.645145 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 444/864] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:24.681565 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a4de10e-2e8e-4c81-b531-cadaa3c1ecd0 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.074504 Oct 04 20:35:24.682695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 421/865] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:24.706533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.713521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.714399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.718621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.718621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.718621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.719231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.767124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2d5c3b2-4b58-40ea-9c36-3446bec2b33e tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.067779 Oct 04 20:35:24.768538 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 445/866] 10.222.0.36 () {60 vars in 1211 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:24.792237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.798162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.799073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.799884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.801908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.803847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.803847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.844645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.845785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.850885 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-143980bb-45ac-47f6-91dd-7cece4fd1077 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.064478 Oct 04 20:35:24.852030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 422/867] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:24.858954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.860000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.860845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.862291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.863358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.864129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.873119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.878716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.879490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.880262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.881753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.882278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.882940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.919665 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80a35d6e-304e-4983-b395-894e0294c308 tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-851029-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.051877 Oct 04 20:35:24.920524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 423/868] 10.222.0.36 () {60 vars in 1237 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/os-services?host=n-d-851029-13&binary=xxx => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:24.946849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.951916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.952816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.953626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.955097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.955906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.956704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.007060 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdfe0a5f-88df-4393-bc2f-f50d355f957f tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.065175 Oct 04 20:35:25.008734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 424/869] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:25.030282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.035248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.036393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.036959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.037821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.038472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.038934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.078088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b8f7fde4-0e56-4e59-998e-aac100472bcf tempest-ServicesAdminNegativeV253TestJSON-724534335 tempest-ServicesAdminNegativeV253TestJSON-724534335-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.052193 Oct 04 20:35:25.079308 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 425/870] 10.222.0.36 () {60 vars in 1239 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:25.129226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.145550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.148819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.151191 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b97816f0-bc23-4af6-b39d-ca43eab338dc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1558 microversion: 2.25 time: 0.313630 Oct 04 20:35:25.152226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 446/871] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1558 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:25.195203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b32ef703-feb2-4368-a436-f9d2f4411ad4 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '.version_select at 0x7f54f6652550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.199439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32ef703-feb2-4368-a436-f9d2f4411ad4 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.200127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32ef703-feb2-4368-a436-f9d2f4411ad4 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.200909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32ef703-feb2-4368-a436-f9d2f4411ad4 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.215824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b32ef703-feb2-4368-a436-f9d2f4411ad4 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2386 microversion: 2.25 time: 0.025892 Oct 04 20:35:25.216816 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 447/872] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/os-migrations => generated 2386 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:25.222735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.223535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.245634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.246514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.247353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.248919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.249787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.250580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.295101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-902f5070-a72b-49bb-980e-346ef1a7a131 tempest-ServicesAdminNegativeV253TestJSON-1258055460 tempest-ServicesAdminNegativeV253TestJSON-1258055460-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.300113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-902f5070-a72b-49bb-980e-346ef1a7a131 tempest-ServicesAdminNegativeV253TestJSON-1258055460 tempest-ServicesAdminNegativeV253TestJSON-1258055460-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ab02a7504f5b478f8da4576727b32cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa9c05bc112402a91ac5f3e3ee9abf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-902f5070-a72b-49bb-980e-346ef1a7a131 tempest-ServicesAdminNegativeV253TestJSON-1258055460 tempest-ServicesAdminNegativeV253TestJSON-1258055460-project] Request method failure captured: Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJkJgp8AnYyBY42kz7ngFIj7gjNZcGSlzVDZNs1DVICULXjPU9XZs9RlaFFWQ7n3Vvv3tp2BTAloYdQwpzxaF9RFBkcqIUuQE4h3lzAPm9nACrKX8wMVIP5uPXiRNL1LV7gVcul2ZOjoZGEY-T0ERPCZuXuVbK2ldZ63khLKEDUdg2Q Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: caa9c05bc112402a91ac5f3e3ee9abf3 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1258055460 Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:35:25.301945 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caa9c05bc112402a91ac5f3e3ee9abf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/caa9c05bc112402a91ac5f3e3ee9abf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/caa9c05bc112402a91ac5f3e3ee9abf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_caa9c05bc112402a91ac5f3e3ee9abf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1258055460 Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: caa9c05bc112402a91ac5f3e3ee9abf3 Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1258055460 Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1258055460-project Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: ab02a7504f5b478f8da4576727b32cf1 Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1258055460-project Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:25.303842 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:25.304794 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:25.306486 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:25.308141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-902f5070-a72b-49bb-980e-346ef1a7a131 tempest-ServicesAdminNegativeV253TestJSON-1258055460 tempest-ServicesAdminNegativeV253TestJSON-1258055460-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:25.308141 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-902f5070-a72b-49bb-980e-346ef1a7a131 tempest-ServicesAdminNegativeV253TestJSON-1258055460 tempest-ServicesAdminNegativeV253TestJSON-1258055460-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.213354 Oct 04 20:35:25.308141 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 426/873] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:35:25.315402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.316294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.325024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.325523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.325972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.327083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.328669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.328669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.619984 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad226906-7da2-46db-82a5-1405a4640e8c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1632 microversion: 2.1 time: 0.401991 Oct 04 20:35:25.621014 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 448/874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1632 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:25.627042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.627940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.638786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.639598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.640337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.642275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.643067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.646540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.646779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.660702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7e05bd0-61fa-4638-924f-a4ce8f9d84e1 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1472 microversion: 2.1 time: 0.355067 Oct 04 20:35:25.662179 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 427/875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:25.673380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.674979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.690127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.691504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.693064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.694915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.696066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.697073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.957268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.959699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:25.975494 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c1578c1-3ba6-487a-82c9-738dc19de738 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1277 microversion: 2.1 time: 0.311144 Oct 04 20:35:25.977229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 428/876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:25.987654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.988601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.001538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.003032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.003853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.005169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.005892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.006969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.452506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid 28a91c95-59fa-498f-9811-a3e5d072ed89 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:26.487282 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee49ed99-57c1-4bb2-b1c3-aefedb4f3b9e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 2053 microversion: 2.25 time: 0.864321 Oct 04 20:35:26.489179 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 449/877] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 2053 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:26.522259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:26.526850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.543172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.545143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.546370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.548635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.550779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.552159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.625214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lazy-loading 'flavor' on Instance uuid 875089be-27da-4346-9b00-9dbf9e0c29db {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:26.665463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123541) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:35:26.677019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:26.834811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:26.848929 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3120152e-d227-4276-930f-db1304c30795 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.868877 Oct 04 20:35:26.851201 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 429/878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:26.862515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:26.865994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.879617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.881071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.882556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.887263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.888685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.889926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.095694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:27.105832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:27.108045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:27.117833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e093b507-f1a3-4b13-944d-c4b625a791a4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.264382 Oct 04 20:35:27.119572 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 430/879] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:26 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:27.132219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:27.134150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:27.159232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.160685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.161807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.163606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.165243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.166350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.125408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e20ac90ba4e129c24328a2f0a7d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239f887a70154739880d4022f58e210b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:28.143269 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a1aa53dc-99c4-44dd-90ec-b12271084d47 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 200 len: 1472 microversion: 2.1 time: 1.021200 Oct 04 20:35:28.145956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 431/880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:27 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 1472 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:28.157384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-564180253", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3fe9fa00-ea40-44c6-8d74-c6204519a84b"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:28.286448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] validate_networks() for [('3fe9fa00-ea40-44c6-8d74-c6204519a84b', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:29.733604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:29.736057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:29.737076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:29.737820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:29.738605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:29.769444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:29.771428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:29.772552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:29.775825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:29.782399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:29.783973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:29.804898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=21 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:29.844392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:29.864001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for user 07dfa4ed8d314142a365c3e67fe5b334 and project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:29.894276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:29.902304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:29.977301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:30.385705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8f173ff-ab6c-4f04-a736-a816dbdad035 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.233561 Oct 04 20:35:30.397922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 432/881] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:35:30.417475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.425205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.456529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.456529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.459632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.460896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.463428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.464818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.957536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:30.978128 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7621c391-519d-42f0-82d1-2c62b92beb18 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 0.584936 Oct 04 20:35:30.986806 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 433/882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.009750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.011379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.033094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.045917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.045917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.045917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.045917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.046802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.365210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e965df48-ec82-4735-82e9-19293b15b080 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db/action" status: 202 len: 0 microversion: 2.1 time: 4.859038 Oct 04 20:35:31.373037 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 450/883] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:26 2022] POST /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db/action => generated 0 bytes in 4868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:31.386995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.392814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.405288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.406547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.407612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.410032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.411452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.412554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.513032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.549877 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46508dbe-8149-4840-a544-499c05c8e778 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.560506 Oct 04 20:35:31.551288 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 434/884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.590123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8267455-7584-4784-936c-4339b911d204", "name": "network-vif-deleted", "tag": "eba407a5-43ed-480d-93a0-22000c87b90e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:31.618477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.620246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.624490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.662198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] Creating event network-vif-deleted:eba407a5-43ed-480d-93a0-22000c87b90e for instance d8267455-7584-4784-936c-4339b911d204 on n-h1-851029-13 Oct 04 20:35:31.674567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1266e99d-ba75-44b8-82c6-8a58e511e610 req-65e01834-47bc-412e-b07b-c5e254621608 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121053 Oct 04 20:35:31.675616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 435/885] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:31.687845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.689245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] [instance: d8267455-7584-4784-936c-4339b911d204] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.701450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.702346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.703193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.704149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.704611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.705659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.706429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.724427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.728257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.741545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] HTTP exception thrown: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. Oct 04 20:35:31.741830 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6feda4a9-7e59-45bc-aa1b-dc06d03eb602 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.362963 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Request method failure captured: Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 HTTP/1.1 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhV0fkY2Rrs6V8wAISWocB5lGptuWWPgtE3je4GcQjV-IhlopbDNurWvoQsXINOUfO3_wTcwjr2-JvctkW4M1NDg2Ng2WRJCBJY8K-0WcCwIsPHlDiBq0inMcFwPS4YlWaX73bo1EpubL03joxp2iuPd18dAZrtGCQHC-Pqp-Q-4No Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 239f887a70154739880d4022f58e210b Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:35:31.741983 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/239f887a70154739880d4022f58e210b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/239f887a70154739880d4022f58e210b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_239f887a70154739880d4022f58e210b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 239f887a70154739880d4022f58e210b Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1033184653 Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: db3e20ac90ba4e129c24328a2f0a7d40 Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerTestJSON-1033184653-project Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. Oct 04 20:35:31.744438 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd8267455-7584-4784-936c-4339b911d204'} Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:31.745859 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. Oct 04 20:35:31.751436 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:31.758960 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 451/886] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:31.759774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] Returning 404 to user: Instance d8267455-7584-4784-936c-4339b911d204 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:31.759774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc9cb978-06bd-4bef-b55b-82bc264fe1c2 tempest-ImagesOneServerTestJSON-1033184653 tempest-ImagesOneServerTestJSON-1033184653-project] 10.222.0.36 "GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204" status: 404 len: 111 microversion: 2.1 time: 0.064041 Oct 04 20:35:31.759774 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 436/887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/d8267455-7584-4784-936c-4339b911d204 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:31.763213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.771191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.774449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.775525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.795822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.796768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.798000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.799841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.800704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.802251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.143692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.159960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.167264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.167264 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb06d49f-045f-4030-8a95-9d71f23becb3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1261 microversion: 2.25 time: 0.423260 Oct 04 20:35:32.168205 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 452/888] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1261 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:32.180119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.182259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.195646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.197443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.198845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.200502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.201637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.203049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.260681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:32.700259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.717784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:32.730743 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76d4870a-87d1-44d9-b5c8-42d9322088c5 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 0.983858 Oct 04 20:35:32.736990 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 437/889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:32.748916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.753480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.773500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.776304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.777561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.779728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.783034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.793693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.871650 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10957ee2-dea8-4f68-b635-c0f1a26ea657 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 204 len: 0 microversion: 2.1 time: 0.701003 Oct 04 20:35:32.873152 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 453/890] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:32 2022] DELETE /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:32.901971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.903452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.937200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.938095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.938985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.948990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.953022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.953766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.501419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:33.517595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-052d62a9-b539-4b69-b729-a6e3eb9f7076 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 0.778240 Oct 04 20:35:33.518726 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 438/891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:32 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:33.529071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:33.530719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:33.548111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.549497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.550728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.552448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.553592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.554715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.703745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:33.735899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72cc0384-e8b9-487a-99ea-57fac25e1ba3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.853238 Oct 04 20:35:33.742594 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 454/892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:32 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:33.757784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:33.759781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:33.787110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.788724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.790093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.791792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.792932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.794070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.917656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:33.962054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:33.972414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.004165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afa5fe0e-d3a8-4d89-ba0a-24f35d127ad2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.482366 Oct 04 20:35:34.018089 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 439/893] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:33 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:34.069809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.071079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.100652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.101525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.102326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.103721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.125670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.126509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.387531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.407624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc408ea7-c001-4047-8ea6-2980168fd5f4 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1712 microversion: 2.1 time: 0.664220 Oct 04 20:35:34.409935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 455/894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:33 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1712 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:34.424546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76569e6-dd77-4716-a061-fb59fbaaf04a", "tag": "a1e38b08-1d03-4cfe-9a6b-a4d2174861d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:34.451059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.451878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.452818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.474821 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] Creating event network-changed:a1e38b08-1d03-4cfe-9a6b-a4d2174861d5 for instance b76569e6-dd77-4716-a061-fb59fbaaf04a on n-h1-851029-13 Oct 04 20:35:34.476967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e35fe09f-bd8e-4b5b-8c9d-045fb0492387 req-62b53044-560a-46ac-9364-2a4af62de834 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062745 Oct 04 20:35:34.478461 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 456/895] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:34.484357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.493037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.495459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.504325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.507835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.508565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.509220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.510201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.512005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.512255 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c870f0a5-9f5e-4941-acaf-af0d9e072571 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1313 microversion: 2.25 time: 0.491262 Oct 04 20:35:34.513364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.514354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.514952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 440/896] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:34.602149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.604871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.621070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.622211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.623562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.624903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.629154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.631555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.728401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:35.472907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:35.499880 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e347aad-4a14-4608-bb06-f460015bfa95 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 1.017675 Oct 04 20:35:35.507307 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 457/897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:35.544862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.546822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.581350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.582517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.583559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.585058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.586122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.587113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.797488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:36.827696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a436d6e9-99aa-49c5-a43e-cc0608167256 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 2.258941 Oct 04 20:35:36.828903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 441/898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:36.850111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:36.851338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:36.877355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.878315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.879760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.881144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.882292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.887436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.027436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.067370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68f55c49-7d7b-4435-a06b-9d43800ed69c tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 1.555784 Oct 04 20:35:37.068968 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 458/899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:37.091331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.099010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.122562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.123687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.124338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.131733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.133559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.134649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.254290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.272814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.276052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:37.295328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94db6847-7cde-4f47-8c82-46dda2fbe72f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.463889 Oct 04 20:35:37.298210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 442/900] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:36 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:37.359520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.361924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.382887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.384204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.385451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.388223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.389609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.390905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.042341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.067329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a53cf016-fae0-4ca6-8897-4fb5c18b08e1 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1712 microversion: 2.1 time: 0.992380 Oct 04 20:35:38.068426 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 459/901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1712 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.088291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.099351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.122619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.123647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.124506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.125926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.126895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.127756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.361395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.386373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.390018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.392838 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6f00229-d905-4fb4-9e10-aaddd89d262d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 1.091555 Oct 04 20:35:38.397562 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 443/902] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:38.406399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.408272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.425960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.435048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.435948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.437340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.440519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.441572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.027309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.076106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0036f84f-66a3-4aec-bea2-ec47705f2124 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 0.968928 Oct 04 20:35:39.076106 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 460/903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:39.083014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.091834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.107556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.111373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.113706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.116253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.118383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.119618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.214639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.235901 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81824114-0ea4-49aa-9c9b-29be44e3c8e7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 0.836209 Oct 04 20:35:39.237221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 444/904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:39.257070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.258787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.279611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.284747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.286224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.289563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.290999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.294747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.580190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.608535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.612741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.624630 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1105a6e-467d-41f5-94ab-bbe94dc5ca5f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.376072 Oct 04 20:35:39.637122 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 445/905] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:39.652649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875089be-27da-4346-9b00-9dbf9e0c29db", "name": "network-vif-unplugged", "status": "completed", "tag": "16698709-0ed6-4fc5-b6f6-032962863637"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:39.679135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.681924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.682970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.714729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] Creating event network-vif-unplugged:16698709-0ed6-4fc5-b6f6-032962863637 for instance 875089be-27da-4346-9b00-9dbf9e0c29db on n-h2-851029-13 Oct 04 20:35:39.732243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3e868c3d-8310-41c0-922a-4197be20cabd req-ed8426a4-49fb-4808-a219-608de3aee335 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091103 Oct 04 20:35:39.733885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 446/906] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:39.748606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.750160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.765519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.770358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.770358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.770358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.772073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.772549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.888427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:40.194811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:40.288672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:40.326370 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5eba0972-09d3-4154-9dfd-907e3b37842b tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1644 microversion: 2.1 time: 0.589518 Oct 04 20:35:40.330451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 447/907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1644 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:40.344390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:40.346745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:40.362057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.368245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.376381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.376381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.376381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.376381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.393986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:41.149193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.171612 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4936f2c-1ab3-4962-b35d-8bcc9a2ce627 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 2.117231 Oct 04 20:35:41.172303 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 461/908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:41.187602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:41.187602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:41.217288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.218197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.219708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.226801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.227984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.232196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.802982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.829334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.840651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.844303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd39c460-83eb-4faa-8e7e-6eeaec895bbc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 1.510780 Oct 04 20:35:41.858710 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 448/909] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:40 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:41.899008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ac73ea5-ccd4-4948-916a-dfc839cc6252 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6489af0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.065240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ac73ea5-ccd4-4948-916a-dfc839cc6252 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd" status: 200 len: 662 microversion: 2.1 time: 0.216829 Oct 04 20:35:42.067990 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 449/910] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd => generated 662 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:42.091869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.093653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.110626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.112575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.114453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.115789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.116873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.118014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.152121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:42.554132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.589606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd1e7fce-c636-45de-a2c1-5fa990b6b37a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 1.415738 Oct 04 20:35:42.596666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.608244 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 462/911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:42.671568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.673002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.675962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7f8c7d8-ba2b-48f6-ba09-299fbc4faebb tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 0.598000 Oct 04 20:35:42.680018 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 450/912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:42.706724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.719277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.723411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.725984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.729671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.734213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.737961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.739361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.750989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.776011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.776571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.779634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.783726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.788025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.107563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20b601a437764fb8890a2ca25d72367a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e57e35d48e5408d8a74da8cf5846d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.111582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.159250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.160368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e677be88-4b0c-4f82-864b-8ce2f6cbfcfd tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 200 len: 1644 microversion: 2.1 time: 0.476719 Oct 04 20:35:43.164334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 451/913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 1644 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:43.167642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.187279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91f13ddb-03f8-4166-b027-65e193ee2695 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.567000 Oct 04 20:35:43.189551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 463/914] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:43.214946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-738b694b-38dd-479b-952b-938a27016c31 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6466790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.216179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa63f75-12f0-4581-9b6c-2171310b08a8", "tag": "29c815c5-af1c-48d7-92d9-63b22043240d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:43.268545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.277575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.279039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.337809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] Creating event network-changed:29c815c5-af1c-48d7-92d9-63b22043240d for instance faa63f75-12f0-4581-9b6c-2171310b08a8 on n-h2-851029-13 Oct 04 20:35:43.357771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-21edcb90-609b-46ee-83de-2e68a4b59652 req-f9b9955f-f0f6-4ddb-b396-57a1f7513c38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191350 Oct 04 20:35:43.359778 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 452/915] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:43.378885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875089be-27da-4346-9b00-9dbf9e0c29db", "tag": "16698709-0ed6-4fc5-b6f6-032962863637"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:43.390290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-738b694b-38dd-479b-952b-938a27016c31 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd" status: 200 len: 662 microversion: 2.1 time: 0.198379 Oct 04 20:35:43.399995 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 464/916] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd => generated 662 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:43.421687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.422237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.424411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.426920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.427716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.453581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] Creating event network-changed:16698709-0ed6-4fc5-b6f6-032962863637 for instance 875089be-27da-4346-9b00-9dbf9e0c29db on n-h2-851029-13 Oct 04 20:35:43.460517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.462717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-27c32848-10bb-444c-a476-1169fc323719 req-e0c229e9-4918-4991-8d4f-3e7a3432ee7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098290 Oct 04 20:35:43.463832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.464653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 453/917] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:43.468338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.477603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.478856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.479423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.515187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.517103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.543441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.547899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.549125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.552132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.557478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.558621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.199241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.216406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04464280-28b4-48dc-b5f3-b7888eed919d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1542 microversion: 2.1 time: 0.814376 Oct 04 20:35:44.219952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 465/918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1542 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:44.234202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.236391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.252540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.254867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.257531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.261231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.263743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.267828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.653180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.721947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.733617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.736523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2c27bd1-f203-48e6-a85b-0d7c43dde71a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 1.254565 Oct 04 20:35:44.758205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 454/919] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:44.783899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.788279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.806857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.808314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.809395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.812222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.813847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.815042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.093364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.102598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:45.132850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9955e729-fb3e-41b4-b1c6-afec9222b31e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 0.904140 Oct 04 20:35:45.139188 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 466/920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:45.171225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.179032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.207862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.208738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.209317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.210622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.223918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.224760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.311223 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea HTTP/1.1 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:35:45.314964 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:35:45.318606 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '28dd9f54-f84d-472a-b1e3-35cc089ba3ea'} Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:45.320361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:35:45.322963 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.331052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:45.332744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-daca17b4-fd8a-4234-84d0-823cfefb4991 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 404 len: 111 microversion: 2.1 time: 0.186606 Oct 04 20:35:45.335048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 467/921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:45.350490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.352183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.364740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.366214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.367617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.398730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.401235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.401618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.749426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.760885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.791478 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6f0dd96-7519-49ba-94ce-2a0c04969f3a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 1.037009 Oct 04 20:35:45.791881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.795401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:45.808803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8b4430f-76a4-4709-be2f-bec027cc021f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.470978 Oct 04 20:35:45.822708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 455/922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:45.823731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 468/923] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:45.833396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.834988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.851957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.854129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.855961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.857879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.858088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.858984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.860901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.861852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.873487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.874498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.884171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.885040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.886849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.886849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.942182 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 HTTP/1.1 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:35:45.950989 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:45.952638 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '6764938b-3e9a-4a3e-869c-11ed92451b80'} Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:45.953590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:45.956183 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:35:45.962552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:45.963040 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b555551e-e85e-4e73-82c7-17db84b8b794 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 404 len: 111 microversion: 2.1 time: 0.128960 Oct 04 20:35:45.964367 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 469/924] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:45 2022] DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:45.978582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dd9f54-f84d-472a-b1e3-35cc089ba3ea", "name": "network-vif-deleted", "tag": "c71fbfe3-34b0-477b-a59c-d0a836252426"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:46.013148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.013861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.014362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.042411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] Creating event network-vif-deleted:c71fbfe3-34b0-477b-a59c-d0a836252426 for instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea on n-h1-851029-13 Oct 04 20:35:46.054386 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6120f864-f9e1-4141-9217-b761eb41cd40 req-b0f75be9-b13f-47cf-9874-9ee603e47dc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087458 Oct 04 20:35:46.055959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 470/925] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:46.064313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.065653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.090864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.092193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.093218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.094870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.096017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.097286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.346014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.362723 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c552998e-fd03-4136-a0e8-e983c4590be6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1541 microversion: 2.1 time: 0.549294 Oct 04 20:35:46.363423 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 456/926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1541 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:46.382347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.387722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.405176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.406323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.407287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.408737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.410138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.411049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.457653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 HTTP/1.1 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:35:46.461054 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:46.463809 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6764938b-3e9a-4a3e-869c-11ed92451b80'} Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:46.465354 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:35:46.468107 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.475505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:46.475505 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9444e442-db13-45a6-a87a-9ba567184667 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 404 len: 111 microversion: 2.1 time: 0.101970 Oct 04 20:35:46.481320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 457/927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:46.492318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.496740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.507191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.508468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.509651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.511342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.512503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.513412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.763918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.792390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.796444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.799435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a238fc0e-c19f-4db5-aea4-de7ad8713ad5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 0.741376 Oct 04 20:35:46.801702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 471/928] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:46.811349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fb86bc5-b1b6-4b70-9c11-66aa0f435fe6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f637e3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.911661 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9fb86bc5-b1b6-4b70-9c11-66aa0f435fe6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f" status: 200 len: 661 microversion: 2.1 time: 0.107118 Oct 04 20:35:46.913168 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 472/929] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:46.924556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-556bd408-3458-49b0-a73a-232efa0beac6 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '.version_select at 0x7f54f63eac10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.084227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.093710 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-556bd408-3458-49b0-a73a-232efa0beac6 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871138313" status: 202 len: 0 microversion: 2.1 time: 0.176917 Oct 04 20:35:47.108156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 473/930] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871138313 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:47.133434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6374a761-b4f4-4659-8041-883640da422a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 0.649593 Oct 04 20:35:47.138753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.139591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 458/931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:47.144107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.169613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.193140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.205057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.216951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.218432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.219821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.226964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.227782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.242252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.245884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.246807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.249715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.252678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.255834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.498978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.587074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.599827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.620161 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffda7006-5d44-46e9-8713-47fbea59f00f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.476661 Oct 04 20:35:47.621799 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 459/932] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:47.662426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1618856-f758-447a-9795-70eca2f0a938 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f677c430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.787131 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1618856-f758-447a-9795-70eca2f0a938 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f" status: 200 len: 661 microversion: 2.1 time: 0.144174 Oct 04 20:35:47.789262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 460/933] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f => generated 661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:47.800287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.802811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.818969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.822733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.822733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.826277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.828747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.830231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.131785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.190620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ec5b1a54-6e58-4fbd-820d-8b1362008cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 1.078621 Oct 04 20:35:48.192260 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 474/934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.214059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.214059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:48.238296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.239274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.240071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.241369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.247978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.248594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.333945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.358382 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f3ec163-163d-4467-afae-0eec02c31414 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1541 microversion: 2.1 time: 0.566797 Oct 04 20:35:48.360047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 461/935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1541 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.369011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-unplugged", "status": "completed", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:48.389759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.400183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.401015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.427000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Creating event network-vif-unplugged:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h2-851029-13 Oct 04 20:35:48.446967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:35:48.485396 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5c5fd5e0-68a9-42e4-a549-647698c49f04 req-777b374e-1096-4d2d-9adb-7a3abc3b79f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122024 Oct 04 20:35:48.487635 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 462/936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:48.501590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.503403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:48.527140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.529791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.532197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.534452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.537540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.540656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.078679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.106622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.115977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.117853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdf8d735-e5fe-4e8e-946a-1d8fb1d44c98 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 0.924016 Oct 04 20:35:49.118900 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 475/937] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:49.164162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.165308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.184382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.184886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.185643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.186619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.190928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.192315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.280018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.288275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94d82d99-f3c5-4b2a-838f-58a79358c2c0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 0.798026 Oct 04 20:35:49.296934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 463/938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:49.305715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.319652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.333968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.348339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.349228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.350325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.351499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.352680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.449869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.477780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.496293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.514843 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d74ef8d1-8696-416f-9850-fd78217084b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.355500 Oct 04 20:35:49.543288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 476/939] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:49.580689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.582873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.609615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.616578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.618097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.619878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.622306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.625808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.218971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.252595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-958d5db4-4e44-4db3-847a-9b39fa4dd3d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 0.953732 Oct 04 20:35:50.255268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 464/940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:50.279838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76569e6-dd77-4716-a061-fb59fbaaf04a", "name": "network-vif-plugged", "status": "completed", "tag": "a1e38b08-1d03-4cfe-9a6b-a4d2174861d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:50.333123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.336312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.340187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.393237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] Creating event network-vif-plugged:a1e38b08-1d03-4cfe-9a6b-a4d2174861d5 for instance b76569e6-dd77-4716-a061-fb59fbaaf04a on n-h1-851029-13 Oct 04 20:35:50.414032 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-836a6c8e-ca2b-4daa-b45c-5730ef16c899 req-9ac7136b-6e23-46d6-b406-3e906dc0ec0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152203 Oct 04 20:35:50.419100 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 465/941] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:50.434887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.438168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.475568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.476482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.477291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.478762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.479843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.481510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.510936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.542233 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b78fa990-24b2-43d2-bc6f-3a0b52f4c235 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1541 microversion: 2.1 time: 0.996525 Oct 04 20:35:50.562839 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 477/942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1541 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:50.597851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.599529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.625911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.627407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.629157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.630931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.633021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.634164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.500378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.513045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.531878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2dac1336-a118-4bd2-93a9-04020f807d6a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 1.966365 Oct 04 20:35:52.533605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.537402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.538125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 478/943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:52.541044 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef2bb1e4-d2fa-42f0-ad3f-33c65308e3d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 2.118733 Oct 04 20:35:52.543195 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 466/944] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:52.556356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:52.578807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.583379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.584720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.591765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.597189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.622409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.624965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Creating event network-changed:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h2-851029-13 Oct 04 20:35:52.625444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.626421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.636289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.637952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.639277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.640564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:35:52.681902 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-93a12eed-a0b1-4b44-b870-2662ca1e991a req-125b5b41-5acf-4b9e-8330-edc2ca91efd2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131359 Oct 04 20:35:52.681902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 467/945] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:52.698421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e4b340f0-7991-48a7-950c-7f310578933f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6ab9550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.853266 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e4b340f0-7991-48a7-950c-7f310578933f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5" status: 200 len: 662 microversion: 2.1 time: 0.166653 Oct 04 20:35:52.855198 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 468/946] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5 => generated 662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:52.880201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.882768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.917749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.926337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.928861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.929021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.930600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.931455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.039654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.082170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.104039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.130818 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5448207d-a652-4012-994b-aebaafc93b3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.590299 Oct 04 20:35:53.137363 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 479/947] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:53.163082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:53.182931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:53.204873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.213298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.214829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.217122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.218487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.223758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.373204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:54.401987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b016f222-304e-4074-b2a7-8674efbd9c1a tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1317 microversion: 2.1 time: 1.544349 Oct 04 20:35:54.436870 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 469/948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1317 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:54.450225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ef57ac5-d8c3-46e6-8779-b7b596b0056c tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.538269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:54.576038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ef57ac5-d8c3-46e6-8779-b7b596b0056c tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1255441963" status: 202 len: 0 microversion: 2.1 time: 0.136477 Oct 04 20:35:54.577593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 470/949] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:35:54 2022] DELETE /compute/v2.1/flavors/1255441963 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:54.601053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b154eb6-10b1-4bcd-b0ec-4baef1fb50b0 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1473 microversion: 2.1 time: 1.461117 Oct 04 20:35:54.609226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f2509a76-dcee-4f22-b7af-11ddc851230f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6482430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.620047 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 480/950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:53 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1473 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:54.655522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa63f75-12f0-4581-9b6c-2171310b08a8", "name": "network-vif-plugged", "status": "completed", "tag": "29c815c5-af1c-48d7-92d9-63b22043240d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:54.703686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.704717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.705458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.753924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] Creating event network-vif-plugged:29c815c5-af1c-48d7-92d9-63b22043240d for instance faa63f75-12f0-4581-9b6c-2171310b08a8 on n-h2-851029-13 Oct 04 20:35:54.773819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8cceef76-3b38-4b92-8575-993e4d8dbf34 req-f28271f3-0e0e-438a-a366-6a366512aec2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150554 Oct 04 20:35:54.792998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 481/951] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:54.816886 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f2509a76-dcee-4f22-b7af-11ddc851230f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5" status: 200 len: 662 microversion: 2.1 time: 0.231180 Oct 04 20:35:54.819158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 471/952] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:35:54 2022] GET /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5 => generated 662 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:54.828868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.832478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:54.852250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.854042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:54.865784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.869101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.869101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.870248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.875940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.876182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.876802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.879467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.882336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.886548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.888138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.890247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.091603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.124464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22b9527f-e68d-4af1-8123-06209919f493 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1504 microversion: 2.1 time: 1.329505 Oct 04 20:35:56.125857 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 482/953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:54 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1504 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:56.146738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:56.152996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:56.176466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.179911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.184888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.186042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.188049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.188049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.539799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.596481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.600481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.603718 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4da27041-04b8-41c4-ba68-3012dff2ccee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1361 microversion: 2.25 time: 1.781898 Oct 04 20:35:56.604936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 472/954] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:54 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1361 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:56.614489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78e4f0f2-6e43-48ac-bff3-35e515eced96 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:56.672460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.714227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78e4f0f2-6e43-48ac-bff3-35e515eced96 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.106832 Oct 04 20:35:56.721637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 473/955] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:35:56 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:56.759006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.765564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.777066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ac55475-c49f-4fb2-97ed-9ec8abb7689e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.647680 Oct 04 20:35:56.792141 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 483/956] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:35:56 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:56.820249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1008048442", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:56.902897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33259f40-55f1-4df9-85f1-352cee960c0b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Action: 'create', calling method: .version_select at 0x7f54f647f430>, body: {"pool": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:56.974867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:58.914378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:58.915552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:58.915951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:58.917847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:58.918917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:58.939881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.942058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.943540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.946299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.947733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.948990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:59.009924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Getting quotas for project 07d97bc82450455982de0d09d2448851. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:59.031767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Getting quotas for user 51c24c1c94784ab88d7f9b31c26682b5 and project 07d97bc82450455982de0d09d2448851. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:59.060703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:59.066354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:59.290832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47481573-06cd-41bb-9db9-1f7065522271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.496161 Oct 04 20:35:59.293070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 484/957] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:59.306352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.308526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:59.327014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:59.328482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:59.335811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:59.338040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:59.339797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:59.341246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.203379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:00.247205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ff6e986-d7c5-4363-8e08-a0241c0e5da0 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1467 microversion: 2.1 time: 0.951027 Oct 04 20:36:00.264167 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 485/958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:59 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1467 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:00.778898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:00.780954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:00.796244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.797554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.798650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.807218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.807218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.807218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.564787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:01.589336 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94a6a456-7efc-42f5-bcf0-9f7dc1b444ce tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1470 microversion: 2.1 time: 1.323077 Oct 04 20:36:01.610635 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 486/959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:00 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1470 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:01.639819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5530d1da-67eb-4dd9-8265-9ce80230e20c tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.808689 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5530d1da-67eb-4dd9-8265-9ce80230e20c tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1527132680" status: 202 len: 0 microversion: 2.1 time: 0.195241 Oct 04 20:36:01.816038 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 487/960] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:36:01 2022] DELETE /compute/v2.1/flavors/1527132680 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:01.838227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.840314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:01.855750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:01.885663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.887324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.888063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.889426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.890724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.891747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:02.660260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:02.696825 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19441bd7-ef62-495e-a212-843c37586b18 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1479 microversion: 2.1 time: 0.876736 Oct 04 20:36:02.708122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 488/961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:01 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1479 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:02.718361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:02.723814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:02.757169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:02.758135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:02.758992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:02.766856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:02.768058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:02.768945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.358235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.362310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:03.377522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.380670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.382705 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c101fe7c-ba0d-4b52-8767-b611006c8803 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1558 microversion: 2.25 time: 0.672636 Oct 04 20:36:03.384087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 489/962] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:02 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1558 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:03.390622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.391704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:03.413327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.414328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.421215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.421215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.421215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.421215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.430617 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-33259f40-55f1-4df9-85f1-352cee960c0b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.705583 Oct 04 20:36:03.432373 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 474/963] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:35:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:03.445911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-607438884", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:03.491709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=85,nova_api:DELETE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:03.602124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.634045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.637372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:03.641955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:03.650020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-512afdf5-c249-4b12-a0ec-cba52710aa39 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.263912 Oct 04 20:36:03.651917 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 490/964] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:03 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:03.669588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.672475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:03.686707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.698560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.702965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.705039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.707341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.710088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.183620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad7d2b70-fb25-4920-aa9c-34d74c3da516 tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1620 microversion: 2.1 time: 0.529130 Oct 04 20:36:04.185378 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 491/965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:03 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1620 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:04.203017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-plugged", "status": "completed", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:04.233801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.236639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.238469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.266615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:04.267581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:04.268399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:04.269989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:04.272486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Creating event network-vif-plugged:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h2-851029-13 Oct 04 20:36:04.272709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:04.281842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:36:04.304350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.304695 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ec922d07-ce2b-4f70-92f9-6028cc72634f req-bc75401c-16d0-4180-8acf-7d14cbf18653 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111335 Oct 04 20:36:04.305710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 492/966] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:04.310726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.311801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.317436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.318230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.319032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.326652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:04.328165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:04.339368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:04.345168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.347961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.359440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.359440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.359440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.359440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.390061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Getting quotas for project 07d97bc82450455982de0d09d2448851. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:04.404475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Getting quotas for user 51c24c1c94784ab88d7f9b31c26682b5 and project 07d97bc82450455982de0d09d2448851. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:04.437769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:04.447177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:04.458751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.461010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.462331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.465245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.466477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.467582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.537530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:04.547869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:04.701620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86f6d8d6-387e-4a2c-a8d5-4d0eeb47d8dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.267534 Oct 04 20:36:04.715204 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 475/967] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:04.727130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd8ccb57-c6d9-497f-8887-e25ca1388c38 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:04.807958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd8ccb57-c6d9-497f-8887-e25ca1388c38 tempest-ServersWithSpecificFlavorTestJSON-727105816 tempest-ServersWithSpecificFlavorTestJSON-727105816-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088796 Oct 04 20:36:04.814340 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 476/968] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:36:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:04.845242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5988d5f2-da26-4c79-aff6-9b1de09ceeb1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '.version_select at 0x7f54f650b040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:04.859780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5988d5f2-da26-4c79-aff6-9b1de09ceeb1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.863490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5988d5f2-da26-4c79-aff6-9b1de09ceeb1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.870832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5988d5f2-da26-4c79-aff6-9b1de09ceeb1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.904547 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5988d5f2-da26-4c79-aff6-9b1de09ceeb1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2368 microversion: 2.1 time: 0.086922 Oct 04 20:36:04.906718 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 477/969] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:36:04 2022] GET /compute/v2.1/os-migrations => generated 2368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:04.928084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:04.928883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:04.964680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.965411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.966174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.976007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.977563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.978833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.298271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b94e0169-2261-46cb-a38f-89a78ae465c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003/action" status: 202 len: 0 microversion: 2.1 time: 0.986986 Oct 04 20:36:05.300788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 493/970] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:04 2022] POST /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003/action => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:05.329568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e59cefd6-680e-4ff5-9c6d-340ce6905a5c tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f638e5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:05.866755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid faa63f75-12f0-4581-9b6c-2171310b08a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:05.940950 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a44829ac-eb53-4d86-8d14-7f13ca31d894 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 2052 microversion: 2.25 time: 1.030890 Oct 04 20:36:05.964164 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 478/971] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:04 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 2052 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:05.975173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1582482102", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "17ea1f23-cdc1-4fac-b05e-46c2bfeaac78"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:06.151356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e59cefd6-680e-4ff5-9c6d-340ce6905a5c tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/1e2bb3df-2b25-4e56-aca2-48ed0021d1f0" status: 200 len: 142 microversion: 2.1 time: 0.831642 Oct 04 20:36:06.166579 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 494/972] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:36:05 2022] GET /compute/v2.1/os-floating-ips/1e2bb3df-2b25-4e56-aca2-48ed0021d1f0 => generated 142 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:06.184111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.187117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:06.214544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.214544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.214544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.215144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:06.215314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.215314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.216343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.630909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:06.651344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:06.661392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:06.672064 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75068659-66dc-4416-887c-bf590d3209e3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.508883 Oct 04 20:36:06.687353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 495/973] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:06.708014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e1d046e-cd42-452c-9214-8e805daf55b2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.709659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e1d046e-cd42-452c-9214-8e805daf55b2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:06.955776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e1d046e-cd42-452c-9214-8e805daf55b2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:07.003427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e1d046e-cd42-452c-9214-8e805daf55b2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1217 microversion: 2.1 time: 0.312726 Oct 04 20:36:07.013593 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 496/974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:07.022933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.024250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.061458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.061458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.061458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.061458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.062144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.062144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.109177 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea HTTP/1.1 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:36:07.119742 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:07.121661 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '28dd9f54-f84d-472a-b1e3-35cc089ba3ea'} Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:07.122638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:07.124277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:36:07.137947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:07.145198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d61a1b14-1efb-4388-8ce3-888dbfc6e461 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 404 len: 111 microversion: 2.1 time: 0.125129 Oct 04 20:36:07.153497 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 497/975] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:07 2022] DELETE /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:07.164437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.167041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.176479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.177909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.178519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.180166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.180900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.181491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.302963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:07.303825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:07.304641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:07.305252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:07.306459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:07.348392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.350176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.350176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.351458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.352209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.352880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.426219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:07.440137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Getting quotas for user fb0b6816f268493aaf8944363f2bd618 and project 3d7a2afde38148faab4850e9d2f191bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:07.471360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:07.477579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:07.668169 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-611a5fdf-6364-4d81-b04a-6d89d9038025 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1632 microversion: 2.1 time: 0.512174 Oct 04 20:36:07.669698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 498/976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1632 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:07.678501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.679717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.694703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.698647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.698647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.698647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.699529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.699841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.738610 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb53a2eb-a1ff-4570-be35-838534df41f7 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781805 Oct 04 20:36:07.745968 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 479/977] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:07.769472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.771443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.823664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.823664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.823664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.823664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.863779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.868710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.836688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:08.871886 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b168088-c3f6-4448-bd3d-dbd48b820315 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1469 microversion: 2.1 time: 1.200245 Oct 04 20:36:08.881436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 499/978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1469 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:08.896261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44d130ca-0aa0-424b-955e-e525be729082 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f6402940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:08.931011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid faa63f75-12f0-4581-9b6c-2171310b08a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:08.987924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d91eeb08-d512-4d7d-83e5-05b510f2e5bc tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 2052 microversion: 2.25 time: 1.236289 Oct 04 20:36:09.002301 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 480/979] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 2052 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:09.033440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.041474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 28dd9f54-f84d-472a-b1e3-35cc089ba3ea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.069729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.071638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.072609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.074276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.075205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.076191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.133742 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea HTTP/1.1 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:36:09.137403 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:09.140585 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '28dd9f54-f84d-472a-b1e3-35cc089ba3ea'} Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:09.142216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. Oct 04 20:36:09.149419 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:09.151704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 28dd9f54-f84d-472a-b1e3-35cc089ba3ea could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:09.153153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-884ff98c-6b75-4f0d-b10a-d2e0eedef4f3 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea" status: 404 len: 111 microversion: 2.1 time: 0.141959 Oct 04 20:36:09.155615 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 481/980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/28dd9f54-f84d-472a-b1e3-35cc089ba3ea => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:09.166789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e84fa012-76b8-48f9-8939-117d58b9452a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: .version_select at 0x7f54f64f51f0>, body: {"keypair": {"name": "tempest-keypair-2041462478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyTNogXjZp/qYNC+ECrlfIl+sHfOsRutl1vH0YdGSpDXfG4wXgKzarvBcisNT85rTN3YDLzNmcRmcrNd0ZhECYAasXc/UguLxRYqNC1xTOYVjXdAUSEa9R7EXPhIC1GLw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:09.229347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e84fa012-76b8-48f9-8939-117d58b9452a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for project 2dd088c880894556b8525b41e5684eef. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:09.240967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e84fa012-76b8-48f9-8939-117d58b9452a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for user 44a42dd2dd73439bbe445de3b2eb9744 and project 2dd088c880894556b8525b41e5684eef. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:09.400059 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e84fa012-76b8-48f9-8939-117d58b9452a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238847 Oct 04 20:36:09.401397 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 482/981] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:09.432841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.442383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.458690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.459938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.462057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.463867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.465332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.468674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.635956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.679107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.681518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.698609 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a700177-3f91-4b86-b3e7-83867ccd1ada tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.284170 Oct 04 20:36:09.719907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 483/982] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:09.747503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a628b526-792f-4b20-841a-7b949c01ba32 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.748819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a628b526-792f-4b20-841a-7b949c01ba32 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.795443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44d130ca-0aa0-424b-955e-e525be729082 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.909828 Oct 04 20:36:09.812143 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 500/983] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:36:08 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:09.825143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.827097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.848180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.851214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.852963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.854848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.856646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.857976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.949048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a628b526-792f-4b20-841a-7b949c01ba32 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.975782 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a628b526-792f-4b20-841a-7b949c01ba32 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1217 microversion: 2.1 time: 0.259019 Oct 04 20:36:09.979858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 484/984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:09.987197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.012431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.020927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.022245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.024075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.025293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.037554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.123673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:10.134320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89e3105e-817d-434b-809b-201452769127 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.151800 Oct 04 20:36:10.138954 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 485/985] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:36:10.148497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57f3dfb8-8be2-4470-9fb8-4dbb6e391a5d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1269 microversion: 2.1 time: 0.333709 Oct 04 20:36:10.153941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.154930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:10.155314 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 501/986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1269 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:10.169418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c15fe91e-2796-4da1-8543-7893b0514870 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f661bdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.192237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.192836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.193307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.203169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.204444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.207123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.261157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 HTTP/1.1 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:36:10.265673 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:10.268609 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6764938b-3e9a-4a3e-869c-11ed92451b80'} Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:10.270024 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:10.274280 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:10.283292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:10.283292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe743861-d0bb-4953-9093-277cf8bba0a9 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 404 len: 111 microversion: 2.1 time: 0.140229 Oct 04 20:36:10.284214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 486/987] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:10 2022] DELETE /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:10.291327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.293791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:10.309395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.314619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.316028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.319253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.329440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.330495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:11.835386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:11.858276 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7609f9b-b843-414c-a48e-f9deddf5b6e5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1469 microversion: 2.1 time: 1.571724 Oct 04 20:36:11.874881 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 487/988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:10 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1469 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:11.895617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:11.897347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:11.935298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:11.940362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:11.941794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:11.948964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:11.953863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:11.955264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.462856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c14f56e9-85a7-48c0-9247-ab60a98b835c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8/action" status: 202 len: 0 microversion: 2.25 time: 0.578964 Oct 04 20:36:12.475031 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 488/989] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:36:11 2022] POST /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:12.509980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:12.517111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] [instance: 6764938b-3e9a-4a3e-869c-11ed92451b80] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:12.552309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.564068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.565271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.566986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.568049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.584300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.620138 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] HTTP exception thrown: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Request method failure captured: Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 HTTP/1.1 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJfxVt0zv5S9rinF8DuXtvYG8mV1scecc0Q0AykJqCh6I_FueU11ud3nxcj36fSzBnH4ngIqTGuKTVmEVG5I9434K9AtbB6LFSmx9lGYjjf4r9mbPfC3Qmx2CTDF-04YTqFbO1tOtkMirEeXaBpT7TL5dRfMbvgrub9eQ1ZClY8MK-4 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:36:12.624160 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2e57e35d48e5408d8a74da8cf5846d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2e57e35d48e5408d8a74da8cf5846d19 Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187 Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 20b601a437764fb8890a2ca25d72367a Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-958444187-project Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:12.626529 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6764938b-3e9a-4a3e-869c-11ed92451b80'} Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:12.627852 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. Oct 04 20:36:12.629945 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:12.634533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] Returning 404 to user: Instance 6764938b-3e9a-4a3e-869c-11ed92451b80 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:12.636681 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21cf000c-7632-43dd-b75b-444e97945791 tempest-ServersWithSpecificFlavorTestJSON-958444187 tempest-ServersWithSpecificFlavorTestJSON-958444187-project] 10.222.0.36 "GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80" status: 404 len: 111 microversion: 2.1 time: 0.155018 Oct 04 20:36:12.649994 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 489/990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:12 2022] GET /compute/v2.1/servers/6764938b-3e9a-4a3e-869c-11ed92451b80 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:12.658460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:12.660870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:12.674225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.676567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.677764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.679388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.680140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.680832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:13.635081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:13.664398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:13.668895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:13.689151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68202012-52d6-4373-b56e-5bbb4ef83c89 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 1.039188 Oct 04 20:36:13.691487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 490/991] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:12 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:13.704100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:13.705368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:13.755924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.757768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.758828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:13.760300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.761294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.762179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.493433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:14.495937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:14.536883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab6f5749-cf60-4800-ac4d-e6976685719b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1269 microversion: 2.1 time: 0.842799 Oct 04 20:36:14.544547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 491/992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:13 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1269 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:14.565774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:14.568176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:14.612312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.613220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.614047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.623008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.624230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.625533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.115405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:15.145906 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e236cd4c-9b29-4b14-b17b-de58235ccbbc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1275 microversion: 2.1 time: 0.598907 Oct 04 20:36:15.158716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 492/993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:14 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1275 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:15.173644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.191051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.212231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.212912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.213645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.214593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.215453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.216236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.357433 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c15fe91e-2796-4da1-8543-7893b0514870 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/1e2bb3df-2b25-4e56-aca2-48ed0021d1f0" status: 202 len: 0 microversion: 2.1 time: 5.200093 Oct 04 20:36:15.366494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 502/994] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:36:10 2022] DELETE /compute/v2.1/os-floating-ips/1e2bb3df-2b25-4e56-aca2-48ed0021d1f0 => generated 0 bytes in 5204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:15.381009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.383491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.408058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.438888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.438888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.438888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.438888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.439483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.347856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid faa63f75-12f0-4581-9b6c-2171310b08a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:16.402780 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f9c62c6-021e-4eca-8fca-41860616f197 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 2037 microversion: 2.25 time: 1.242073 Oct 04 20:36:16.429885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 493/995] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 2037 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:16.470812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-unplugged", "status": "completed", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:16.528968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.531936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.533149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.600088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Creating event network-vif-unplugged:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:36:16.625128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:36:16.677968 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5ab236b5-d7cf-4e1c-b662-9c13d83e1d55 req-acc2128f-8ef2-47a6-add0-0b9629bf4b84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.235548 Oct 04 20:36:16.680239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 494/996] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:16.691566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:16.702955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:16.727139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.730615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.730615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.730615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.731971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.733037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.988350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:17.129669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.132900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.163027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.166434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.175677 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7dc72db-93ec-4bb0-8813-462fe6166de4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1535 microversion: 2.1 time: 1.812635 Oct 04 20:36:17.177676 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 503/997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1535 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:17.187366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3fc8d6a-da84-4955-a6fa-805cce97b14b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Action: 'create', calling method: .version_select at 0x7f54f69d1dc0>, body: {"pool": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:17.206981 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0b4917a-29d4-4f7b-94f1-aac9e8027eb3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.523465 Oct 04 20:36:17.227935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 495/998] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:16 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:17.238268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:17.243894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:17.269791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.272370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.272370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.272839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.273830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.275240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.602097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.630685 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1885d10c-8c7b-4daf-a581-61d17335ddfd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1275 microversion: 2.1 time: 0.399459 Oct 04 20:36:17.632342 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 496/999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:17 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1275 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:17.644148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:17.647425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:17.658719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.663767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.664506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.668896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.671184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.672757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.901445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.906620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:17.933966 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3217ee5a-20e5-43c6-acdf-000bbd9ad5d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1275 microversion: 2.1 time: 0.298791 Oct 04 20:36:17.958121 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 497/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:17 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1275 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:17.982548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": "auto"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:17.993502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:18.022910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.023648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.024367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.026123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.033185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.034622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.122310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'flavor' on Instance uuid faa63f75-12f0-4581-9b6c-2171310b08a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:18.162477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:36:19.970867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:20.060842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:25.392516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:25.926150 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c6407ef-9ff1-4960-848f-bea63d9cd4fd tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8/action" status: 202 len: 0 microversion: 2.25 time: 7.963163 Oct 04 20:36:25.928704 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 498/1001] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:36:17 2022] POST /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8/action => generated 0 bytes in 7967 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:25.944216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:25.948876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:25.976584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.982048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.982048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.982048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.982048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.982644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.032261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3fc8d6a-da84-4955-a6fa-805cce97b14b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.852085 Oct 04 20:36:26.033383 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 504/1002] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:36:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:26.047622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.048810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:26.086133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.090806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.091813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.093162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.094054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.100344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.402805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.431969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.436030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.449794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-29b8da5c-7306-46d2-9379-52a0689a1bfa tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1478 microversion: 2.91 time: 0.414457 Oct 04 20:36:26.452332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 505/1003] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:26 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1478 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:26.463601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.465266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:26.492096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.495906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.497088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.498137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.499158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.499918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.985753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:27.007410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c071dddb-76a6-429f-bcac-989165b83288 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1535 microversion: 2.1 time: 1.075299 Oct 04 20:36:27.009182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 499/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:25 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1535 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:27.019729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:27.021730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:27.055551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.056924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.058261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.060321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.062596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.063896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.829481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:27.855709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba24e802-e16f-424c-a08b-e1d830a8b2b3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1317 microversion: 2.1 time: 1.399196 Oct 04 20:36:27.858111 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 506/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:26 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1317 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:28.030956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:28.066774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:28.070228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:28.070228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.099937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] Creating event network-changed:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:36:28.114319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4bce5643-2555-4675-a1c4-f3439821ffc7 req-c513c891-c624-4bed-82c8-23104aa27709 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252821 Oct 04 20:36:28.128536 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 507/1006] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:28.144667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-787052882", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "d4133c60-0102-48e4-be66-6bf5189f9cc1"}], "security_groups": [{"name": "tempest-securitygroup--770805409"}], "key_name": "tempest-keypair-2041462478", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:28.295136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:28.325025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f59d22b-2dae-414b-953e-bf4da27dc097 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 1.305787 Oct 04 20:36:28.333876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 500/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:27 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:28.340227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:28.356257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:28.373456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:28.373456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:28.373456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:28.373456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.374214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:28.376473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:28.377379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.956691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] validate_networks() for [('d4133c60-0102-48e4-be66-6bf5189f9cc1', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:29.397338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:29.421202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:29.427021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:29.430899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b89c5e96-b959-4d55-b8ff-cecdd52c3316 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.097108 Oct 04 20:36:29.434468 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 501/1008] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:28 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:29.448550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57dd4218-c882-4383-9c23-0a952abc956a tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f647fdc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:31.036361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:31.037220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:31.037610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:31.038797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:31.040146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:31.058964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.059756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.060790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.062446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.063332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.065796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.104100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:31.113363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for user 44a42dd2dd73439bbe445de3b2eb9744 and project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:31.139379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:31.144723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:31.360312 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-101a43c4-d32c-4562-bee9-1ec11fc357d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.241820 Oct 04 20:36:31.362494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 508/1009] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 3246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:31.373048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:31.378456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:31.392020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.393927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.395365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.397197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.398368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.399539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.536744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-851029-13". {{(pid=123541) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:36:31.766067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:31.870905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57dd4218-c882-4383-9c23-0a952abc956a tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc" status: 202 len: 0 microversion: 2.1 time: 2.428883 Oct 04 20:36:31.870905 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 502/1010] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:36:29 2022] DELETE /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:32.011021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5327dad2-5f33-44dc-a59c-b673bd325d4b", "tag": "ff2a5972-fee9-4682-9fbb-428af5833ef2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:32.056346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.057216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.058010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.103727 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] Creating event network-changed:ff2a5972-fee9-4682-9fbb-428af5833ef2 for instance 5327dad2-5f33-44dc-a59c-b673bd325d4b on n-h2-851029-13 Oct 04 20:36:32.114700 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-421b020f-25d5-4cdd-8a8f-490e723738c9 req-88c4ddd9-0bd2-4418-b5b8-6fce1418c6ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242089 Oct 04 20:36:32.117062 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 503/1011] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:32.129686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:32.132294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:32.144766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.146350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.147732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.149179 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d8a7d7e-8348-4233-9d38-ebf5153fd2ad tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action" status: 202 len: 0 microversion: 2.91 time: 0.784444 Oct 04 20:36:32.150206 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 509/1012] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:36:31 2022] POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:32.151190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.153033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.154291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.181614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:32.182890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:32.219169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.221785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.222581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.224000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.232936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.234257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.186369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:34.214985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd742187-3437-490b-b7ec-fa401af28a1e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1535 microversion: 2.1 time: 2.094441 Oct 04 20:36:34.218104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 504/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:32 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1535 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:34.236088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:34.236088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:34.258138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.259612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.262435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.265001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.266348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.270062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.613765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:34.626034 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c7719ee-f93e-49fe-83e3-a33aef2a4812 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1317 microversion: 2.1 time: 2.464975 Oct 04 20:36:34.634899 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 510/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:32 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1317 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:34.782137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-plugged", "status": "completed", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:34.803976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.804911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.805675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.829751 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] Creating event network-vif-plugged:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:36:34.840194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f5cc5078-c0ea-4c75-b64f-e410249d70e4 req-0631c210-b834-4f9d-8fec-c53a61ff4cd5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203222 Oct 04 20:36:34.841404 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 511/1015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:34.852225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}, {"name": "network-changed", "server_uuid": "37bc06a5-c7c8-4f58-8fa4-3593dbdd5794", "tag": "04e7bb18-0cec-4ce4-8e6a-b645fb606a91"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:34.874905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.875819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.876611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.905673 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Creating event network-changed:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:36:34.907158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] Creating event network-changed:04e7bb18-0cec-4ce4-8e6a-b645fb606a91 for instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 on n-h1-851029-13 Oct 04 20:36:34.921008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1792a15b-7d33-477d-a48f-62ebe5b3d7d7 req-1d19226a-7ba8-45c8-8b96-eb9e1fc78f22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077107 Oct 04 20:36:34.923181 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 512/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:34.925041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:34.935671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:34.940257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:34.949371 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41bc9f1d-3e83-4b9b-bfd1-496fc8c0008f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 0.727840 Oct 04 20:36:34.951302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.952691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.953893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.955733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.957119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.958691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.964012 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 505/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:34 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:35.009972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.011420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.030250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.034472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.038258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.061169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.061169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.061169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.327340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.352209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fca72402-af27-4c27-a73d-b44f4e7e8a75 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1230 microversion: 2.1 time: 0.385269 Oct 04 20:36:35.354969 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 506/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:34 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1230 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:35.366966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f6c15d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.531980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc could not be found", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:36:35.534048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] HTTP exception thrown: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Request method failure captured: Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc HTTP/1.1 Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJkqsI7BZp-_Oo9p1FVX5NzVDh-iMQyPzGenfobZrJ4zRe8N5jmEv0O_VH6DVKk7D4TQmhO-N1lni5KmAnWPlsA_VwQoUy7OPLeaYT11ZA0uxQfmi8bp_0lNrDL5kBgmdIXx5nfnir4MEbpjhqEcalmls4KTX1rUUNc9klSiBWu6Xmw Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 66612739defa4e3abdd4e602a35dc15e Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:36:35.550353 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 66612739defa4e3abdd4e602a35dc15e Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FloatingIPsTestJSON-974735966-project Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 96821f2611904d8a9f7d3c1a20922f5e Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FloatingIPsTestJSON-974735966-project Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: exception: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8c6d7c57-2269-4248-a4bf-dbdaa19c16bc'} Oct 04 20:36:35.553196 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:36:35.554870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc could not be found Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3bb152f-fd18-4967-ab94-691be2ebc688'] Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc. Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:35.557161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:35.562069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:35.567944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:35.567944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:35.567944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Returning 404 to user: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:35.567944 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-07e9e273-25c3-45ac-b0f1-f5cef10f76e2 tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc" status: 404 len: 111 microversion: 2.1 time: 0.197885 Oct 04 20:36:35.567944 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 507/1019] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:35.589497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.590715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.606249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.607228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.608049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.609473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.610337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.611132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.805940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.811385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.828921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.833784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.834457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.839137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.842636 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6da12dec-114c-4ed9-8b99-023a5521c4c5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 0.915583 Oct 04 20:36:35.844815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 513/1020] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:34 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:35.848177 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63caaf4d-3c7f-44d3-b6d3-d1108c51f6ec tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1486 microversion: 2.91 time: 0.288110 Oct 04 20:36:35.850003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 508/1021] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1486 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:35.857398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.859458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.860701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Calling method '.version_select at 0x7f54f6406a60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.887433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.889747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.891081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.893508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.894730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.895652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.997108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc could not be found", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:36:35.998732 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] HTTP exception thrown: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Request method failure captured: Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc HTTP/1.1 Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJkqsI7BZp-_Oo9p1FVX5NzVDh-iMQyPzGenfobZrJ4zRe8N5jmEv0O_VH6DVKk7D4TQmhO-N1lni5KmAnWPlsA_VwQoUy7OPLeaYT11ZA0uxQfmi8bp_0lNrDL5kBgmdIXx5nfnir4MEbpjhqEcalmls4KTX1rUUNc9klSiBWu6Xmw Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 66612739defa4e3abdd4e602a35dc15e Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:36:36.004692 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_66612739defa4e3abdd4e602a35dc15e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 66612739defa4e3abdd4e602a35dc15e Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FloatingIPsTestJSON-974735966 Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FloatingIPsTestJSON-974735966-project Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 96821f2611904d8a9f7d3c1a20922f5e Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FloatingIPsTestJSON-974735966-project Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: exception: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8c6d7c57-2269-4248-a4bf-dbdaa19c16bc'} Oct 04 20:36:36.007612 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:36:36.009185 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc could not be found Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f9b5d76-2b4c-4501-86c9-cd3069b63699'] Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc. Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.011432 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:36.017345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:36.022345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc Oct 04 20:36:36.022345 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:36.022345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] Returning 404 to user: Floating IP not found for ID 8c6d7c57-2269-4248-a4bf-dbdaa19c16bc {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:36.022345 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0553a67-6d95-47d9-af4b-6afd5bc7265b tempest-FloatingIPsTestJSON-974735966 tempest-FloatingIPsTestJSON-974735966-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc" status: 404 len: 111 microversion: 2.1 time: 0.156214 Oct 04 20:36:36.022345 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 509/1022] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:36:35 2022] DELETE /compute/v2.1/os-floating-ips/8c6d7c57-2269-4248-a4bf-dbdaa19c16bc => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:36.023954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.030375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.063827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.066830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.069350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.069350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.070064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.070891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.387368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.431901 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3cbe773-da0b-498e-8ea2-4db92ac69cdb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1528 microversion: 2.1 time: 0.584694 Oct 04 20:36:36.436348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 514/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1528 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.452544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.455322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.469201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.471223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.472344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.481446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.481446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.481446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.482143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.497371 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d42f517-c9ef-47c2-82ed-ba30ab36ea81 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1317 microversion: 2.1 time: 0.484878 Oct 04 20:36:36.499716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 510/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.511548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.512861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.540936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.542229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.544230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.546895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.548786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.550387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.888177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.912527 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0961bd73-f622-4661-88af-cad3a6375be2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1230 microversion: 2.1 time: 0.410459 Oct 04 20:36:36.938930 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 511/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1230 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.949315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.952683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.982570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.983904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.984827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.986598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.987750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.988646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.198251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.217128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b943e6ef-97e8-41a7-a698-3bb1be5ab7dc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 1.771827 Oct 04 20:36:38.218244 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 515/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:38.229703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:38.231067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:38.245218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.247827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.248871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.250380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.252887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.253936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.347520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.367683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-632d11b4-40c1-4fbc-a11f-df02ec5ca521 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1528 microversion: 2.1 time: 1.450159 Oct 04 20:36:38.371988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 512/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1528 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:38.414697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:38.416369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:38.428034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.429471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.430585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.432331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.433509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.434595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.813389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.840538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.844924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.856586 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-24f460e9-a9aa-4448-b23d-0b10a49877e5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1488 microversion: 2.91 time: 0.462672 Oct 04 20:36:38.875716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 513/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:38 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1488 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:38.905148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:38.906207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:38.922150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.923102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.924468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.925974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.927168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.928270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.640898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.705778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.712813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.717526 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb2cbd5f-cbeb-439c-99d3-2ab553f7be56 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.495874 Oct 04 20:36:39.720079 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 516/1029] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:38 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:39.735870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5327dad2-5f33-44dc-a59c-b673bd325d4b", "name": "network-vif-plugged", "status": "completed", "tag": "ff2a5972-fee9-4682-9fbb-428af5833ef2"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:39.766133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.775019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.775019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.825574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] Creating event network-vif-plugged:ff2a5972-fee9-4682-9fbb-428af5833ef2 for instance 5327dad2-5f33-44dc-a59c-b673bd325d4b on n-h2-851029-13 Oct 04 20:36:39.847662 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5ad4ac0c-4a9b-4a20-8f07-6897a07fda02 req-43bcd766-6d10-49db-9e94-882c6bcfc68d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124581 Oct 04 20:36:39.850512 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 517/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:39.874323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.876798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.895880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.897306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.899606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.904675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.906248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.907548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.056292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:40.082801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b58ce096-866c-4f40-bd0f-32a159049289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1317 microversion: 2.1 time: 1.204214 Oct 04 20:36:40.097553 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 514/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:38 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1317 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:40.271312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:40.302805 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65b03719-ba51-47e7-84a6-25773d0a0ced tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1292 microversion: 2.1 time: 0.447093 Oct 04 20:36:40.306190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 518/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1292 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:40.325881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.328976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.352775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.356162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.357366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.359041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.360217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.361360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.511262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4acdd3f0-3f31-4f91-94ff-504f805f392b tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.527122 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4acdd3f0-3f31-4f91-94ff-504f805f392b tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] HTTP exception thrown: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4acdd3f0-3f31-4f91-94ff-504f805f392b tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Request method failure captured: Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/flavors/cd8dfbed-021b-4a86-b724-2018457d1200 HTTP/1.1 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJgCnVhlkO_IbGCm1oi6OeAWYpmbjm_-zP0Lw5vUfboqpD5f7pFyGOpNLBfjYXMmMP_ekPn1pUakdtOCIgEXGUYng1CEF4VYwSZRcYwtfYFqVXXJ4R2giyfQWrhc7DETfz3UNZnBoTA9X0iqe29Lq5qi5lG1NBpe3tDXyvDFyQ-nOTM Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e9125b118d6543cdbfeab6b2ec3f73a2 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MigrationsAdminTest-1763503901 Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:36:40.531966 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e9125b118d6543cdbfeab6b2ec3f73a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e9125b118d6543cdbfeab6b2ec3f73a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e9125b118d6543cdbfeab6b2ec3f73a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e9125b118d6543cdbfeab6b2ec3f73a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MigrationsAdminTest-1763503901 Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e9125b118d6543cdbfeab6b2ec3f73a2 Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MigrationsAdminTest-1763503901 Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MigrationsAdminTest-1763503901-project-admin Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 563c3d0ee1b4446bbec8dd6bb495917d Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MigrationsAdminTest-1763503901-project-admin Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. Oct 04 20:36:40.534965 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'cd8dfbed-021b-4a86-b724-2018457d1200'} Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:40.538343 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. Oct 04 20:36:40.541462 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:36:40.547220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4acdd3f0-3f31-4f91-94ff-504f805f392b tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Returning 404 to user: Flavor cd8dfbed-021b-4a86-b724-2018457d1200 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:40.549478 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4acdd3f0-3f31-4f91-94ff-504f805f392b tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/cd8dfbed-021b-4a86-b724-2018457d1200" status: 404 len: 109 microversion: 2.1 time: 0.449543 Oct 04 20:36:40.589383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 515/1033] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:40 2022] DELETE /compute/v2.1/flavors/cd8dfbed-021b-4a86-b724-2018457d1200 => generated 109 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:40.600748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.604879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.620607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.621945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.623158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.627639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.629142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.630471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.008023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.024811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.029073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.040008 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cdd885e1-2106-4acd-99aa-8c5a53a3f6c7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.448454 Oct 04 20:36:41.042077 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 516/1034] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:41.052250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-647022613", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:41.083474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:41.129332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:41.285843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:42.640101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:42.683453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-669b02ef-276b-4b12-944f-e28fa233a71c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 2.374712 Oct 04 20:36:42.697257 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 519/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:42.706133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:42.722092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:42.742692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.744604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.746085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.748538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.752080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.756943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.791840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:44.796312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:44.799560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:44.806050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:44.806050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:44.857130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.864412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.867704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.874038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.875781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.877749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.913385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:44.957376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:44.969378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Getting quotas for user 589b60499a914b8886201a339bbef1fe and project 3831b450653944e38a3f7e37b0e68d82. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:45.012743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:45.023259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:45.273499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fc8ffbc-5978-4a18-988c-bd8489551ed4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.224709 Oct 04 20:36:45.294139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 517/1036] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:45.317487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.322461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.350362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.351493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.353173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.354907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.355608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.360937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.360937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.409501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.415005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.419387 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da33cc6b-e1ba-47dc-9f41-21a73e6532d0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 2.719897 Oct 04 20:36:45.420850 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 520/1037] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:42 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:45.435298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.437432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.450392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.451426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.452332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.454143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.456581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.458630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.159641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.196401 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58bbd5c2-9a16-43f0-969e-eeaca99139ba tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1292 microversion: 2.1 time: 0.772161 Oct 04 20:36:46.216109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 521/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1292 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.246914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-plugged", "status": "completed", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:46.268928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.271032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.277391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.303585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] Creating event network-vif-plugged:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:36:46.318367 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-dcf09c99-3823-4cca-858d-181ca77d8c98 req-149c0cef-e543-42e3-8b72-f3d6a60e8d5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099705 Oct 04 20:36:46.325115 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 522/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:46.341980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.351072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:46.377288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.385660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.399341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.401365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.402980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.406759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.048930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:47.083548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:47.090062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:47.124879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8879615-91e2-4329-aa0b-398df6eff762 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.780476 Oct 04 20:36:47.130644 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 523/1040] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:47.164859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa63f75-12f0-4581-9b6c-2171310b08a8", "name": "network-vif-unplugged", "status": "completed", "tag": "29c815c5-af1c-48d7-92d9-63b22043240d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:47.233729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.233729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.233729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.267696 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] Creating event network-vif-unplugged:29c815c5-af1c-48d7-92d9-63b22043240d for instance faa63f75-12f0-4581-9b6c-2171310b08a8 on n-h2-851029-13 Oct 04 20:36:47.297839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c7ef765c-02c9-4703-a80f-c0053118dd5c req-e808b205-9526-4f2a-9d94-e1ef3825e754 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160264 Oct 04 20:36:47.299400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 524/1041] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:47.318636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.320040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.324411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:47.335005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.335934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.336715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.338023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.339813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.344597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.392899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54a0931a-4b57-4f4a-bb70-675c9baaae30 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1466 microversion: 2.1 time: 2.096125 Oct 04 20:36:47.405696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 518/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1466 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:47.425417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4f68d8c-fe3f-4352-92a5-b9eb664a2d61 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.493899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4f68d8c-fe3f-4352-92a5-b9eb664a2d61 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:48.058888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4f68d8c-fe3f-4352-92a5-b9eb664a2d61 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:48.078048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4f68d8c-fe3f-4352-92a5-b9eb664a2d61 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1212 microversion: 2.1 time: 0.667933 Oct 04 20:36:48.116746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 519/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:47 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1212 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:48.130051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:48.131788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:48.148730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.152205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.152205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.152205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.152920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.154591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.905003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:48.965005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75e3b25d-cae8-4211-80cd-27168afb21ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 1.648344 Oct 04 20:36:48.978947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 525/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:47 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:48.986260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:48.998765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:49.040373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.048118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.048118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.048118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.048118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.048661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.804758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:49.850695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:49.850695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:49.868957 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8386f6d-44e5-48ba-bf00-d6992eab07a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.747413 Oct 04 20:36:49.877796 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 520/1045] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:48 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:49.911687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:49.929128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:49.957279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.968638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.968638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.968638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.968638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.969387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.113316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.127331 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a37dc252-47d0-4177-9be1-3688f8324dc3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 1.150251 Oct 04 20:36:50.128946 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 526/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:48 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:50.136463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:50.137610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:50.146892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.148067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.148974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.150743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.151993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.153154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.465412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.484142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.490444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.509130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85d1b67a-2b78-4d83-b5be-ae709c831ca9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.378509 Oct 04 20:36:50.509962 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 527/1047] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:50 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:50.536540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc06a5-c7c8-4f58-8fa4-3593dbdd5794", "name": "network-vif-plugged", "status": "completed", "tag": "04e7bb18-0cec-4ce4-8e6a-b645fb606a91"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:50.579704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.580959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.584530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.654364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] Creating event network-vif-plugged:04e7bb18-0cec-4ce4-8e6a-b645fb606a91 for instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 on n-h1-851029-13 Oct 04 20:36:50.682165 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c6e1a779-4d98-4669-b9ac-05201e869dda req-6b39b00d-540d-4517-b313-263493e1c00b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161288 Oct 04 20:36:50.705062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 528/1048] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:50.721513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:50.727019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:50.748046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.750358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.762883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.771839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.773189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.774027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.084557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:51.116931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a06e7be2-df3f-4c3e-81d4-d2dfd329affb tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1264 microversion: 2.1 time: 0.417865 Oct 04 20:36:51.134301 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 529/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:50 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1264 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:51.178989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa63f75-12f0-4581-9b6c-2171310b08a8", "tag": "29c815c5-af1c-48d7-92d9-63b22043240d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:51.229526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.231046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.232338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.268814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:51.290947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] Creating event network-changed:29c815c5-af1c-48d7-92d9-63b22043240d for instance faa63f75-12f0-4581-9b6c-2171310b08a8 on n-h2-851029-13 Oct 04 20:36:51.302978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-20330b9f-a243-45d8-be03-e02ed788082a req-b6d0de97-d697-4c2f-bd9c-d3f34fe39bee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163714 Oct 04 20:36:51.304566 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 530/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:51.321282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:51.323846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:51.348897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.350413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.351826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.354893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.356007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.357110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.577807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88e60b96-a307-4ce6-9064-2b3c0a341b3d tempest-ServersOnMultiNodesTest-806749476 tempest-ServersOnMultiNodesTest-806749476-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1619 microversion: 2.1 time: 1.697441 Oct 04 20:36:51.586309 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 521/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:49 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1619 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:51.609498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:51.614218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:51.646330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.648734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.650111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.652769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.654950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.656690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.156043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.197683 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb32ecef-5fdd-45d1-ab45-ffa9cd4f0a9b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 0.890929 Oct 04 20:36:52.203092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 531/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:51 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:52.218749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:52.221773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:52.240780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.241672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.242151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.243047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.243598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.244095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.944644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.978725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.982036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.997914 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43bd1243-8de7-41db-b68c-1b4695067456 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.408715 Oct 04 20:36:53.000242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 522/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:51 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:53.057158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.061201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.082515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.083985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.085149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.086822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.088063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.089289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.384964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.412283 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2bc2305c-3b32-4624-a55e-6cbea47a89f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 1.210422 Oct 04 20:36:53.436493 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 532/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:52 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.450087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.451282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.483655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.485590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.487595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.489271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.490421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.491572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.530367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.577755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.586059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.613484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-300a3bc9-f35c-41a0-b2cf-0097e8be16a9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.585617 Oct 04 20:36:53.618103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 523/1055] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:53.622908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:53.639233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.650911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.681431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.684864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.686360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.694265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.695891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.697250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.293534 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2f7310e-f652-4726-8db0-9fe09546537d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 204 len: 0 microversion: 2.1 time: 0.853314 Oct 04 20:36:54.295461 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 533/1056] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:53 2022] DELETE /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:54.320247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.324754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.352348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.355312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.359022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.363500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.366038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.375785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.535192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:54.580436 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4a55850-4572-4405-9417-8c1c821cfe87 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1270 microversion: 2.1 time: 0.958658 Oct 04 20:36:54.591124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 524/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1270 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:54.603390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.605374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.646747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.648421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.651719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.654442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.656981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.658557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.912254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:55.347793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.371613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a01e0d9-7b65-4eb1-87a5-8efb41747e6c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1317 microversion: 2.1 time: 1.073311 Oct 04 20:36:55.380730 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 534/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1317 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:55.396035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.397939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.426480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.433507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.434723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.442370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.443798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.447454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.677828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.713510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.726950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.733551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c4f7d49-8595-46a3-88e9-28c1f141877a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.138942 Oct 04 20:36:55.737397 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 525/1059] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:55.772342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.776459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.818912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.832916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.838998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.848978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.852401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.862382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.745966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:56.788480 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4ec0542-09d9-4eb3-ab09-4f0f0547be78 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1472 microversion: 2.1 time: 1.403898 Oct 04 20:36:56.812758 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 535/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1472 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:56.840596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:56.842428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.856460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:56.859785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.861497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.862652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.865032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.866318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.867701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.955581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.010985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-400babbf-7f44-421c-a3f4-ac26d764dfc8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 1.267235 Oct 04 20:36:57.023685 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 526/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:57.057494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.061932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.112518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.113333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.114811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.116410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.117220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.127377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.366551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.399415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.405740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.434341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79e25278-6ff6-45e2-b51a-887d8487ad52 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.609396 Oct 04 20:36:57.435934 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 536/1062] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:56 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:57.471385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.473525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.499973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.506708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.506708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.506708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.506708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.508053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.067320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:58.412203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.448522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.458755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-248ae46d-1395-4a23-9bd5-9e513dd0d5c2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 1.439703 Oct 04 20:36:58.476555 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 527/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.499014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.502977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.504575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7eb22179-d451-4b1c-bc68-1ae572e315e1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1467 microversion: 2.1 time: 1.059958 Oct 04 20:36:58.506383 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 537/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1467 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.522394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.524377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.526020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.528500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.529817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.532684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.536025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:58.612150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.615949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.615949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.664535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] Creating event network-changed:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h1-851029-13 Oct 04 20:36:58.693781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a3d33088-20fd-46cc-8814-5c0aa6ba08f8 req-e5fff21d-84c1-4d6a-b2b9-0c52b9ff5fde service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177568 Oct 04 20:36:58.696744 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 538/1065] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:58.711365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.713113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.765421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.768058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.770905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.775450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.776344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.781995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.586797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.626949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a619d813-14bb-4207-be0c-fb49d717c187 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1472 microversion: 2.1 time: 0.926656 Oct 04 20:36:59.655891 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 539/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1472 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:59.681084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:59.684998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:59.748268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.750075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.751773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.753660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.755393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.756745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.008341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.048873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.048873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.056998 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b08b8ea-0204-41ef-8824-27095ee020cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 2.588164 Oct 04 20:37:01.058105 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 528/1067] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:01.091442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.097124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.104951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:01.118761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.120773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.121982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.123704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.127099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.129803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.365242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.385385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.410876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.425782 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64f5a7d1-e940-4630-a0a9-5e39e5bb0c29 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 1.745791 Oct 04 20:37:01.427314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.427821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 540/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:59 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:01.451355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c990e60d-73b8-4845-b37a-25fcb90718fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.390822 Oct 04 20:37:01.453952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 529/1069] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:01.455522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.459958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.472068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.474946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.476181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.480144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.481644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.483838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.496270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.498688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.529627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.540213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.540213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.540213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.541459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.543791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.162113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.189397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-898f7d4e-88b7-48a9-8b19-a2aacf64d7f1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.730333 Oct 04 20:37:02.194813 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 530/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.207155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.232323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16905b5a-089b-4f64-88f8-6137a2469433 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1468 microversion: 2.1 time: 0.800083 Oct 04 20:37:02.240756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5327dad2-5f33-44dc-a59c-b673bd325d4b", "name": "network-vif-deleted", "tag": "ff2a5972-fee9-4682-9fbb-428af5833ef2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:02.245225 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 541/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1468 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.265523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.267303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.269514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.286528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.287884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.302452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.303468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.304393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.305776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.306766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.307544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.334829 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] Creating event network-vif-deleted:ff2a5972-fee9-4682-9fbb-428af5833ef2 for instance 5327dad2-5f33-44dc-a59c-b673bd325d4b on n-h2-851029-13 Oct 04 20:37:02.347525 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0a650d9e-a8a2-4632-9cd4-4a43b20a96dc req-f22cc19d-c598-42b6-9cd7-208a29387776 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137041 Oct 04 20:37:02.349444 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 531/1072] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:02.367040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.369639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.384351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.389775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.391419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.393322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.394545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.395719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.397477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.398471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.400143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.401105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 5327dad2-5f33-44dc-a59c-b673bd325d4b {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:02.493882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.520966 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-383f8543-5240-4b00-94ec-279524c83289 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 200 len: 1307 microversion: 2.1 time: 0.259720 Oct 04 20:37:02.541086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 542/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.559060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2120994172"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:02.565082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.580051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.586546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.586546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.586546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.586546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.588869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.833713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.848411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.854194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.861231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d3a0b1c-f5b6-4d72-a8a7-48ce96668459 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 0.505263 Oct 04 20:37:02.867309 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 532/1074] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:02.875353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.880279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.897260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.898433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.901895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.903086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.905424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.906347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.247417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.265227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3995b8a4-3ce4-424c-829b-713c21aed55a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 0.395674 Oct 04 20:37:03.278871 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 533/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:03.278871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.280566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.295219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.297815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.297815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.299506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.300543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.301479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.481464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48982a7a-363a-46a3-bb4f-ba3d376c8e96 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "POST /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a/action" status: 202 len: 0 microversion: 2.1 time: 0.938108 Oct 04 20:37:03.486448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.499178 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 543/1076] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:02 2022] POST /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a/action => generated 0 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:37:03.504902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.513547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.526136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.528804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.536954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7336ffc0-ee41-4f61-bb43-e0f548239169 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.268022 Oct 04 20:37:03.538001 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 534/1077] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:03.562991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6076d1b2-077e-40c2-a2eb-57397934adb9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f63481f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.577107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.579171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.580764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.582311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.591277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.593084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.656978 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6076d1b2-077e-40c2-a2eb-57397934adb9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.111561 Oct 04 20:37:03.658901 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 535/1078] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:03.664677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.665610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 5327dad2-5f33-44dc-a59c-b673bd325d4b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.674087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.674895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.675501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.676646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.677315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.677908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.700250 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b HTTP/1.1 Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:03.703032 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. Oct 04 20:37:03.705605 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '5327dad2-5f33-44dc-a59c-b673bd325d4b'} Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:03.706597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. Oct 04 20:37:03.708822 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.711734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance 5327dad2-5f33-44dc-a59c-b673bd325d4b could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:03.713391 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f43e957-0dec-4e06-ac1f-7ab024cb1cf3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b" status: 404 len: 111 microversion: 2.1 time: 0.053825 Oct 04 20:37:03.714610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 536/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/5327dad2-5f33-44dc-a59c-b673bd325d4b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:04.037496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.056950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:04.062403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d55dd8ce-8e87-4a0d-8d47-592e3ad4005d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.561094 Oct 04 20:37:04.065514 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 544/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:04.076472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.077380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.101763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.102654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.105027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.106645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.107657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.108663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.168396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:04.269209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b96df29-11cd-4112-8e41-da72447809ca tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-540795794", "id": 572606313, "os-flavor-access:is_public": "False"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:04.362086 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b96df29-11cd-4112-8e41-da72447809ca tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.645365 Oct 04 20:37:04.364372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 537/1081] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:03 2022] POST /compute/v2.1/flavors => generated 435 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:04.373712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.375296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.390867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.392185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.392878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.394143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.395171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.395865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.630455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24c40666-43d0-4b8c-af81-bdb908309c6d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 204 len: 0 microversion: 2.1 time: 0.562403 Oct 04 20:37:04.639310 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 545/1082] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:04 2022] DELETE /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:04.654939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.656628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.672680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.672680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.672680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.673816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.674336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.675357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.708265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.717050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:04.732145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.737063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.739838 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4fdd670-ce8f-4945-89e5-1b02117701ee tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 0.373216 Oct 04 20:37:04.741767 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 538/1083] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:04.757953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e84fa1d1-914d-4060-bcb8-f77d78acb7f6 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:05.036437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.047737 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e84fa1d1-914d-4060-bcb8-f77d78acb7f6 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/572606313/action" status: 200 len: 96 microversion: 2.1 time: 0.303517 Oct 04 20:37:05.050398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12b3f3ec-df68-4aa3-be1e-4e24059791ce tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 0.413762 Oct 04 20:37:05.050623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 539/1084] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 4 20:37:04 2022] POST /compute/v2.1/flavors/572606313/action => generated 96 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:05.054572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 546/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.066006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.067225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.078869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.079686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.080495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.080898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:05.081915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.082705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.083384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.102133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.103449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.104540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.130819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] Creating event network-changed:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h2-851029-13 Oct 04 20:37:05.141664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d8e5b1a9-af63-46ed-a7eb-6ad5b2d463d1 req-8b3124e1-d580-4aca-9df8-45df0230c33c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089740 Oct 04 20:37:05.142790 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 540/1086] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:05.153927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.154916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.167723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.168679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.169419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.170769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.171966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.172817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.197044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.210457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.213311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.222958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a44b437c-b9fc-40f7-8719-094e4e5dd0b3 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.166368 Oct 04 20:37:05.224681 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 547/1087] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:05.232324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa64ca8a-ee12-4b97-9392-c7b96df8321a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6346f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.351795 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa64ca8a-ee12-4b97-9392-c7b96df8321a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.121185 Oct 04 20:37:05.351795 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 548/1088] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.359287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc91353e-a541-48ff-a03f-74a26bc0d9a4 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:05.480828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.497818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9386bdb3-8103-4698-b8e6-5cb84e370f28 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1473 microversion: 2.1 time: 0.352701 Oct 04 20:37:05.499141 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 541/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1473 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.523269 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-cc91353e-a541-48ff-a03f-74a26bc0d9a4 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. Oct 04 20:37:05.532924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.534559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.548356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc91353e-a541-48ff-a03f-74a26bc0d9a4 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Request method failure captured: Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/flavors/572606313/action HTTP/1.1 Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 67 Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJltsPXuC1hOLDAB2Fliir2ykCGOBbrIlSLWbro5S2ic6yxN0RrVBEUHt8yGZJm0HYxi7m_beapCZQ2_0eyZ3j4G6Gd9_fNZT_P6Q8N41On8djG5r0pk-xfe-1P5VEhtGBEXvMKhccTNU1ZQsvc_7vnw3Fj39Xp31NiqMBWlv1qBWHY Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:37:05.549644 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c1384b3d28248d597efe834af3118fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 90d8292a165b4ccbbbfcda79594a8f41 Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} Oct 04 20:37:05.551626 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: exception: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '572606313', 'body': {'addTenantAccess': {'tenant': '6ad385b7e9794d7ba8175961a77f4c26'}}} Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:05.552717 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-6ad385b7e9794d7ba8175961a77f4c26' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:37:05.553969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:37:05.556289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:05.558636 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-6ad385b7e9794d7ba8175961a77f4c26' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 37, 5, 488483), 'updated_at': None, 'flavor_id': 36, 'project_id': '6ad385b7e9794d7ba8175961a77f4c26'}] Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:05.569467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:05.590127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:05.592068 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:05.594256 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. Oct 04 20:37:05.594256 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:05.594540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.594540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.594540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.594540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.596087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.596296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc91353e-a541-48ff-a03f-74a26bc0d9a4 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 6ad385b7e9794d7ba8175961a77f4c26 combination. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:05.596296 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc91353e-a541-48ff-a03f-74a26bc0d9a4 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/572606313/action" status: 409 len: 152 microversion: 2.1 time: 0.236235 Oct 04 20:37:05.596296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 549/1090] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 4 20:37:05 2022] POST /compute/v2.1/flavors/572606313/action => generated 152 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:37:05.604556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c3f9e9e-2228-4b83-b14b-56e02f07ba31 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:05.947196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.947722 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c3f9e9e-2228-4b83-b14b-56e02f07ba31 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/572606313/action" status: 200 len: 21 microversion: 2.1 time: 0.347775 Oct 04 20:37:05.963231 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 550/1091] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 4 20:37:05 2022] POST /compute/v2.1/flavors/572606313/action => generated 21 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:05.975783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.977509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.979802 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c94a695-9790-4814-8f21-eeacdcccdb5d tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.478367 Oct 04 20:37:05.981839 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 542/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.998895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.000265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.002030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.003713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.004845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.006191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.022262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2b13066-b814-46d6-8cc4-7f0dea30fd07 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.158330 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2b13066-b814-46d6-8cc4-7f0dea30fd07 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/572606313" status: 202 len: 0 microversion: 2.1 time: 0.171130 Oct 04 20:37:06.173748 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 543/1093] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:37:05 2022] DELETE /compute/v2.1/flavors/572606313 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:06.192670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.193846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.229050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.230575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.231884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.233980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.235010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.236539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.523493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.549594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.558301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.560348 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-275ac78c-1378-4c16-a7ec-b3b3dd3df93c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 0.595252 Oct 04 20:37:06.561303 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 551/1094] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:06.594134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4b5879a-7ccd-4a24-bb31-89d4917ef497 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.663667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.668372 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4b5879a-7ccd-4a24-bb31-89d4917ef497 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096719 Oct 04 20:37:06.670203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 552/1095] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.681099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.682361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.686179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0e92491-ddd9-46d4-9c5f-5acae38de37f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 0.501684 Oct 04 20:37:06.701184 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 544/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.709007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.711187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.712359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.713979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.715237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.716328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.730883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d66646e3-3b30-4798-9aa3-b6856a6c3acc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6342e50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.848936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d66646e3-3b30-4798-9aa3-b6856a6c3acc tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.145613 Oct 04 20:37:06.850606 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 545/1097] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.862137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.863951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.877000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.878383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.879592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.881354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.883755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.885136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.908675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.948358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.962789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.987130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3de08630-5a57-4c0f-9771-61c5b2c11c45 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.314733 Oct 04 20:37:06.987814 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 553/1098] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:07.037488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f602a7-e451-4a89-b005-aa38fd3b6f23 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1639672812", "id": 1634164480, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:07.190287 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46f602a7-e451-4a89-b005-aa38fd3b6f23 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.179136 Oct 04 20:37:07.201767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 554/1099] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:07.201767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.202440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.234877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.235404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.236775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.237607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.238363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.252023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.642734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.662244 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2a012a4-f59d-4b74-aaeb-2cab6d86baa5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1473 microversion: 2.1 time: 0.807953 Oct 04 20:37:07.664307 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 546/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1473 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:07.681406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d884901-6fe5-4de6-bd65-d2c15cd921d0 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.686087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.697784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6d884901-6fe5-4de6-bd65-d2c15cd921d0 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 20:37:07.702932 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f1e0f6e-046e-44b2-a7ec-977f84983905 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.509443 Oct 04 20:37:07.704928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 555/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d884901-6fe5-4de6-bd65-d2c15cd921d0 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Request method failure captured: Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/flavors/1634164480/os-flavor-access HTTP/1.1 Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJltsPXuC1hOLDAB2Fliir2ykCGOBbrIlSLWbro5S2ic6yxN0RrVBEUHt8yGZJm0HYxi7m_beapCZQ2_0eyZ3j4G6Gd9_fNZT_P6Q8N41On8djG5r0pk-xfe-1P5VEhtGBEXvMKhccTNU1ZQsvc_7vnw3Fj39Xp31NiqMBWlv1qBWHY Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:37:07.705514 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c1384b3d28248d597efe834af3118fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 90d8292a165b4ccbbbfcda79594a8f41 Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: exception: Access list not available for public flavors. Oct 04 20:37:07.712434 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'flavor_id': '1634164480'} Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 20:37:07.714307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:07.717028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d884901-6fe5-4de6-bd65-d2c15cd921d0 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:07.717028 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d884901-6fe5-4de6-bd65-d2c15cd921d0 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1634164480/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.040936 Oct 04 20:37:07.717028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 547/1102] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/flavors/1634164480/os-flavor-access => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:37:07.724623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.724623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.736108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.737205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.738117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.739569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.740534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.741404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.743771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc7e709b-be08-46f4-ab5e-36ec3edde99c tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.884801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc7e709b-be08-46f4-ab5e-36ec3edde99c tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1634164480" status: 202 len: 0 microversion: 2.1 time: 0.152851 Oct 04 20:37:07.888527 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 548/1103] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:37:07 2022] DELETE /compute/v2.1/flavors/1634164480 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:07.906126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.907961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.944785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.944785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.944785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.944785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.945607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.945607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.143825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.172226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.185951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.188722 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-971de16f-7d4b-4dd3-adbe-524981cc42f1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 0.480879 Oct 04 20:37:08.199296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 556/1104] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:08.219311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-184dcb50-fae5-419e-901d-d07b10690c75 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62fd550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.314214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.336948 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5cbb1ce-8c5a-460c-8a2e-1766ff5a04af tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 0.445567 Oct 04 20:37:08.340564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-184dcb50-fae5-419e-901d-d07b10690c75 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.138864 Oct 04 20:37:08.346531 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 557/1105] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:08.354847 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 549/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:08.372621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7a5214e-479c-4785-a1dc-4baca592aca9 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.384334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.386022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:08.401805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.403992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.405345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.407876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.409132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.410241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.465116 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7a5214e-479c-4785-a1dc-4baca592aca9 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115921 Oct 04 20:37:08.466780 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 558/1107] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:08.513280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-997c2694-bf18-467b-8584-a810ee22848d tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-837396527", "id": 2057556005, "os-flavor-access:is_public": "False"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:08.562826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.586227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.590382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.601781 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a24ee5c1-a4a0-48f6-addc-3481959111dd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.243963 Oct 04 20:37:08.602978 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 550/1108] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:08.670266 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-997c2694-bf18-467b-8584-a810ee22848d tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.164107 Oct 04 20:37:08.672154 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 559/1109] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:08 2022] POST /compute/v2.1/flavors => generated 438 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:08.713984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.715683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:08.731570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.733744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.739799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.739799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.739799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.741288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.026583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9938ea8c-fb67-459c-bba9-c654cb8b71ca tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:09.034283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9938ea8c-fb67-459c-bba9-c654cb8b71ca tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5efb5c66dd924ef18074049f178b8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad385b7e9794d7ba8175961a77f4c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9938ea8c-fb67-459c-bba9-c654cb8b71ca tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Request method failure captured: Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/flavors/2057556005/action HTTP/1.1 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 67 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJlrnX04CtgQ-q-zwK-QuNCvZpDxR7JpLRSFgyYLxFxj9bLM2Dx29fad4NRiGq4L7KO3zIPV3Hn9brxGoap41LxuUUTtCQeKgXF1uEX_j7iwQRVCamykJ8iIKnc3sv0c02NPtrJE2gA0yB6aX-EhozxNFfTUChLpxZ8-2bwOd-CHTWA Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 6ad385b7e9794d7ba8175961a77f4c26 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:09.043015 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 6ad385b7e9794d7ba8175961a77f4c26 Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsAccessNegativeTestJSON-692838074-project Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5efb5c66dd924ef18074049f178b8e99 Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-692838074-project Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} Oct 04 20:37:09.046120 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2057556005', 'body': {'addTenantAccess': {'tenant': '6ad385b7e9794d7ba8175961a77f4c26'}}} Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:37:09.049844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:37:09.052582 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.056433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9938ea8c-fb67-459c-bba9-c654cb8b71ca tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:09.067481 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9938ea8c-fb67-459c-bba9-c654cb8b71ca tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] 10.222.0.36 "POST /compute/v2.1/flavors/2057556005/action" status: 403 len: 130 microversion: 2.1 time: 0.372425 Oct 04 20:37:09.070233 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 551/1110] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 4 20:37:08 2022] POST /compute/v2.1/flavors/2057556005/action => generated 130 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:09.088533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:09.094198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:09.126299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.134684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.136032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.143511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.144878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.150501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.155754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:09.181113 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-27f81b6a-dcd9-4c81-ba72-20c7215ee051 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1473 microversion: 2.1 time: 0.474009 Oct 04 20:37:09.189610 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 560/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1473 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:09.209052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee1c2f7d-d26b-4da6-9d38-e4f35934ba03 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:09.326339 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee1c2f7d-d26b-4da6-9d38-e4f35934ba03 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2057556005" status: 202 len: 0 microversion: 2.1 time: 0.133919 Oct 04 20:37:09.328447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 561/1112] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:37:09 2022] DELETE /compute/v2.1/flavors/2057556005 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:09.350457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:09.354217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:09.391390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.394836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.397839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.399778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.403350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.408313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.771481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.802484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee8dc625-a8fb-4d02-8a65-95eb577d1ad8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 1.729861 Oct 04 20:37:10.817319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 552/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:09 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:10.839085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0938a066-7df9-467e-b39a-cd6eb2677072 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:10.902365 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0938a066-7df9-467e-b39a-cd6eb2677072 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081485 Oct 04 20:37:10.904733 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 553/1114] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:10.916175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11dc1de0-45d2-4048-a213-4756d2e23a45 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6348310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.098496 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11dc1de0-45d2-4048-a213-4756d2e23a45 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.177980 Oct 04 20:37:11.101822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 554/1115] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:10 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:11.127049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.131126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:11.133482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:11.150261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.154256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.158131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.162893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.165381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.168382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.186269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:11.197484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:11.206745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2e2e561-4966-4de3-8043-3f857378f149 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.870017 Oct 04 20:37:11.208412 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 562/1116] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:09 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:11.245412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.258748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:11.299802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.304124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.307498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.309396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.314050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.316571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.976752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.020549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.032931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.061246 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-666853e8-2441-457d-b352-c06e762ebbc4 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.847159 Oct 04 20:37:12.066613 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 563/1117] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:11 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:12.092992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:12.103864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:12.142334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.145120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.146643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.149677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.151558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.159537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.664648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:13.708595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-17088153-432b-4256-8983-5135b9170772 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 2.602911 Oct 04 20:37:13.712907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 555/1118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:11 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:13.739063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76b988b6-2278-4679-9c0e-e5e34f9e026b tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-366952007", "id": 2143729587, "os-flavor-access:is_public": "False"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:13.921195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76b988b6-2278-4679-9c0e-e5e34f9e026b tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.205696 Oct 04 20:37:13.936530 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 556/1119] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:13 2022] POST /compute/v2.1/flavors => generated 438 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:13.964629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:13.973395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:14.005665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.013540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.018352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.024531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.025736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.031051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.208658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.241936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e86d88a4-8ca4-4fcf-a3de-a97bd21385c9 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1473 microversion: 2.1 time: 2.170386 Oct 04 20:37:14.264249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 564/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:12 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1473 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:14.293597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d180d0ca-71ce-435e-bf73-9ad3a624c009 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6297d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.809021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d180d0ca-71ce-435e-bf73-9ad3a624c009 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.540157 Oct 04 20:37:14.828291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 565/1121] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:14.852960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.856889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:14.888178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.894139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.895823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.899230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.902982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.906362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.084356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.131228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cdc096a1-d58a-46ce-af5f-a73b961a78ca tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 1.189790 Oct 04 20:37:15.153696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 557/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:13 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:15.195687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:15.196545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:15.251243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.252684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.262811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.268844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.270768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.277833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.667350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.705775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.717396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.752852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf3dcdb9-e048-4f27-93d4-600bcdb8cf3d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1531 microversion: 2.91 time: 0.593208 Oct 04 20:37:15.758207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 558/1123] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:15 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1531 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:15.794464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f6c0937-5e31-4f12-8f87-5e1adf1ffdf3 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:16.162504 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f6c0937-5e31-4f12-8f87-5e1adf1ffdf3 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/2143729587/action" status: 200 len: 97 microversion: 2.1 time: 0.397199 Oct 04 20:37:16.194403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 559/1124] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 4 20:37:15 2022] POST /compute/v2.1/flavors/2143729587/action => generated 97 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:16.221893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:16.234031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:16.265670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.271925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.272962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.276086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.277883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.285617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.307876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.349498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.356788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.363548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e108dcf-e97e-49fe-915f-78c53a445747 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1568 microversion: 2.25 time: 1.533164 Oct 04 20:37:16.398412 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 566/1125] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1568 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:16.434416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76569e6-dd77-4716-a061-fb59fbaaf04a", "name": "network-vif-deleted", "tag": "a1e38b08-1d03-4cfe-9a6b-a4d2174861d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:16.494166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.495091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.495874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.548783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] Creating event network-vif-deleted:a1e38b08-1d03-4cfe-9a6b-a4d2174861d5 for instance b76569e6-dd77-4716-a061-fb59fbaaf04a on n-h1-851029-13 Oct 04 20:37:16.567776 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4f37f534-ab3b-4399-ab9c-2a1acccbc7a7 req-0d241f27-6ae5-4256-8463-985fecd09be0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161581 Oct 04 20:37:16.572718 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 567/1126] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:16.599073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:16.600494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:16.631430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.634585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.635636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.638241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.640080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.643258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.820408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.821299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.822096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.822983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid b76569e6-dd77-4716-a061-fb59fbaaf04a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:17.072710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:17.095201 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35a3bec7-4499-4280-a6d6-79518353b46b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 200 len: 1307 microversion: 2.1 time: 0.519537 Oct 04 20:37:17.097299 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 568/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:16 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 1307 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:17.106777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:17.111034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:17.136891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:17.143016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.147476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.156203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.158593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.159970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.161081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.195596 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02a3710a-1cf7-4b2b-9a55-6d0c41bfd82b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 1.004136 Oct 04 20:37:17.200896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 560/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:16 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:17.226623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e851f640-b6cd-4ae2-9551-143fb20c0a59 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6301700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:17.388972 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e851f640-b6cd-4ae2-9551-143fb20c0a59 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.184753 Oct 04 20:37:17.396551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 561/1129] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:17 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:17.417860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-948d89d7-4a21-4b95-a274-2e35f9fab910 tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:17.423254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-948d89d7-4a21-4b95-a274-2e35f9fab910 tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5efb5c66dd924ef18074049f178b8e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad385b7e9794d7ba8175961a77f4c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-948d89d7-4a21-4b95-a274-2e35f9fab910 tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Request method failure captured: Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/flavors/2143729587/action HTTP/1.1 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 70 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJlrnX04CtgQ-q-zwK-QuNCvZpDxR7JpLRSFgyYLxFxj9bLM2Dx29fad4NRiGq4L7KO3zIPV3Hn9brxGoap41LxuUUTtCQeKgXF1uEX_j7iwQRVCamykJ8iIKnc3sv0c02NPtrJE2gA0yB6aX-EhozxNFfTUChLpxZ8-2bwOd-CHTWA Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 6ad385b7e9794d7ba8175961a77f4c26 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:17.434430 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ad385b7e9794d7ba8175961a77f4c26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 6ad385b7e9794d7ba8175961a77f4c26 Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-692838074 Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsAccessNegativeTestJSON-692838074-project Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5efb5c66dd924ef18074049f178b8e99 Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-692838074-project Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: {"removeTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} Oct 04 20:37:17.437421 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2143729587', 'body': {'removeTenantAccess': {'tenant': '6ad385b7e9794d7ba8175961a77f4c26'}}} Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can( Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:17.439222 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:37:17.442140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:17.446717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-948d89d7-4a21-4b95-a274-2e35f9fab910 tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:17.448721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-948d89d7-4a21-4b95-a274-2e35f9fab910 tempest-FlavorsAccessNegativeTestJSON-692838074 tempest-FlavorsAccessNegativeTestJSON-692838074-project] 10.222.0.36 "POST /compute/v2.1/flavors/2143729587/action" status: 403 len: 133 microversion: 2.1 time: 0.048345 Oct 04 20:37:17.449974 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 562/1130] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 4 20:37:17 2022] POST /compute/v2.1/flavors/2143729587/action => generated 133 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:17.458875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:17.461588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:17.482291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.483359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.484205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.486406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.487421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.487994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.526202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lazy-loading 'services' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:17.550139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:17.613332 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0811ea0c-7a23-45c4-a5b0-31687784f86e tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1938 microversion: 2.91 time: 0.513605 Oct 04 20:37:17.615414 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 569/1131] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:17 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1938 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:17.630458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "name": "network-vif-plugged", "status": "completed", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:17.650461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.652362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.653554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.695651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] Creating event network-vif-plugged:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h1-851029-13 Oct 04 20:37:17.726303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2f32c00a-e1f2-470e-8ea3-d95791a085a9 req-c97eb3fe-bd18-47c3-b89b-b2e3ce204ecd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108174 Oct 04 20:37:17.732194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 570/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:17.977672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4dac3588-2e79-4cc0-8571-5f380596de95 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Action: 'create', calling method: .version_select at 0x7f54f62bd3a0>, body: {"keypair": {"name": "tempest-keypair-1912963784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/YO/Y0FYw80gb/6+07fzVw2zOLgjVRpbTFY/mUt8fGAr6m/BOz4uEZexE3n4mIQRRssaossIW2u6SUsOIaLhgEsE3Uh6m1LAGd17izsX0nTprupvO0m7LjXVWB599/zg=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:18.016968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:18.080327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4dac3588-2e79-4cc0-8571-5f380596de95 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Getting quotas for project afffb2be165246a390dfb756e136ec64. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:18.106507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4dac3588-2e79-4cc0-8571-5f380596de95 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Getting quotas for user 2712aab84bfb4eae9501a0e6839efe44 and project afffb2be165246a390dfb756e136ec64. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:18.351932 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4dac3588-2e79-4cc0-8571-5f380596de95 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.617089 Oct 04 20:37:18.353055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 571/1133] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:18.375086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:18.376695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:18.418788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.419936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.421088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.423743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.425217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.426529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.042778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.081903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21f37729-459a-4116-b1ad-58dd7d2b6086 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 1.629615 Oct 04 20:37:19.088884 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 563/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:17 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:19.122474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ab6c947-3787-4c0a-b20c-c5ce8e4e7549 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6ad385b7e9794d7ba8175961a77f4c26"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:19.541970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.589126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ab6c947-3787-4c0a-b20c-c5ce8e4e7549 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/2143729587/action" status: 200 len: 21 microversion: 2.1 time: 0.495594 Oct 04 20:37:19.593733 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 564/1135] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 4 20:37:19 2022] POST /compute/v2.1/flavors/2143729587/action => generated 21 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:37:19.604825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.611590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:19.613707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:19.615092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.617228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1d044a7-cfe9-466e-be07-73a8eb55a4c0 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1543 microversion: 2.25 time: 1.262438 Oct 04 20:37:19.620636 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 572/1136] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:18 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1543 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:19.656809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.657494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.658245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.659611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.661579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.662534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.717983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lazy-loading 'flavor' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:20.033620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:20.038594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b76569e6-dd77-4716-a061-fb59fbaaf04a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:20.161148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.168242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.173985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.183537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.190118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.191220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.330568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a HTTP/1.1 Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:37:20.339781 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. Oct 04 20:37:20.342498 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b76569e6-dd77-4716-a061-fb59fbaaf04a'} Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:20.344441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. Oct 04 20:37:20.347255 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:20.361773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance b76569e6-dd77-4716-a061-fb59fbaaf04a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:20.363834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f890c89-a97f-456d-a3bb-ddbcac4a280b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a" status: 404 len: 111 microversion: 2.1 time: 0.740684 Oct 04 20:37:20.369728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 573/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:19 2022] GET /compute/v2.1/servers/b76569e6-dd77-4716-a061-fb59fbaaf04a => generated 111 bytes in 745 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:20.393741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:20.395719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:20.412329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.416789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.418169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.420130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.434354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.435544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.953908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:20.980610 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80c19415-dde5-48d3-955f-b379a6e103d0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1359 microversion: 2.1 time: 0.610879 Oct 04 20:37:20.983301 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 574/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:20 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1359 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:21.012015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-395a2b54-1ba8-4d75-ad61-e2a55bba701d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6297a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.342168 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7ec8f14-3eb3-4a0c-b1ab-c766aff4d09b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action" status: 202 len: 0 microversion: 2.91 time: 1.727856 Oct 04 20:37:21.355917 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 565/1139] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:37:19 2022] POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action => generated 0 bytes in 1755 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:21.406430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffe0a22d-42bc-4e42-a47e-f3853cd6488a tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.433699 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-395a2b54-1ba8-4d75-ad61-e2a55bba701d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.446697 Oct 04 20:37:21.436329 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 575/1140] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:20 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:21.447373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:21.456485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bda7a8b6-a663-4b9c-9ce9-ca3157be6366 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '.version_select at 0x7f54f62c98b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.462945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bda7a8b6-a663-4b9c-9ce9-ca3157be6366 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.464014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bda7a8b6-a663-4b9c-9ce9-ca3157be6366 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.464951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bda7a8b6-a663-4b9c-9ce9-ca3157be6366 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.501832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bda7a8b6-a663-4b9c-9ce9-ca3157be6366 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3233 microversion: 2.25 time: 0.062994 Oct 04 20:37:21.504080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 576/1141] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 4 20:37:21 2022] GET /compute/v2.1/os-migrations => generated 3233 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:21.515913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.517439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:21.528245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.529483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.530185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.531234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.533215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.534190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.534601 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffe0a22d-42bc-4e42-a47e-f3853cd6488a tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2143729587" status: 202 len: 0 microversion: 2.1 time: 0.178380 Oct 04 20:37:21.535728 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 566/1142] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:37:21 2022] DELETE /compute/v2.1/flavors/2143729587 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:21.565200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-plugged", "status": "completed", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:21.601565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.621118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.622448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.650958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] Creating event network-vif-plugged:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:37:21.663841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-082f692d-94cc-4715-9f25-7ffe59bd6fcd req-8cec658c-e6b0-458d-94bf-3eee6bc07072 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124830 Oct 04 20:37:21.665956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 567/1143] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:21.679226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.680741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:21.693340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.695041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.696704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.698336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.699560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.700670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.805457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:21.811710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:22.435750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.468492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7691a9e8-9e33-425f-ad4f-1a00e0de3225 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.961433 Oct 04 20:37:22.472998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 577/1144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:21 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:22.484705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.487075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.508276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.509383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.510354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.512013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.513419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.514567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.001475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0fa47d0-8b0c-43c8-8408-c823e25c5cd3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 204 len: 0 microversion: 2.1 time: 1.331733 Oct 04 20:37:23.003424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 568/1145] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:21 2022] DELETE /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 0 bytes in 1336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:23.024134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:23.025875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:23.056737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.060090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.065241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.067199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.073606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.078490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.481897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.500127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.504444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.529297 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e74a4c15-501d-4744-946f-5141bf9c6612 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 1.054076 Oct 04 20:37:23.534799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 578/1146] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:23.550552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e17bcf5-1250-4355-8ccd-d25fe117cdfb tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:23.646138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e17bcf5-1250-4355-8ccd-d25fe117cdfb tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107083 Oct 04 20:37:23.652497 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 579/1147] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:23.670710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:23.676840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:23.705501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.708328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.708328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.709007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.709845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.710608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.873888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid faa63f75-12f0-4581-9b6c-2171310b08a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:23.915512 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e3f1eac-53c0-40bf-b050-5b0eddd33a89 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 2037 microversion: 2.25 time: 0.907604 Oct 04 20:37:23.919397 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 569/1148] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:23 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 2037 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:23.936745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-317221cc-eb03-43f7-834c-11a3c1ba8b5e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f640cdc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.114244 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-317221cc-eb03-43f7-834c-11a3c1ba8b5e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.184987 Oct 04 20:37:24.118622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 570/1149] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:23 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:24.168161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.178637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:24.227578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.232342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.233661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.238888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.240260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.242483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.429477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:24.463434 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b26b389-958b-45c9-9b98-e9af59553ba0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1542 microversion: 2.1 time: 0.801480 Oct 04 20:37:24.465569 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 580/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:23 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1542 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:24.486168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.489016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:24.515376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.517285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.518718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.521222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.522922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.524805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.099619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.106003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.126145 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5e36d41-e4f5-46ba-b66f-34276532eb75 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1472 microversion: 2.1 time: 1.004485 Oct 04 20:37:25.130502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-29b89613-2ef8-43c4-8bb8-0ab18212bd76 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 0.653568 Oct 04 20:37:25.138048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 581/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:24 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.148500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1339dcd3-4d4d-4a9a-ae98-a5494951988d tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-51998941", "id": 1935261278, "os-flavor-access:is_public": "False"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:25.154431 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 571/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:24 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1472 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.189470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "name": "network-vif-plugged", "status": "completed", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:25.231613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.233103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.234259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.269662 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] Creating event network-vif-plugged:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h2-851029-13 Oct 04 20:37:25.282726 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f7f154ad-a53d-4395-a0df-d162e3823bac req-c5159805-14b4-40ea-8350-a12127c23390 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125949 Oct 04 20:37:25.284244 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 572/1153] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:25.305815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-953eb9d7-6776-45c5-9239-62f07601f763 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: .version_select at 0x7f54f633cb80>, body: {"keypair": {"name": "tempest-keypair-1944346279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkmLTK4JDvM+ZhRcVe20+QZaqV6lLoUZGlRmsv63KoQLkwPLyID2vNRa+aOI91V9NcuAbV5FIZv+6TCfZEwWcE/xKx1hO2Y49aohMTUUcPDa5Qn+pFI8Kvg68tL+VtX2Q=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:25.349560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1339dcd3-4d4d-4a9a-ae98-a5494951988d tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.208843 Oct 04 20:37:25.351287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-953eb9d7-6776-45c5-9239-62f07601f763 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for project ccb7a2196402402a880493998d67e44b. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:25.362039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-953eb9d7-6776-45c5-9239-62f07601f763 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for user 07dfa4ed8d314142a365c3e67fe5b334 and project ccb7a2196402402a880493998d67e44b. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:25.375691 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 582/1154] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/flavors => generated 437 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:25.396853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.397610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.413564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.419151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.419151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.419151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.419151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.420705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.502222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-953eb9d7-6776-45c5-9239-62f07601f763 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.210679 Oct 04 20:37:25.507523 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 573/1155] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 220 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:37:25.532427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.539506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.586760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.587686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.588821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.590210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.596983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.597924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.002691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.038894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.052599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.083980 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2bba0024-7bb9-4bce-8546-c5e4ff164013 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.564400 Oct 04 20:37:26.085966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 574/1156] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:26.097137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa093be9-f4ae-42da-bf06-6449b5897684 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62c88b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.174642 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abf3588b-7c4d-4ea2-b01d-2d77b5040874 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.796922 Oct 04 20:37:26.175759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 583/1157] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-interface => generated 284 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:26.215088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-910c2f87-f16d-406b-8c9e-7feae118a60e tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "49a58625447147a984b6d2060e56e118"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:26.264355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa093be9-f4ae-42da-bf06-6449b5897684 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.175882 Oct 04 20:37:26.273472 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 575/1158] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:26.286225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.288929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.308516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.309937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.311143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.313515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.315524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.318134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.453853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-910c2f87-f16d-406b-8c9e-7feae118a60e tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] HTTP exception thrown: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-910c2f87-f16d-406b-8c9e-7feae118a60e tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Request method failure captured: Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/flavors/1935261278/action HTTP/1.1 Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 70 Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJltsPXuC1hOLDAB2Fliir2ykCGOBbrIlSLWbro5S2ic6yxN0RrVBEUHt8yGZJm0HYxi7m_beapCZQ2_0eyZ3j4G6Gd9_fNZT_P6Q8N41On8djG5r0pk-xfe-1P5VEhtGBEXvMKhccTNU1ZQsvc_7vnw3Fj39Xp31NiqMBWlv1qBWHY Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:37:26.461521 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c1384b3d28248d597efe834af3118fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c1384b3d28248d597efe834af3118fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0c1384b3d28248d597efe834af3118fe Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-627727097 Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 90d8292a165b4ccbbbfcda79594a8f41 Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: {"removeTenantAccess": {"tenant": "49a58625447147a984b6d2060e56e118"}} Oct 04 20:37:26.466337 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: exception: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1935261278', 'body': {'removeTenantAccess': {'tenant': '49a58625447147a984b6d2060e56e118'}}} Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 20:37:26.467959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.470410 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. Oct 04 20:37:26.477365 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:26.479465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-910c2f87-f16d-406b-8c9e-7feae118a60e tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Returning 404 to user: Flavor access not found for 40 / 49a58625447147a984b6d2060e56e118 combination. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:26.481549 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-910c2f87-f16d-406b-8c9e-7feae118a60e tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1935261278/action" status: 404 len: 124 microversion: 2.1 time: 0.287470 Oct 04 20:37:26.484058 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 584/1159] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 4 20:37:26 2022] POST /compute/v2.1/flavors/1935261278/action => generated 124 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:26.516622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.518289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.542496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.546030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.554627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.556406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.557610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.559719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.406438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.431965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-856d5438-e40b-4911-b935-969baa245449 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1312 microversion: 2.1 time: 1.155958 Oct 04 20:37:27.459277 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 576/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1312 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:27.485629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a63b80a-82a3-4aa4-8cbd-32544f7a521c tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.599436 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a63b80a-82a3-4aa4-8cbd-32544f7a521c tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1935261278" status: 202 len: 0 microversion: 2.1 time: 0.137172 Oct 04 20:37:27.600861 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 577/1161] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:37:27 2022] DELETE /compute/v2.1/flavors/1935261278 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:27.632989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.634838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.659602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.672199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.673458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.675520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.676939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.677987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.704341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.732397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c96c9148-056d-4fbb-8814-0fcaa1a3636b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1472 microversion: 2.1 time: 1.243661 Oct 04 20:37:27.737167 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 585/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1472 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:27.763627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f8b37e0-1f25-491d-b5b2-5de26bd5cb99 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62c9280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.925983 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f8b37e0-1f25-491d-b5b2-5de26bd5cb99 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.181505 Oct 04 20:37:27.928379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 586/1163] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:27.956741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ef123fc-b843-4faf-aaf6-fba4ec1e3f77 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:28.040657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ef123fc-b843-4faf-aaf6-fba4ec1e3f77 tempest-FlavorsAccessNegativeTestJSON-627727097 tempest-FlavorsAccessNegativeTestJSON-627727097-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.109786 Oct 04 20:37:28.042007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 587/1164] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:28.274303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.308224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.332803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.366586 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf2ab975-d023-441b-93fb-004a4150dff2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.755215 Oct 04 20:37:28.374004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 578/1165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:28.487127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:28.509985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:28.518242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:28.555444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.559466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.560743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.585151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.597514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.597514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.772392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d19da983-26ca-44f7-8742-bade31d97657"}], "security_groups": [{"name": "tempest-securitygroup--1800145995"}], "key_name": "tempest-keypair-1912963784", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:30.026726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] validate_networks() for [('d19da983-26ca-44f7-8742-bade31d97657', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:30.519217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:30.544629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba7b2157-1682-4add-8b4f-3e045932c94a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1461 microversion: 2.1 time: 2.060532 Oct 04 20:37:30.550801 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 588/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:28 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1461 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:30.563792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:30.577559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:30.605752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.608576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.610527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.616376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.623722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.631511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.802350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.803157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.803964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.808640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:30.973413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.026203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2eff2c7d-3372-4d7b-8f26-ee0103619b0b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 200 len: 1306 microversion: 2.1 time: 0.468807 Oct 04 20:37:31.029247 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 589/1167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:30 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 1306 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:31.041518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb7bc74c-dae7-4582-8b3f-f119d83a6fc0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a7dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.204629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb7bc74c-dae7-4582-8b3f-f119d83a6fc0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.172441 Oct 04 20:37:31.229909 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 590/1168] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:31.250854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.252631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:31.280952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.284019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.288690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.292358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.293742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.295511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.558348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.613663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.619821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.737317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee1c283e-9b77-4864-a0cc-6b9228f6bcfd tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.504642 Oct 04 20:37:31.743801 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 591/1169] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:31.782019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7", "name": "network-vif-deleted", "tag": "b4d9bf17-aed8-4190-ae8e-d3e0779f0372"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:31.837979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.839473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.840311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.861763 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] Creating event network-vif-deleted:b4d9bf17-aed8-4190-ae8e-d3e0779f0372 for instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 on n-h1-851029-13 Oct 04 20:37:31.897873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6ef27d1f-21f0-4a3c-b51f-3d7f49f1fcc6 req-0a1536d2-e313-48eb-9c7d-c9a5619541e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151937 Oct 04 20:37:31.913759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 592/1170] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:31.963516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.964885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.009556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.019169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.031969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.031969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.034977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.038040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.785139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:32.786043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:32.787463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:32.788181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:32.789784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:32.831063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.832042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.832900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.834408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.847858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.849147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.927869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Getting quotas for project afffb2be165246a390dfb756e136ec64. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:32.948326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Getting quotas for user 2712aab84bfb4eae9501a0e6839efe44 and project afffb2be165246a390dfb756e136ec64. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:33.001280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:33.006796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:33.286402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12bc5e6b-5b8c-4923-a925-79a39e64773a tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1614 microversion: 2.1 time: 1.370274 Oct 04 20:37:33.292323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 593/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1614 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:33.305483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:33.333390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.335876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.337372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.381845 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] Creating event network-changed:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h1-851029-13 Oct 04 20:37:33.415317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-07856e6e-c789-48a9-be19-00e6be286165 req-22476a53-e81a-4e60-b8c2-b043dd3bee69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110650 Oct 04 20:37:33.416931 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 594/1172] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:33.420222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1d1afbe-c7ab-451d-875b-95ec9c756139 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.662719 Oct 04 20:37:33.438102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 579/1173] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 4686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:37:33.450742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.452165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.459058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1bc0580-5753-436c-9d24-8f3e7c064eeb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62faf70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.495825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.496982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.497899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.499601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.506436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.508728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.581200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 HTTP/1.1 Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:37:33.584300 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. Oct 04 20:37:33.587214 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7'} Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:33.589752 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. Oct 04 20:37:33.592602 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:37:33.612059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:33.618342 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1bc0580-5753-436c-9d24-8f3e7c064eeb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.178189 Oct 04 20:37:33.620640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a429cb7-1957-463e-992c-83353cae08ce tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7" status: 404 len: 111 microversion: 2.1 time: 0.201077 Oct 04 20:37:33.622737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 595/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/servers/ba93d1fa-a9cf-4ee1-91ba-8917a0b236d7 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:33.629652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 580/1175] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:33.650291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.658902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:33.660726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.671346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.693126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.726348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.726348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.726348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.726348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.727642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.733397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.734964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.736727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.741832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.753767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.757159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.894476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '563c3d0ee1b4446bbec8dd6bb495917d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9125b118d6543cdbfeab6b2ec3f73a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:33.904029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] flavor_id is None. Assuming migration. {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 20:37:33.905194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:37:34.817290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.894412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.911329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.970057 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed84a731-6444-4ff9-b575-9d6efe5b621c tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 1.343005 Oct 04 20:37:34.981961 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 596/1176] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:35.009659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e50c6a5-a594-4a25-b6f7-765c7ab61f92 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.010914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e50c6a5-a594-4a25-b6f7-765c7ab61f92 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.040986 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7af91c77-14dd-4026-be56-4ed7ef7533f9 tempest-MigrationsAdminTest-1763503901 tempest-MigrationsAdminTest-1763503901-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e/action" status: 202 len: 0 microversion: 2.1 time: 1.408891 Oct 04 20:37:35.055811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 581/1177] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:33 2022] POST /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e/action => generated 0 bytes in 1425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:35.074002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.083183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.095713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.097118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.098434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.099794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.100908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.103549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.256823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:35.434282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e50c6a5-a594-4a25-b6f7-765c7ab61f92 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.476929 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e50c6a5-a594-4a25-b6f7-765c7ab61f92 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1226 microversion: 2.1 time: 0.492678 Oct 04 20:37:35.512211 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 597/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:34 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1226 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:35.532640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b1726fe-8035-466e-b2fb-419f3aba005d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62bd3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.650475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b1726fe-8035-466e-b2fb-419f3aba005d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.136192 Oct 04 20:37:35.652447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 598/1179] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:35.662801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.664477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.678938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.684640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.686325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.688863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.690144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.691358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.886260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85e44508-5a23-4a78-9088-122c6e480bc3 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 204 len: 0 microversion: 2.1 time: 0.824904 Oct 04 20:37:35.887788 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 582/1180] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:35 2022] DELETE /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:35.919584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.921152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.957419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.958854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.960057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.961466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.965888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.976446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.131788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:36.542051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.589257 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23a5c5ef-a5f5-4d97-84ad-7e62b019f792 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1470 microversion: 2.1 time: 0.934500 Oct 04 20:37:36.628049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 599/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1470 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:36.645518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.646701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.683369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.684823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.685964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.692536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.694187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.695659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.732675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:36.797638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81af5c01-bac2-4cc2-b82b-20b0ef5b4a9e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 204 len: 0 microversion: 2.1 time: 0.895137 Oct 04 20:37:36.799804 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 583/1182] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:35 2022] DELETE /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 0 bytes in 902 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:37:36.826335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.828014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.849117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.852585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.854029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.858808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.860869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.864054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.954918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.990726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.005199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.030211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08b9a7b8-b5b0-4309-8477-b0141677aa10 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.396740 Oct 04 20:37:37.031865 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 600/1183] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:37.048580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e74fb4e5-afa6-4811-adbc-7405998f85f1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a1700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:37.220483 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e74fb4e5-afa6-4811-adbc-7405998f85f1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.182024 Oct 04 20:37:37.229282 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 601/1184] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:37 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:37.279367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:37.281466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:37.301992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.304685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.308313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.311341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.313178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.314493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.321767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.326083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:37.348840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb57107f-6d8a-481e-96f2-be3e718aa048 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1230 microversion: 2.1 time: 0.542007 Oct 04 20:37:37.353528 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 584/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1230 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:37.647647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-656386400", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3fe9fa00-ea40-44c6-8d74-c6204519a84b"}], "security_groups": [{"name": "tempest-securitygroup--319817367"}], "key_name": "tempest-keypair-1944346279", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:38.796138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] validate_networks() for [('3fe9fa00-ea40-44c6-8d74-c6204519a84b', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:39.424328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.450168 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2347b9b4-3d6f-4259-909c-6c55d60f836c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1475 microversion: 2.1 time: 2.218869 Oct 04 20:37:39.459360 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 602/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:37 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1475 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:39.472632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:39.486335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:39.520523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.521918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.523104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.527452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.528620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.536140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.005695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.045305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cbf5febd-6877-42c1-951b-26c53dfedffe tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1470 microversion: 2.1 time: 1.582988 Oct 04 20:37:41.048069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 603/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:39 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1470 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:41.069927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.080692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.121364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.122125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.126990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.128491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.130308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.131129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.490994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.527104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.534564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.550714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b0b6fe5-107e-47f8-a1ac-96885e698689 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.500262 Oct 04 20:37:41.581213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 604/1188] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:41.598057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d431fc23-f5c5-4f3b-9c8c-8d898e1b15cf tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a1ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.648964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:41.650084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:41.651119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:41.651945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:41.657969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:41.719045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.720973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.721788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.725832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.728996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.729967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.788570 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d431fc23-f5c5-4f3b-9c8c-8d898e1b15cf tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.197940 Oct 04 20:37:41.806755 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 605/1189] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:41.823021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:41.829388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.834197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.862717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.866902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for user 07dfa4ed8d314142a365c3e67fe5b334 and project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:41.868221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.869369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.879250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.880553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.884003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.948190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:41.964543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:41.976482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:42.230366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:42.261199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa48e1f7-5978-455d-a82c-f56d6e61fa71 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1284 microversion: 2.1 time: 0.451326 Oct 04 20:37:42.264295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 606/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1284 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:42.290828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.292790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.321080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.322438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.323551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.325149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.326277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.327364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.330080 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5300c1b-0c79-4554-a2bc-5cfb7f811be8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 4.693531 Oct 04 20:37:42.366913 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 585/1191] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:37:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 4732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:37:42.376349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8733460-26b3-42c2-98aa-0dba3731185f", "name": "network-vif-deleted", "tag": "a221cf1e-e46f-497c-963f-8c61abc62d9d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:42.463234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.471082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.471082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.518853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] Creating event network-vif-deleted:a221cf1e-e46f-497c-963f-8c61abc62d9d for instance b8733460-26b3-42c2-98aa-0dba3731185f on n-h2-851029-13 Oct 04 20:37:42.530518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d674f2de-ec32-4cc0-a9d8-b340f7e915f8 req-a97a2204-04c6-492f-b3e7-fa19a92b1c27 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161079 Oct 04 20:37:42.539963 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 586/1192] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:42.585812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ee9be3-b277-4ab4-bfaf-498945328c9c", "name": "network-vif-unplugged", "status": "completed", "tag": "dea2a79d-77f9-484d-b232-19d202747864"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:42.592110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:42.614104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92da814c-0247-4726-975b-d7ff50f20e63 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1433 microversion: 2.1 time: 0.347029 Oct 04 20:37:42.644958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 607/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1433 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:42.679528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.683499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.696059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.704522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.710313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.748400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.753920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.757836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.768322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.771582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] Creating event network-vif-unplugged:dea2a79d-77f9-484d-b232-19d202747864 for instance 44ee9be3-b277-4ab4-bfaf-498945328c9c on n-h1-851029-13 Oct 04 20:37:42.775890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.778952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.809721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d485c2ce-0aae-41e7-97f6-febf083c1232 req-35fa0633-973c-4874-a77a-986b7ee29893 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.263994 Oct 04 20:37:42.809721 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 587/1194] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:42.832118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.834574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.561842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.604973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.612024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.627350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-400559ab-5917-45a7-bee1-0f037a827e65 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1285 microversion: 2.25 time: 0.809076 Oct 04 20:37:43.647007 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 588/1195] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1285 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:43.671028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.674469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.703408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.707346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.707346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.711665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.712811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.715234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.200371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.238329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.245517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.268731 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f90dbbf-bce2-4557-9c74-2ca37ae6f40f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.615976 Oct 04 20:37:44.286722 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 589/1196] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:44.297181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-819d52fb-ac67-439e-874a-1e3d0d72dc3c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6301af0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.417524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.444833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-036830f8-7cfe-4467-9c9b-b7bb4b6fb56f tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1470 microversion: 2.1 time: 1.791936 Oct 04 20:37:44.450933 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 608/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1470 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:44.479199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ee9be3-b277-4ab4-bfaf-498945328c9c", "name": "network-vif-deleted", "tag": "dea2a79d-77f9-484d-b232-19d202747864"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:44.512870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.514825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.516732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.532712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-819d52fb-ac67-439e-874a-1e3d0d72dc3c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.253390 Oct 04 20:37:44.538194 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 590/1198] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:44.564187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.569206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.585165 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] Creating event network-vif-deleted:dea2a79d-77f9-484d-b232-19d202747864 for instance 44ee9be3-b277-4ab4-bfaf-498945328c9c on n-h1-851029-13 Oct 04 20:37:44.592390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.593205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.594700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.595867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.597643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.598616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.605379 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ea75a286-852b-4930-a63a-93f5a50973e2 req-952a3eb5-afc1-4012-8afb-243ece474a3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144951 Oct 04 20:37:44.607626 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 609/1199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:44.620071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.622915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.643137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.643137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.643137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.646938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.648425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.650206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.763684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.771154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.774561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.782842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 44ee9be3-b277-4ab4-bfaf-498945328c9c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:44.900337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.935674 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e9cef54-0ddc-40ba-ae64-4f2beef5efde tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1284 microversion: 2.1 time: 0.394844 Oct 04 20:37:44.943779 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 591/1200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:44.967565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.972058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.030641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.032279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.037685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.039242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.040161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.046572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.161114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.195111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-af42e800-bfc1-457f-afda-b2cf61f197d6 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1309 microversion: 2.1 time: 0.580411 Oct 04 20:37:45.208998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 610/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:45.349943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.353900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.371312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.372116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.372583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.373460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.374170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.375554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.403162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.446095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.448210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.449406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1376e8d5-e9e3-4d42-bcb5-3640618df59f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1289 microversion: 2.25 time: 0.502915 Oct 04 20:37:45.479147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:45.481251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 592/1202] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1289 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:45.513533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.519336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.587997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.589088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.591605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.593969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.595413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.596678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.842034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.891263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.891263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.926520 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdbf3309-8dab-48b8-907a-64b2b032265a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.585951 Oct 04 20:37:45.927711 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 611/1203] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:45.948618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1516cfed-b018-4e02-a834-ce325b6da0d6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62bd3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.242551 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1516cfed-b018-4e02-a834-ce325b6da0d6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.312860 Oct 04 20:37:46.258405 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 612/1204] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:46.282229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.284058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.308364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:46.329007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.336052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.341612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.347224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.351546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.365212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.528766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.551106 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-501588f8-182a-4a48-9549-b86e35637b98 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1470 microversion: 2.1 time: 1.049547 Oct 04 20:37:46.560314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 593/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1470 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:46.588476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.592242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.612323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.613165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.613914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.616671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.622876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.625141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.722771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.724231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.725564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.727374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 44ee9be3-b277-4ab4-bfaf-498945328c9c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:46.914375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.932507 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-382ef4a9-cce9-438e-a0e1-095059520423 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 200 len: 1309 microversion: 2.1 time: 0.370121 Oct 04 20:37:46.933901 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 594/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:46.943911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.945089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.957341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.958216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.959403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.960855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.961748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.962538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.040027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.056152 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a411d721-5c7d-40f9-b044-2d925b0dc29d tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.795168 Oct 04 20:37:47.057662 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 613/1207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:47.130081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.154409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.157964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.160784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16cecea3-4e7f-4b93-b71a-82c1253c05de tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1337 microversion: 2.25 time: 0.224747 Oct 04 20:37:47.171450 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 595/1208] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1337 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:47.195812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.197707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.213343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.215058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.216291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.217923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.219271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.221126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.420669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Calling method '.version_select at 0x7f54f6325dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.444986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.448663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.450112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.519035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.522032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.523511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.557736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.597703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.604261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.664397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.664397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.664397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.664397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.665371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.665371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.665798 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fcd5ec0a-40cc-425a-993d-321075d2b56f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.482229 Oct 04 20:37:47.665798 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 596/1209] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:47.733451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-931fed81-66a9-4936-9c28-dd72728a5633 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6309820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.782888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.784207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.785584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.822725 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9636dbdd-8537-4b59-ad88-983c5ca1d12f tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 3026 microversion: 2.53 time: 0.763213 Oct 04 20:37:47.831519 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 614/1210] 10.222.0.36 () {60 vars in 1243 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 3026 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:47.857062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.859528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.872745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.873936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.879706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.879706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.879706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.879706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.945614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-931fed81-66a9-4936-9c28-dd72728a5633 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1453 microversion: 2.1 time: 0.244610 Oct 04 20:37:47.947788 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 597/1211] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:47.962030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Calling method '.version_select at 0x7f54f6309f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.973330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.988606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.990387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.036783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.037936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.039405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.130836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.131497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.132833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.157894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.159213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.160353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.272425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.273405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.274213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.291271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-855fe2bf-ca5e-4760-8b98-492b0f7452d9 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1636 microversion: 2.53 time: 0.340169 Oct 04 20:37:48.293197 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 598/1212] 10.222.0.36 () {60 vars in 1222 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1636 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:48.313663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.316237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 44ee9be3-b277-4ab4-bfaf-498945328c9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.330737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.332095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.333184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.334905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.336077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.337271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.369806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c HTTP/1.1 Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:48.374157 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. Oct 04 20:37:48.383686 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '44ee9be3-b277-4ab4-bfaf-498945328c9c'} Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:48.385424 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. Oct 04 20:37:48.388406 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:48.391714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance 44ee9be3-b277-4ab4-bfaf-498945328c9c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:48.391714 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e3f0379-a2cb-4a11-b1ee-3bd3212bcf70 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c" status: 404 len: 111 microversion: 2.1 time: 0.083537 Oct 04 20:37:48.396389 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 599/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/44ee9be3-b277-4ab4-bfaf-498945328c9c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:48.411028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.415112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.426689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.428109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.429308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.430999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.432197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.433252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.702772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.729488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a77763ee-5278-4f69-8de4-8ff43b2ebcd6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1470 microversion: 2.1 time: 0.895021 Oct 04 20:37:48.745079 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 615/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1470 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:48.762150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.763106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.777320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.778485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.785240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.785240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.785240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.785240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.958148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.975406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.977965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.981236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.983536 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18f2c270-1c47-4442-8641-a1a225692ade tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1345 microversion: 2.25 time: 0.236360 Oct 04 20:37:48.985573 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 616/1215] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1345 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:48.993230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63a99388-071a-49d4-888c-8e438612e8ee tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.594244 Oct 04 20:37:48.995555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Calling method '.version_select at 0x7f54f62a1160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.004802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.006079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.007198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.012782 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 600/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:49.036648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.037835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: b8733460-26b3-42c2-98aa-0dba3731185f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.059297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.062612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.062612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.062612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.063253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.065460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.065830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.066985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.068024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.084762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ed03d13-ba8f-4a21-8ff0-1baebe979310 tempest-HypervisorAdminV253TestBase-1654996647 tempest-HypervisorAdminV253TestBase-1654996647-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/6361d94b-2b86-47bd-9e0f-49b8b8b8e1cc" status: 200 len: 793 microversion: 2.53 time: 0.096807 Oct 04 20:37:49.086847 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f HTTP/1.1 Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:49.095469 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. Oct 04 20:37:49.113386 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b8733460-26b3-42c2-98aa-0dba3731185f'} Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:49.115153 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. Oct 04 20:37:49.117656 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:49.122680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance b8733460-26b3-42c2-98aa-0dba3731185f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:49.122680 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98e37641-1d0a-4552-a21c-78dc7a24bdaa tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f" status: 404 len: 111 microversion: 2.1 time: 0.078089 Oct 04 20:37:49.123111 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 617/1217] 10.222.0.36 () {60 vars in 1298 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/os-hypervisors/6361d94b-2b86-47bd-9e0f-49b8b8b8e1cc => generated 793 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:49.123385 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 601/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/b8733460-26b3-42c2-98aa-0dba3731185f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:49.123385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-155ff26c-8537-456c-b296-aa83c439ec44 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62c83a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.146890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.149623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.171402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.176246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.176246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.176246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.176753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.177663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.270514 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-155ff26c-8537-456c-b296-aa83c439ec44 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1462 microversion: 2.1 time: 0.169378 Oct 04 20:37:49.291119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 602/1219] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1462 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:49.306759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c177f18-422e-46cc-a093-f32dc7fc1400 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.450904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.471367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.474881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.485427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6cb771f-188c-440a-a430-c01822c9faf2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1558 microversion: 2.91 time: 0.385655 Oct 04 20:37:49.487154 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 618/1220] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1558 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:49.507427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d15066c-24ce-49c6-abe4-0702ba3f252d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62fd820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.612195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c177f18-422e-46cc-a093-f32dc7fc1400 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/53bbeaa0-cac8-4d0c-a0a9-d8a3f552fd34" status: 204 len: 0 microversion: 2.1 time: 0.318360 Oct 04 20:37:49.613591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 603/1221] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 20:37:49 2022] DELETE /compute/v2.1/os-server-groups/53bbeaa0-cac8-4d0c-a0a9-d8a3f552fd34 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:49.627098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99682fbd-7ae5-4afa-825c-4be5bed0870c", "tag": "54ee3188-3589-4012-af7b-f07a79da4dc4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:49.630764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d15066c-24ce-49c6-abe4-0702ba3f252d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 200 len: 1462 microversion: 2.1 time: 0.140319 Oct 04 20:37:49.633573 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 619/1222] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 1462 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:49.637390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.641698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.647601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.648765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.649410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.650398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.651269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.651962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.654499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.657617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.659102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.679900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:49.688328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] Creating event network-changed:54ee3188-3589-4012-af7b-f07a79da4dc4 for instance 99682fbd-7ae5-4afa-825c-4be5bed0870c on n-h1-851029-13 Oct 04 20:37:49.700530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-669b1985-9a9b-4f09-9a5e-2d59f8b0c2bb req-540ffae3-5031-447f-aca5-4a2cfb942eb5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083169 Oct 04 20:37:49.702255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 604/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:49.705677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:49.714276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.716431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.733726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.735313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.735689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.738312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.739326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.741193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.206280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.227850 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a38429b8-319e-499b-9942-42dfe2aefda0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1481 microversion: 2.1 time: 0.522715 Oct 04 20:37:50.243358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 605/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1481 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:50.275763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.277214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:50.292631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.294366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.295660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.298057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.299278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.300265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.493928 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9cc101b5-7d11-4563-99d8-17a22b9a814b tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 204 len: 0 microversion: 2.1 time: 0.860860 Oct 04 20:37:50.500535 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 620/1225] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:49 2022] DELETE /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:50.509493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.515841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:50.534828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.536596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.537696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.539088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.545441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.545441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.371013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:51.391174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55189254-cb90-405b-b940-82f69dd426cc tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1475 microversion: 2.1 time: 1.144581 Oct 04 20:37:51.414177 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 606/1226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1475 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:51.429096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.431193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:51.442921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.444254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.445509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.470918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.470918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.470918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.654341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:51.689429 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e28fe29-5f49-4fe5-af57-f73ee763e79b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 1.192777 Oct 04 20:37:51.705210 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 621/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:51.735529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.736852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:51.757622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.758759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.759417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.760508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.761528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.762514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.770790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:51.834766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:52.048897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.073810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.085107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.091746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b0dd49e-feea-42cc-956b-140f879df8a4 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.674509 Oct 04 20:37:52.106798 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 607/1228] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:51 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:52.126703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.126703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.159364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.159909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.161068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.162697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.163734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.167776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.408475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.412988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:52.420543 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c19ce62-4c3d-4ec0-a979-5033e4ea11fd tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 204 len: 0 microversion: 2.1 time: 0.712497 Oct 04 20:37:52.431367 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 622/1229] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:51 2022] DELETE /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:52.440807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.444603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.465182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51f35371-abe7-427d-8dec-d2f3f215424e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.368726 Oct 04 20:37:52.468005 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 608/1230] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:52.477616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.486036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.495687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.501577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.518022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.519586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.520869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.525365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.525957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.529604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.529604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.530175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.530347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.531555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.536906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.537881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.187550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.194199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.214727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-407f605f-40cd-4615-b7ad-8612517f8598 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1468 microversion: 2.1 time: 0.770941 Oct 04 20:37:53.216975 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 623/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1468 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:53.227149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.228767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.241840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.242273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bad5adc-4470-4fd6-ab25-786499e12e44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 200 len: 1473 microversion: 2.1 time: 0.743946 Oct 04 20:37:53.243169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.243736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 609/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 1473 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:53.244314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.245736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.246769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.247983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.298415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.300162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.316918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.317627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.318617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.320073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.320972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.321817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.585201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:53.817233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.839947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2bcc89a1-ab07-40f8-950a-a77237c7d080 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1475 microversion: 2.1 time: 0.620161 Oct 04 20:37:53.846265 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 624/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1475 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:53.858558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.876284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.882045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.883925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.885210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.895401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.902740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.903746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.940038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.958884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9d994bb-72be-4880-a6b6-85b56200c053 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.713357 Oct 04 20:37:53.963010 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 610/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:53.997815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-435348373"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:54.002651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.015565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.016661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.017707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.019513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.021308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.022867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.558389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.578459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.595338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.602375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a2f0a18-f204-47be-8c16-b4a2bba1f534 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.750343 Oct 04 20:37:54.657704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 625/1235] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:54.675697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.681847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.709778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.711184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.712426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.714049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.723929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.725214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.995284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.056545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.059918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.079468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97d67c88-5fd5-4979-bdc1-6d7f410a2a1d tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.419194 Oct 04 20:37:55.095554 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 626/1236] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:55.105054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.106598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.138012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.145140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.146413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.149374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.150641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.151805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.279990 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac1cabb4-92e9-4c54-84cd-ff5ecaba4367 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "POST /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794/action" status: 202 len: 0 microversion: 2.1 time: 1.314236 Oct 04 20:37:55.284093 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 611/1237] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:53 2022] POST /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794/action => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:37:55.312238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24e46bc-0ab9-4a3f-9e8b-805008409ed5", "name": "network-vif-deleted", "tag": "201f8485-a296-4877-bf93-e21850f4706f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:55.351934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.353435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.354496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.407702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] Creating event network-vif-deleted:201f8485-a296-4877-bf93-e21850f4706f for instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 on n-h2-851029-13 Oct 04 20:37:55.425743 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-735a90bf-ceb3-4679-8e93-c75f727eb068 req-a2b6a8cd-09e3-4997-b3f1-6a7531c0cb82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134772 Oct 04 20:37:55.427984 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 612/1238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:55.463242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.465328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.478212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.483827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.490467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.492520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.493925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.495235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.633575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.684430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73d74475-067e-4585-9073-8ad3fb5d15d8 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 200 len: 1303 microversion: 2.1 time: 0.584596 Oct 04 20:37:55.689177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 627/1239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:55 2022] GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 1303 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:55.715174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-unplugged", "status": "completed", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:55.758410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.762160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.767214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.801342 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] Creating event network-vif-unplugged:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:37:55.817716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-172b58c0-b7f7-4ca0-8174-46ad03391ceb req-1ac3ce95-655f-421a-a9e4-b6f6dd6c5d16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122439 Oct 04 20:37:55.819500 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 628/1240] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:55.848987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.851082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.888375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.895473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.903776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.906250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.928421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.929376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.473426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:56.507567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a5a9a57-a793-4c6b-ae9c-af40a35a2de3 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1475 microversion: 2.1 time: 1.068493 Oct 04 20:37:56.510401 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 613/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:55 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1475 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:56.553372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a44bd403-1782-4d8f-882e-2c2213a8c11b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62c8430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.618414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:56.647381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a034800c-2029-4eca-9139-d4dae17b169b tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.825111 Oct 04 20:37:56.667447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 629/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:55 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:56.694861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.696419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.709532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.710968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.712065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.713718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.714959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.716080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.832472 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a44bd403-1782-4d8f-882e-2c2213a8c11b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.314885 Oct 04 20:37:56.846702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 614/1243] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:56.865227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.869241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.898222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.903207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.908806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.910770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.912186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.913415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.448022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.505332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.515687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.516051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.542064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8116091-1939-4bb9-b759-4c1611dce402 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.699957 Oct 04 20:37:57.550646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.552007 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 615/1244] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:57.570186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.594917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.595369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: a24e46bc-0ab9-4a3f-9e8b-805008409ed5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.595547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a10300fb-998b-4170-b700-bdbc367d1be1 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.925870 Oct 04 20:37:57.609294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.610601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.611854 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 630/1245] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:57.612429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.614093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.615384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.616423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.639069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:57.689302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. Oct 04 20:37:57.692205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 HTTP/1.1 Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:37:57.694010 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. Oct 04 20:37:57.696623 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a24e46bc-0ab9-4a3f-9e8b-805008409ed5'} Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:57.698101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. Oct 04 20:37:57.699686 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:37:57.701441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.701441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.714087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance a24e46bc-0ab9-4a3f-9e8b-805008409ed5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:57.715765 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c679fb9d-7af9-403e-a541-3f36df9ef46c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5" status: 404 len: 111 microversion: 2.1 time: 0.155461 Oct 04 20:37:57.721906 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 616/1246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/a24e46bc-0ab9-4a3f-9e8b-805008409ed5 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:57.734465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.736324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.738715 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] Creating event network-changed:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h2-851029-13 Oct 04 20:37:57.754516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.755078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-45f648f3-2367-4d84-b5ae-10d303d50ff6 req-e33609ad-8dde-4f6c-b15a-a393a3fa8c62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139451 Oct 04 20:37:57.756349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.757704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 631/1247] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:57.767043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.767043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.767043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.767043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.772983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.774165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.793412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.796215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.798709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.801157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.802847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.804198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.479730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:58.531542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b96cc59-a0c6-4390-b24d-1ceb1ffc64f8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.769785 Oct 04 20:37:58.536754 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 632/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.546077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.562032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:58.604634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.605078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.606038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.610649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.619675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.621968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.716307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:58.753076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a7129a6-949a-4e16-852d-87a4f0e532f2 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1475 microversion: 2.1 time: 1.027031 Oct 04 20:37:58.766754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 617/1249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1475 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.807437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d50fc097-7f2f-4236-bd8d-669146c46ce2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f627ef70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.877017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:58.901273 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7fb49731-5f5e-4e7c-a53c-1bbce04cb85e tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1303 microversion: 2.1 time: 0.362416 Oct 04 20:37:58.902097 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 633/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1303 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.939088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.940790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:58.956777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.957773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.960022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.961615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.963320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.964598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.976719 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d50fc097-7f2f-4236-bd8d-669146c46ce2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.206703 Oct 04 20:37:58.977786 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 618/1251] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.987613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.988826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.002705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.004032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.005165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.006764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.007989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.009377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.259448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.281503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.285289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.301971 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89f7a9f0-6a41-4558-bc4c-6313a5358388 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.378218 Oct 04 20:37:59.303739 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 634/1252] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:59.396809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.417784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.422024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.427383 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9eef642-97c9-4ba6-b7ed-f2e347ca1b64 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.446054 Oct 04 20:37:59.430037 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 619/1253] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:59.484651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99682fbd-7ae5-4afa-825c-4be5bed0870c", "name": "network-vif-plugged", "status": "completed", "tag": "54ee3188-3589-4012-af7b-f07a79da4dc4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:59.503493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.504530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.508556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.512000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:59.533275 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] Creating event network-vif-plugged:54ee3188-3589-4012-af7b-f07a79da4dc4 for instance 99682fbd-7ae5-4afa-825c-4be5bed0870c on n-h1-851029-13 Oct 04 20:37:59.544286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0c0aa6db-a9c9-4702-b8ba-f598763506bf req-92a159d3-a273-4cb4-8e71-a96418360204 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068641 Oct 04 20:37:59.550977 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 635/1254] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:59.581071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:59.581385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.612586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.617809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.621970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.627741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.634569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.640442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.807839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:59.815020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.854700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.862147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.866002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.872216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.876225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.884496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.330958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.357745 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d91d73b-1bb6-43bb-8a58-f9eab82172b5 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.783624 Oct 04 20:38:00.360836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 620/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:59 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.376466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea45c7a-5b53-4e36-ab04-bc5feeb81a28", "name": "network-vif-deleted", "tag": "93a11930-432b-43ae-bcc5-258edeb0d8c4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:00.412827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.413482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.414122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.471078 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] Creating event network-vif-deleted:93a11930-432b-43ae-bcc5-258edeb0d8c4 for instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 on n-h2-851029-13 Oct 04 20:38:00.489257 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d3e3e655-d93c-4a25-881d-99a1eb7c905f req-b2c485b3-3995-4a4c-8534-2f7d25e15bec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124938 Oct 04 20:38:00.493988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 621/1256] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:00.506711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.509494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.526843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.527521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.528657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.530337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.532611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.532611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.553528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.599815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99ab98cd-5fce-47b7-b30c-ee7ae473abd5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1475 microversion: 2.1 time: 0.800016 Oct 04 20:38:00.616950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.618252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.619751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.621094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:00.626950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 636/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:59 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1475 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.657124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57a52f5e-1b36-4682-ad6a-72be23bba016 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6285430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.720485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.740750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e94e6e5e-8d1d-474f-97b5-2b7adee4e2c5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1308 microversion: 2.1 time: 0.243574 Oct 04 20:38:00.742252 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 622/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.753551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.755184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.768826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.770196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.771584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.773304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.774512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.775554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.800068 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57a52f5e-1b36-4682-ad6a-72be23bba016 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.170578 Oct 04 20:38:00.815208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 637/1259] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.830581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.837019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.863215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.863215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.863215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.866256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.867459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.871575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.010184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.068955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.081613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.112875 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f186a4a-eff3-41c2-9b50-69b32fa87b50 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.367934 Oct 04 20:38:01.173285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 623/1260] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:01.411925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:01.426628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:01.432232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.444826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:01.498053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.498053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.498053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.498053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.500179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.500179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.500819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.500819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.500819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a365f503-b710-465d-b252-cbdb94a00827 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.677249 Oct 04 20:38:01.505895 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 638/1261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:01.669748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:01.671754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:01.701736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.702694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.705797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.707201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.708084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.708909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.315422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.365520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-974d87d1-faa8-4cd6-898b-4268a268cc42 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1352 microversion: 2.1 time: 0.964896 Oct 04 20:38:02.372139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 624/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:01 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1352 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.401660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.401660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.436452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.439255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.442324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.442324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.444019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.445112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.476677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.520676 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e6f57f5-3edb-495c-88cd-f11998021a94 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1474 microversion: 2.1 time: 0.860250 Oct 04 20:38:02.522403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 639/1263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:01 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1474 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.527830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.528872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.529771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.530774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:02.540347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e89300d1-5040-4d79-9a10-518d6a1eb734 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62c9a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.720073 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e89300d1-5040-4d79-9a10-518d6a1eb734 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.193587 Oct 04 20:38:02.721160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 640/1264] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.742273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.743542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.784488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.785432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.786267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.787630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.788482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.789268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.908297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.952230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00213952-1d80-456e-9973-2e7384a76b44 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 200 len: 1308 microversion: 2.1 time: 0.568226 Oct 04 20:38:02.973317 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 625/1265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 1308 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.984655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.986648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.024694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.028946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.030821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.034393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.036129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.037359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.107579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.131396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.135468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.145712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a67c55e3-4570-4d4d-8520-cc51f1fa0aa8 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.422251 Oct 04 20:38:03.149059 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 641/1266] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:03.380168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc06a5-c7c8-4f58-8fa4-3593dbdd5794", "name": "network-vif-plugged", "status": "completed", "tag": "04e7bb18-0cec-4ce4-8e6a-b645fb606a91"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:03.414595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.415865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.416563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.446821 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] Creating event network-vif-plugged:04e7bb18-0cec-4ce4-8e6a-b645fb606a91 for instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 on n-h1-851029-13 Oct 04 20:38:03.464404 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-71e011e2-50e7-4f3b-8c96-0704912d6bfc req-7d88fe01-7af1-40b9-8452-6b18dae88bb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094714 Oct 04 20:38:03.465521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 642/1267] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:03.481266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.482585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.493951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.495315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.496784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.500881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.502025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.503165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.766271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.787435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.792577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.795851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9398222e-86a8-4504-8596-369f057df0a6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.820253 Oct 04 20:38:03.835205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 626/1268] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:03.847454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.848633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.867509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.869384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.877240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.877240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.877240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.877240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.924310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:04.032738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:04.059828 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0ea1b52-264f-4073-910a-b1513e21ef16 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1543 microversion: 2.1 time: 0.586401 Oct 04 20:38:04.074979 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 643/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1543 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:04.104879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4a2e766-5f29-416e-8be2-c15b93fd8c3e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a1e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.229178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4a2e766-5f29-416e-8be2-c15b93fd8c3e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.152215 Oct 04 20:38:04.231781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 644/1270] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:04.247268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.249786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.269878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.271911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.274141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.276729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.278616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.285938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.332118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 HTTP/1.1 Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:38:04.343906 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. Oct 04 20:38:04.346947 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1ea45c7a-5b53-4e36-ab04-bc5feeb81a28'} Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:04.348648 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. Oct 04 20:38:04.351889 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.361809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance 1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:04.364178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fcb5411-ee86-44bc-a0ff-4e6274a98167 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28" status: 404 len: 111 microversion: 2.1 time: 0.129662 Oct 04 20:38:04.367557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 645/1271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/1ea45c7a-5b53-4e36-ab04-bc5feeb81a28 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:04.395944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.399525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.428300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.429169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.434896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.434896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.434896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.434896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.825936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f21651f5-a121-4b9e-9c61-3e903ef68fa1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.454011 Oct 04 20:38:04.830888 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 646/1272] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c/os-interface => generated 285 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:04.855200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.857006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.880303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.883863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.885410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.887283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.889123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.890533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.035874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.070910 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce249881-452f-4b3d-b1ce-0a25f4cd9943 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1474 microversion: 2.1 time: 1.233217 Oct 04 20:38:05.072190 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 627/1273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1474 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.089659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38103a14-b3de-491e-b52c-c94820f2f19d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.277540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.293519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38103a14-b3de-491e-b52c-c94820f2f19d tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/27777efb-1e07-421d-84df-00daf501aeaf" status: 204 len: 0 microversion: 2.1 time: 0.219219 Oct 04 20:38:05.295182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 628/1274] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 20:38:05 2022] DELETE /compute/v2.1/os-server-groups/27777efb-1e07-421d-84df-00daf501aeaf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:05.312645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "name": "network-vif-unplugged", "status": "completed", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:05.342081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.347852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.354203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.354203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.354203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.361996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a2f04e1-068c-4e30-9c5a-21d3b0759fd9 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.527153 Oct 04 20:38:05.363709 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 647/1275] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:05.375398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.375957 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Creating event network-vif-unplugged:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h1-851029-13 Oct 04 20:38:05.377461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:05.388910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] Instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:38:05.392336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.397054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.397054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.397054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.400626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.401752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.422352 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-63ea6cac-1275-4da0-aa10-42cb3c042615 req-d7d0c4db-c889-4aa5-938c-298f109f7c76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123903 Oct 04 20:38:05.433700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 629/1276] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:05.455912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31e94fd5-cf28-43c3-ace6-b44f10521a20 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f628bd30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.604207 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31e94fd5-cf28-43c3-ace6-b44f10521a20 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.167138 Oct 04 20:38:05.621698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 630/1277] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.651157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.653283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:05.682422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.683329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.684093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.695757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.696665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.697486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.829028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:06.352082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1da97a5-0098-457a-99d4-289debde9c0c tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 204 len: 0 microversion: 2.1 time: 0.721157 Oct 04 20:38:06.363890 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 631/1278] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:05 2022] DELETE /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:06.381993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.385719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.407304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.408689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.409783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.411713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.412908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.413889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.902344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.933226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.947439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.958966 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e83f495-4bdc-483a-b38a-4b9b87b9866e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 1.586216 Oct 04 20:38:06.963887 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 648/1279] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:07.025922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.027253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.042600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.044940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.046824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.048495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.049713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.051547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.356708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.388160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-620129e4-69ff-4781-8d67-0a125fa1adcd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1474 microversion: 2.1 time: 1.021459 Oct 04 20:38:07.394114 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 632/1280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1474 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:07.407161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.417147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.458839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.464219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.465626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.467358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.468659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.471975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.790459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.826895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.830893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.856090 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec5e8473-e2db-46b9-b0c3-0aaca4b709d5 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.459199 Oct 04 20:38:07.857633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 633/1281] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:07.877770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90d30794-5b0c-45d0-a82c-d749f8ea32d3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f624b430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.937730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.968436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5206204-05fd-4c65-a739-cf560f77fec5 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1473 microversion: 2.1 time: 0.981362 Oct 04 20:38:07.973420 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 649/1282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1473 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:07.993580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:08.081618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.084717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.088071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.167046 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Creating event network-changed:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h1-851029-13 Oct 04 20:38:08.207941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] Instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:38:08.257120 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9d2b1976-b9da-4385-94d7-9d994b5dc85f req-2f40e43f-834a-4b91-bc78-4af3ca37b358 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278695 Oct 04 20:38:08.260379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 650/1283] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:08.288970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.288970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:08.306025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.322884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.330559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.339091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.340935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.346536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.103893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.141387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.146025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.149281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b80635ea-1044-48b8-80d2-b7251d2be0bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.884175 Oct 04 20:38:09.151441 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 651/1284] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:09.174525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.181222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.209685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.213048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.218559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.220636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.228412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.230337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.600579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:10.658148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1c43f73-9fe7-4475-b2f6-a0636335e010 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1474 microversion: 2.1 time: 1.490406 Oct 04 20:38:10.666710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 652/1285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1474 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:10.691345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.693691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.715128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:10.755012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.755936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.756936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.760966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.762054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.762899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.168668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.201567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.206188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.224046 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45189cd8-af52-4499-b242-cca188825d57 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.552634 Oct 04 20:38:11.273225 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 653/1286] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:11.297240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:11.298274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:11.332818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.336834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.337919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.339311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.340793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.342071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.540036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.560409 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16f8bfb4-02d4-4c1a-a604-fd6cbc08b230 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1431 microversion: 2.1 time: 0.277864 Oct 04 20:38:11.567212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 654/1287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:11 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1431 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:11.588065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "name": "network-vif-plugged", "status": "completed", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:11.612418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.613526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.614170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.638740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] Creating event network-vif-plugged:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h2-851029-13 Oct 04 20:38:11.650419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-47e4b69f-c26d-4aa3-93ec-1cd55ebbe127 req-1cd98bca-7788-4f8a-9063-9fbfd9a8518f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072822 Oct 04 20:38:11.652611 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 655/1288] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:11.667285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:11.677271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:11.691817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.692702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.693693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.697464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.698697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.700973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.291681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:12.341569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:12.350727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:12.353842 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f96ffba2-7eb8-41b3-852d-ba36c3334053 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 0.698392 Oct 04 20:38:12.388448 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 656/1289] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:11 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:12.418714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:12.420366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:12.432629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.434173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.436068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.439881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.441293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.442479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.063524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.118352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf3c9d4b-e4c2-4169-a25f-32cad2e84970 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1472 microversion: 2.1 time: 0.727947 Oct 04 20:38:13.138818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 657/1290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:12 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1472 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:13.162698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ea1f23-cdc1-4fac-b05e-46c2bfeaac78", "name": "network-vif-deleted", "tag": "32eb5f97-9481-4222-9e74-bec41e719ae9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:13.210769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.212408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.217895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.229661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:13.272829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] Creating event network-vif-deleted:32eb5f97-9481-4222-9e74-bec41e719ae9 for instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 on n-h2-851029-13 Oct 04 20:38:13.296234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b76e4216-df85-40d4-aa7a-686c306cb1c1 req-d9c8ff55-f625-4c67-9700-c6b8e3836539 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164655 Oct 04 20:38:13.300333 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 658/1291] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:13.314456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.322191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:13.352576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.353321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.353784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.354615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.355434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.359460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.695479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.776976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.793941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.824495 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de5c30a6-ce0b-422d-9b83-14942da62cba tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 0.522110 Oct 04 20:38:13.829218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 659/1292] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:13.858105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.860861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:13.888449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.894942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.895683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.900272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.901770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.902612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.055571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.056338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.057180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.058034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lazy-loading 'fault' on Instance uuid 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:14.147970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb0b6816f268493aaf8944363f2bd618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7a2afde38148faab4850e9d2f191bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:14.188454 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1693e6a8-6890-4226-9555-64e82b1383d4 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 200 len: 1307 microversion: 2.1 time: 0.339725 Oct 04 20:38:14.206787 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 660/1293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:14.222883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:14.222883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:14.243544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.244469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.245941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.252697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.256001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.257343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:17.050261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:17.079834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:17.096667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:17.104099 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ebce0ce0-6d7b-41be-b977-5199b351f0f5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1410 microversion: 2.25 time: 2.903007 Oct 04 20:38:17.113845 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 661/1294] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:14 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1410 bytes in 2915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:17.151593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:17.152819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:17.190135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:17.191194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:17.192043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:17.193318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:17.204678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:17.207248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:17.849960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:17.849960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:19.351197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:19.388877 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07aa37fd-721f-4c52-be90-efa4c848e826 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1469 microversion: 2.1 time: 2.273766 Oct 04 20:38:19.393274 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 662/1295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:17 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1469 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:19.422444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:19.433782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:19.455979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.456874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.461882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:19.470912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.472084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.473090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.023200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.055485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.059456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.098116 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0e161994-a3cc-499a-93da-446e41970f71 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 1.697523 Oct 04 20:38:21.103306 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 663/1296] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:19 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:21.116841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.118417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] [instance: 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.136078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.138409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.140280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.142258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.144202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.145380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.230224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] HTTP exception thrown: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Request method failure captured: Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 HTTP/1.1 Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhLsX7X791s0ELrtk1B62LKmuakq-Bnl68Wy_SMYcH0s_bLmwAkbmGMiaNXdHRpKL_oOuHTWq4hatSmCVXuhSrKxzxuEPwISuDkeovRopBpxkZCGnPHtLL2KyU53VjHOaNBJgV17f5CkXPhBzBF7IOFSCjuE5J2dIt3v_vz6zOj8lI Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:38:21.239047 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3d7a2afde38148faab4850e9d2f191bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3d7a2afde38148faab4850e9d2f191bb Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1105196166 Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: fb0b6816f268493aaf8944363f2bd618 Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersOnMultiNodesTest-1105196166-project Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. Oct 04 20:38:21.242146 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '17ea1f23-cdc1-4fac-b05e-46c2bfeaac78'} Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:21.243989 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. Oct 04 20:38:21.246786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:21.251315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] Returning 404 to user: Instance 17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:21.253219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aba4cbbf-4251-4f4b-82fc-48bbe780b553 tempest-ServersOnMultiNodesTest-1105196166 tempest-ServersOnMultiNodesTest-1105196166-project] 10.222.0.36 "GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78" status: 404 len: 111 microversion: 2.1 time: 0.147458 Oct 04 20:38:21.262646 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 664/1297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/17ea1f23-cdc1-4fac-b05e-46c2bfeaac78 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:21.288685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99682fbd-7ae5-4afa-825c-4be5bed0870c", "tag": "54ee3188-3589-4012-af7b-f07a79da4dc4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:21.325556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.327594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.331603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.370256 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] Creating event network-changed:54ee3188-3589-4012-af7b-f07a79da4dc4 for instance 99682fbd-7ae5-4afa-825c-4be5bed0870c on n-h1-851029-13 Oct 04 20:38:21.384875 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-67a2b100-a479-481f-9282-b4caf7806160 req-89af02ce-ca96-43e5-b777-c278fb57d571 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115093 Oct 04 20:38:21.395350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 665/1298] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:21.420033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.426118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.456421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.464286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.464286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.464286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.464286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.465225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.713093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.804796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.808652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.816552 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63448bab-6655-4f25-a56e-499c65e60b78 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1606 microversion: 2.25 time: 2.417107 Oct 04 20:38:23.830545 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 666/1299] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1606 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:23.868615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:23.872900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.908807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.918250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.918250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.918250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.918250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.919034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.157546 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90d30794-5b0c-45d0-a82c-d749f8ea32d3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 16.291530 Oct 04 20:38:24.163278 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 634/1300] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 16305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:24.171041 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] HTTP exception thrown: Instance has not been resized. Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Request method failure captured: Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e/action HTTP/1.1 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 20 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJf8jO7HV77FSVp3qWoAlN0MKeLnZGMr_Y1z4Z7ctyTXppgd8FUn5RHW6Tr9YnsOkAMMn2jfQELQV_QYl2BChAtQvkNhTOE2235d-ZMHyzV3oUty68q-ROhBVYCukMLaOFvrVPu6PxEvBuyDiyj5g7Jt3vtbEqZSzFyP7JZ664H_S6c Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:38:24.190424 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 589b60499a914b8886201a339bbef1fe Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: {"revertResize": {}} Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance has not been resized. Oct 04 20:38:24.193167 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '03fcdb48-2ff8-4a26-9f37-1d709d58656e', 'body': {'revertResize': {}}} Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1010, in _action_revert_resize Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.revert_resize(context, instance) Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3908, in revert_resize Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi migration = objects.Migration.get_by_instance_and_status( Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/migration.py", line 164, in get_by_instance_and_status Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_migration = db.migration_get_by_instance_and_status( Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 224, in wrapper Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 3300, in migration_get_by_instance_and_status Oct 04 20:38:24.195218 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.MigrationNotFoundByStatus(instance_id=instance_uuid, Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.MigrationNotFoundByStatus: Migration not found for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e with status finished. Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1013, in _action_revert_resize Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Instance has not been resized. Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:24.197671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance has not been resized. Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Returning 400 to user: Instance has not been resized. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf004bc9-cc0b-4053-befd-1fffe6cbb6d6 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "POST /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e/action" status: 400 len: 74 microversion: 2.1 time: 0.368893 Oct 04 20:38:24.217831 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 667/1301] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:23 2022] POST /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e/action => generated 74 bytes in 379 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:38:24.219537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "name": "network-vif-plugged", "status": "completed", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:24.252209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:24.267654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:24.307242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.308785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.315907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.327480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.328501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.329233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.330596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.331528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.332391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.397675 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Creating event network-vif-plugged:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h1-851029-13 Oct 04 20:38:24.425116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] Instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:38:24.470607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b62c3430-3ed5-4eff-b6e0-bb7cc2a42120 req-6a137cf9-e1aa-4a9a-82d1-09066240ad51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295800 Oct 04 20:38:24.472565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 635/1302] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:24.495227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:24.499308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:24.525367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.537947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.540244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.547373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.552271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.578334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.435000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.476334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.480939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.514489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9906d8d-ed52-4b60-a4bf-c3b75053a503 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1553 microversion: 2.91 time: 1.299354 Oct 04 20:38:25.519857 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 668/1303] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:24 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1553 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:25.540289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.567015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.597213 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e44d6050-f78e-497e-8758-af47dcd1ec53 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-interface" status: 200 len: 284 microversion: 2.25 time: 1.121200 Oct 04 20:38:25.610053 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 636/1304] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 20:38:24 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-interface => generated 284 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:38:25.615536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28211b32-37ee-4ea5-a918-7578bf9bbbf9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f624b310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.621645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.631247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.632437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.636856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.646304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.646496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.779031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:25.786324 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28211b32-37ee-4ea5-a918-7578bf9bbbf9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.185981 Oct 04 20:38:25.812290 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 637/1305] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:26.299290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.compute.api [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Found an unconfirmed migration during delete, id: 8, status: confirming Oct 04 20:38:26.595989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:26.602502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:26.630308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.647953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.649673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.660036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.664629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.668281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.886193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:26.915713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:26.926259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:26.946648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0fa2d11-9618-4af3-91b8-8c77d224dabc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1535 microversion: 2.91 time: 0.378036 Oct 04 20:38:26.965700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 638/1306] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1535 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:26.979307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bcfce71-ae38-499b-8795-d728e3f72604 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62b4820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:27.131164 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8bcfce71-ae38-499b-8795-d728e3f72604 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.152989 Oct 04 20:38:27.133067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 639/1307] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:28.082634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.105412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.160707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.161312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.171031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.174759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.176847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.181021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.405478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.468543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.472120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.499709 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f9fa207-2ec4-4c2c-bd60-5e01b2479c0f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1535 microversion: 2.91 time: 1.465655 Oct 04 20:38:29.501231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 640/1308] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1535 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:29.512228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6de2581e-c820-41a7-9895-ce5347832ba3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f626db80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.741109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6de2581e-c820-41a7-9895-ce5347832ba3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.227539 Oct 04 20:38:29.745542 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 641/1309] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:30.573746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.584296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.628701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.638158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.639167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.645610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.649605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.652472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.096089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.151577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.169499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.221744 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5bdbbf7-5457-4267-976e-643fd9e68b4e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1538 microversion: 2.91 time: 0.663221 Oct 04 20:38:31.222822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 642/1310] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:30 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1538 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:31.279004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:31.367198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.368017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.368629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.456595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] Creating event network-changed:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h2-851029-13 Oct 04 20:38:31.496982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-81102a8f-2cbd-47d5-a21a-333f12b3ece1 req-df5147ee-d28b-4c31-a96f-595f75d9acf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262761 Oct 04 20:38:31.503698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 643/1311] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:31.529407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2364de4f-b796-4a61-989a-6024d61e11a8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f628b940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.674043 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2364de4f-b796-4a61-989a-6024d61e11a8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.166631 Oct 04 20:38:31.678098 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 644/1312] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:31.690056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:31.714395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.734773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.736273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.740209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.744147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.744147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.744147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.984157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-851029-13". {{(pid=123542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:38:32.793308 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1577d77c-a5ec-4b80-8cf0-aa60190c3c81 tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action" status: 202 len: 0 microversion: 2.91 time: 1.112382 Oct 04 20:38:32.801951 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 645/1313] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:38:31 2022] POST /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:32.833039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7a841ea-2ffb-4839-9110-2f3a4b622ad8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f626d4c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:33.032961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7a841ea-2ffb-4839-9110-2f3a4b622ad8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.229021 Oct 04 20:38:33.037460 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 646/1314] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:32 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:33.091862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:33.093196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:33.121973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.122897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.124353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.125682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.126549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.146292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.550794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:33.594741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:33.612702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:33.664511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4cec26e-f82b-42c0-8271-3b635aa563a0 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1486 microversion: 2.91 time: 0.611038 Oct 04 20:38:33.678342 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 647/1315] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:33 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1486 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:34.065811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f544153e-d22d-4012-8862-94217efb5f11 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6301550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:34.446260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f544153e-d22d-4012-8862-94217efb5f11 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.389317 Oct 04 20:38:34.459683 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 648/1316] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:34 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:34.764514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:34.765641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:34.817467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.818361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.819223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.820552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.827484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.828730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.539818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.551839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.557108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.587675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:35.590886 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-948c5cf5-0b5a-4df6-97db-f2d764ebf6cb tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1486 microversion: 2.91 time: 0.836034 Oct 04 20:38:35.593568 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 649/1317] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:34 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1486 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:35.623960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4dec5a31-4081-4eab-a589-6a7d836b5033 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6301790>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.919428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4dec5a31-4081-4eab-a589-6a7d836b5033 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.316245 Oct 04 20:38:35.921240 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 650/1318] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:36.312925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:36.750890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:36.790308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.797152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.810957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.813510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.814369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.815255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.053324 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7620805b-36ef-4f72-a865-388235cb6cad tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 1.020804 Oct 04 20:38:37.070876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 651/1319] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:37.118602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:37.120097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:37.173355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.178466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.185901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.188824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.197630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.204050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.742440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.792342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.802144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.824286 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc5a6397-ad4e-45de-992a-7c26ba81d270 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1488 microversion: 2.91 time: 0.746254 Oct 04 20:38:37.826736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 652/1320] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1488 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:37.836235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d3bd7b4-dfca-422e-93dd-888e63eee343 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f641c040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.033253 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d3bd7b4-dfca-422e-93dd-888e63eee343 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.204430 Oct 04 20:38:38.038746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 653/1321] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:38.057929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.082115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.089386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.092892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.097253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.098756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.107075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.265868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bf8091b-d003-402e-b6c6-65febf73000d tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.223850 Oct 04 20:38:38.267825 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 654/1322] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:38.303153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.309902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.323487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.324912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.327100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.328379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.329579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.434149 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-49829162-4971-40e8-b432-b319fa07b399 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.142572 Oct 04 20:38:38.460173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 655/1323] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:38.483634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.503586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.504421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.519447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.522154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.523220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.524015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.632779 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b23fcb3b-b70c-49d6-926e-7ab58526d6aa tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-851029-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.158208 Oct 04 20:38:38.638108 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 656/1324] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services?host=n-d-851029-13&binary=xxx => generated 16 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:38.672906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.702388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.703616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.705072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.706372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.707333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.711427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.765485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9277d1dd-7414-4f49-9b86-feacef047928 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.108015 Oct 04 20:38:38.781547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 657/1325] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:38.792324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.799883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.801936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.803050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.804650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.805511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.806320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.861157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3b0b465-bf5d-437c-8c4c-3ec83fc7a248 tempest-ServicesAdminNegativeTestJSON-2101892407 tempest-ServicesAdminNegativeTestJSON-2101892407-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.075438 Oct 04 20:38:38.862485 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 658/1326] 10.222.0.36 () {58 vars in 1198 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Unexpected exception in API method: AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: Traceback (most recent call last): Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: res = self.dispatcher.dispatch(message) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: return self._do_dispatch(endpoint, method, ctxt, args) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: result = func(ctxt, **new_args) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\exception_wrapper.py", line 71, in wrapped Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: _emit_versioned_exception_notification( Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: self.force_reraise() Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: raise self.value Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: return f(self, context, *args, **kw) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\utils.py", line 1439, in decorated_function Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: return function(self, context, *args, **kwargs) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 143, in decorated_function Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: return function(self, context, *args, **kwargs) Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: compute_utils.add_instance_fault_from_exc(context, Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: self.force_reraise() Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: raise self.value Oct 04 20:38:39.022794 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 201, in decorated_function Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: return function(self, context, *args, **kwargs) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 4617, in confirm_resize Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: do_confirm_resize(context, instance, migration) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_concurrency\lockutils.py", line 414, in inner Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: return f(*args, **kwargs) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 4595, in do_confirm_resize Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: LOG.exception( Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: self.force_reraise() Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: raise self.value Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 4588, in do_confirm_resize Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: self._confirm_resize( Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: File "c:\openstack\build\nova\nova\compute\manager.py", line 4664, in _confirm_resize Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: pci_mapping = (instance.migration_context. Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 903, in _delete Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:38:39.027424 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2720, in delete Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2711, in _delete_instance Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(context, instance, 'delete', self._do_delete, Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2492, in _delete Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._confirm_resize_on_deleting(context, instance) Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2588, in _confirm_resize_on_deleting Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_rpcapi.confirm_resize(context, Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/rpcapi.py", line 631, in confirm_resize Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return rpc_method(ctxt, 'confirm_resize', Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self.transport._send( Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._driver.send(target, ctxt, message, Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._send(target, ctxt, message, wait_for_reply, timeout, Oct 04 20:38:39.031493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise result Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = self.dispatcher.dispatch(message) Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._do_dispatch(endpoint, method, ctxt, args) Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = func(ctxt, **new_args) Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\exception_wrapper.py", line 71, in wrapped Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.033896 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\utils.py", line 1439, in decorated_function Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 143, in decorated_function Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compute_utils.add_instance_fault_from_exc(context, Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 201, in decorated_function Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4617, in confirm_resize Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi do_confirm_resize(context, instance, migration) Oct 04 20:38:39.037074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_concurrency\lockutils.py", line 414, in inner Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4595, in do_confirm_resize Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.exception( Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4588, in do_confirm_resize Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._confirm_resize( Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4664, in _confirm_resize Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi pci_mapping = (instance.migration_context. Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.045975 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:39.049079 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Request method failure captured: Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e HTTP/1.1 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJf8jO7HV77FSVp3qWoAlN0MKeLnZGMr_Y1z4Z7ctyTXppgd8FUn5RHW6Tr9YnsOkAMMn2jfQELQV_QYl2BChAtQvkNhTOE2235d-ZMHyzV3oUty68q-ROhBVYCukMLaOFvrVPu6PxEvBuyDiyj5g7Jt3vtbEqZSzFyP7JZ664H_S6c Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:38:39.052556 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 589b60499a914b8886201a339bbef1fe Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:39.055767 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '03fcdb48-2ff8-4a26-9f37-1d709d58656e'} Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 903, in _delete Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2720, in delete Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2711, in _delete_instance Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(context, instance, 'delete', self._do_delete, Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2492, in _delete Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._confirm_resize_on_deleting(context, instance) Oct 04 20:38:39.057504 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2588, in _confirm_resize_on_deleting Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_rpcapi.confirm_resize(context, Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/rpcapi.py", line 631, in confirm_resize Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return rpc_method(ctxt, 'confirm_resize', Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self.transport._send( Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._driver.send(target, ctxt, message, Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._send(target, ctxt, message, wait_for_reply, timeout, Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise result Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\server.py", line 165, in _process_incoming Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = self.dispatcher.dispatch(message) Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 309, in dispatch Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._do_dispatch(endpoint, method, ctxt, args) Oct 04 20:38:39.060098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_messaging\rpc\dispatcher.py", line 229, in _do_dispatch Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = func(ctxt, **new_args) Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\exception_wrapper.py", line 71, in wrapped Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\exception_wrapper.py", line 63, in wrapped Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\utils.py", line 1439, in decorated_function Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 143, in decorated_function Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 212, in decorated_function Oct 04 20:38:39.062461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compute_utils.add_instance_fault_from_exc(context, Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 201, in decorated_function Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4617, in confirm_resize Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi do_confirm_resize(context, instance, migration) Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_concurrency\lockutils.py", line 414, in inner Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4595, in do_confirm_resize Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.exception( Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 227, in __exit__ Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\python38\lib\site-packages\oslo_utils\excutils.py", line 200, in force_reraise Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.068750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4588, in do_confirm_resize Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._confirm_resize( Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "c:\openstack\build\nova\nova\compute\manager.py", line 4664, in _confirm_resize Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi pci_mapping = (instance.migration_context. Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi AttributeError: 'NoneType' object has no attribute 'get_pci_mapping_for_migration' Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.073724 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21ccd386-a13e-406c-8db4-ce0a3495cf21 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 500 len: 188 microversion: 2.1 time: 13.546071 Oct 04 20:38:39.080539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 669/1327] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:25 2022] DELETE /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 188 bytes in 13554 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Oct 04 20:38:39.099253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.103199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.159780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.160791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.161616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.163033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.164130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.164927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.306913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.327166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.331209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.350242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-672de887-ac4e-4386-901d-0fadc1c770cc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.264886 Oct 04 20:38:39.352069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 670/1328] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:39.410548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-118b1f06-f182-453d-a471-0b2b1b8a00ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61a1550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.480977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68c5646f-8e6d-4fc1-9755-fe59ec843d84 tempest-ServicesAdminNegativeTestJSON-1657197361 tempest-ServicesAdminNegativeTestJSON-1657197361-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.499395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68c5646f-8e6d-4fc1-9755-fe59ec843d84 tempest-ServicesAdminNegativeTestJSON-1657197361 tempest-ServicesAdminNegativeTestJSON-1657197361-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '99d2cf839c224dd8a6a303fe2934d1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686d1744fff24ab1bba79dd347052347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68c5646f-8e6d-4fc1-9755-fe59ec843d84 tempest-ServicesAdminNegativeTestJSON-1657197361 tempest-ServicesAdminNegativeTestJSON-1657197361-project] Request method failure captured: Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJnHy-VKSYAF0-9B7_bkeh96MSvOYuUnwTuyptlsC5hmv_RRN3975_ex_rvDPLnzSWINwF9cnbMd_bnrqZbD1cMLfgzCu4igTHtKkNWB8nSwntKLqEppj09-x5C1YrkedCFUd5pFPXtMJV1hx-sa1q6UZ80qL0vhAQBljMmtAR7iozE Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 686d1744fff24ab1bba79dd347052347 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1657197361 Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:38:39.509209 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/686d1744fff24ab1bba79dd347052347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/686d1744fff24ab1bba79dd347052347"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/686d1744fff24ab1bba79dd347052347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_686d1744fff24ab1bba79dd347052347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1657197361 Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 686d1744fff24ab1bba79dd347052347 Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1657197361 Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServicesAdminNegativeTestJSON-1657197361-project Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 99d2cf839c224dd8a6a303fe2934d1f0 Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1657197361-project Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:38:39.512161 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:38:39.513966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:38:39.516544 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:38:39.519240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68c5646f-8e6d-4fc1-9755-fe59ec843d84 tempest-ServicesAdminNegativeTestJSON-1657197361 tempest-ServicesAdminNegativeTestJSON-1657197361-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:39.519421 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68c5646f-8e6d-4fc1-9755-fe59ec843d84 tempest-ServicesAdminNegativeTestJSON-1657197361 tempest-ServicesAdminNegativeTestJSON-1657197361-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.639928 Oct 04 20:38:39.522702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 659/1329] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 642 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:39.578789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.579936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.593329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-118b1f06-f182-453d-a471-0b2b1b8a00ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1452 microversion: 2.1 time: 0.216873 Oct 04 20:38:39.604349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 671/1330] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:39.605660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.607034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.608989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.611339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.611339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.612409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.713355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:40.375299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d69751fc-8b9f-4023-889a-829e71adb2c1 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 204 len: 0 microversion: 2.1 time: 0.852581 Oct 04 20:38:40.381226 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 660/1331] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:39 2022] DELETE /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:40.398837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.404879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.430176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.434815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.443902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.449282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.453048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.456590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.459954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.460776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.465296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.474859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.476760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.483269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.489394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.493359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.603365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.608158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.609745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.610492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 03fcdb48-2ff8-4a26-9f37-1d709d58656e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:40.827676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.867207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.873461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.887194 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc8cae8b-fade-40e0-9961-eb26285d3c12 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.466817 Oct 04 20:38:40.890264 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 661/1332] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:40.903127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d0d5931-8685-46b2-8753-0f4ac7c84380 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f625b8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.059695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.077481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2cea0774-b07c-40a7-9de3-94e17397283a tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1538 microversion: 2.1 time: 0.695605 Oct 04 20:38:41.081268 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 672/1333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1538 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:41.960148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.962730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.985386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.987734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.989143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.991352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.992881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.994371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.375106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.444817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.448273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.488584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64809422-2f1c-4aa3-a0cb-d5d18bc0ba3e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.540698 Oct 04 20:38:42.507581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 673/1334] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:42.534516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.582087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 03fcdb48-2ff8-4a26-9f37-1d709d58656e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.620621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.622118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.623801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.625414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.626564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.627501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.839068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.840153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.840977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.841856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 03fcdb48-2ff8-4a26-9f37-1d709d58656e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:43.913825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.934005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a18bcb21-8c9c-4919-934f-6e6167754bd9 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e" status: 200 len: 1538 microversion: 2.1 time: 1.423586 Oct 04 20:38:43.950714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 674/1335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/03fcdb48-2ff8-4a26-9f37-1d709d58656e => generated 1538 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:43.950714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.950714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.962184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.962184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.963106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.964131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.965140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.967368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.198936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.244891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.258610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.283339 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b88943fc-5a9b-4bb1-a495-fca198820dd1 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.344513 Oct 04 20:38:44.287793 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 675/1336] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:44.308670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.310801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:44.340526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.344602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.344602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.344602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.345130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.345944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.459902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:45.367843 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa2e2555-b710-4f75-94eb-11c2c2958d65 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 204 len: 0 microversion: 2.1 time: 1.076631 Oct 04 20:38:45.371331 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 676/1337] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:44 2022] DELETE /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:45.409233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.419036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.458844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.464940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.471974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.483521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.487133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.492924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.266989 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1e1a8bf-86f9-4c07-b8cd-6ce6486b1c22 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1813 microversion: 2.1 time: 0.891113 Oct 04 20:38:46.275730 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 677/1338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1813 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:46.293838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.295341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.329475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.331181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.332420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.334093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.335284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.338461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.678351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.717639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.720856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.733362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d8ea0a4-a1f8-4f18-a431-f262a7a310b2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.457265 Oct 04 20:38:46.747383 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 678/1339] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:46.785125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.787102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.802571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.804165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.806159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.807901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.809196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.810225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.376538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:47.423940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-065a8b7d-2f61-48a5-a551-9e629702eff5 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1534 microversion: 2.1 time: 0.674131 Oct 04 20:38:47.441662 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 679/1340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1534 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:47.479858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fcdb48-2ff8-4a26-9f37-1d709d58656e", "name": "network-vif-deleted", "tag": "8a0ae657-e229-4dd0-9ffe-fd76826215bf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:47.532040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.547411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.550424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.616369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] Creating event network-vif-deleted:8a0ae657-e229-4dd0-9ffe-fd76826215bf for instance 03fcdb48-2ff8-4a26-9f37-1d709d58656e on n-h1-851029-13 Oct 04 20:38:47.627596 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f8d6ce27-5e43-40cd-9da3-a1effb2e0fde req-31deec96-7298-4330-b80b-f5b04aef8a7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168562 Oct 04 20:38:47.630951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 680/1341] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:47.652357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.668565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.673165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.675654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.685800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.685800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.692019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.756515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ee479e6-ab6d-40ef-b20e-183edfcb6e07 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.122703 Oct 04 20:38:47.777854 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 681/1342] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:47.828448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.830603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:47.858632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.862128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.863947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.869563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.874033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.876532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.427000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.476771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.485715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.523019 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d642187-a6e8-4852-81eb-763557ee5dc6 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.727484 Oct 04 20:38:48.543197 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d0d5931-8685-46b2-8753-0f4ac7c84380 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1461 microversion: 2.1 time: 7.649636 Oct 04 20:38:48.545531 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 682/1343] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:48.571365 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 662/1344] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1461 bytes in 7679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:48.599304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.600931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.617040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.617485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.618993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.619503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.620942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.622539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.623759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.624793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.669375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.670449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.678890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.682643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.685869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.689540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.494628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.495528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:50.026602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:50.109518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02b530d1-475d-4f75-b130-f7c8f6b64001 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 2344 microversion: 2.25 time: 1.560828 Oct 04 20:38:50.114071 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 683/1345] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 2344 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:50.147717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16a07a02-afbb-4a64-9c35-11d755137117 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a1d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.327829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16a07a02-afbb-4a64-9c35-11d755137117 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 200 len: 1461 microversion: 2.1 time: 0.209213 Oct 04 20:38:50.331353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 684/1346] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 1461 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:50.343133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.345619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:50.368564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.373417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.375425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.377393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.379459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.380738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.824771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.854847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.881206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.905014 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7726ff27-e430-4440-aab9-c027b0e93780 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.571303 Oct 04 20:38:50.906194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 685/1347] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:50.928518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.965012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.968452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.973645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.975159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.980090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.981199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.126171 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9e3f1b5-0526-41ae-a508-87f1943a01b5 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.212957 Oct 04 20:38:51.126171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 686/1348] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:38:51.161351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.162730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.196903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.202276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.203559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.205183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.206566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.212985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.253719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:51.320370 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32cabf85-0b66-45e5-abae-f2bc30463ddd tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1534 microversion: 2.1 time: 2.741235 Oct 04 20:38:51.347669 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 663/1349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1534 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:51.396538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7fd5e5-0050-4545-8fa6-1494ecb88003", "name": "network-vif-deleted", "tag": "6da158c2-6149-470b-ab33-bce769baf906"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:51.459045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:51.462646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.463921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.465007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.488900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] Creating event network-vif-deleted:6da158c2-6149-470b-ab33-bce769baf906 for instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 on n-h1-851029-13 Oct 04 20:38:51.499865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0d43f8d6-1956-4f47-8f1b-8d94ba370b2c req-7f13eb3a-102a-44a0-af65-32fa30f75b7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148300 Oct 04 20:38:51.501856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 664/1350] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:51.951658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:51.969933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:51.989482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.989482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.996901 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf71dc8f-17f6-453a-8964-d407bf6de349 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1467 microversion: 2.1 time: 0.869388 Oct 04 20:38:52.003293 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 687/1351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1467 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:52.017413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.021637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.022994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.027960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.036679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.037721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.061903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-889568272"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:52.102290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:52.166020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.169189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.170768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.180355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.191575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.199103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.387931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.431761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.438303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.456591 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6dd10b7b-7ab5-412c-bb12-3c12a28cd1a7 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.491693 Oct 04 20:38:52.460431 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 665/1352] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:52.473097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:52.474968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:52.489152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.490471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.492092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.493810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.494961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.496039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.829826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.843810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.844879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.845917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 5a7fd5e5-0050-4545-8fa6-1494ecb88003 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:53.142343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:53.163643 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a151665a-d705-4f94-9f1f-7001d6168e44 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1368 microversion: 2.1 time: 0.700788 Oct 04 20:38:53.165927 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 666/1353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:52 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1368 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:53.228470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc06a5-c7c8-4f58-8fa4-3593dbdd5794", "name": "network-vif-unplugged", "status": "completed", "tag": "04e7bb18-0cec-4ce4-8e6a-b645fb606a91"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:53.314686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.316338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.319104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.398212 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] Creating event network-vif-unplugged:04e7bb18-0cec-4ce4-8e6a-b645fb606a91 for instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 on n-h1-851029-13 Oct 04 20:38:53.439716 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e831f0a0-a9bd-424f-b686-cf75f9b5219b req-0f9ffb39-3b66-46a7-a24e-e81e0ca9e84e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.220184 Oct 04 20:38:53.456182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 667/1354] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:53.530387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:53.533330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:53.603350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.604296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.605148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.606551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.613051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.613891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.842347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf193ab3-b5a0-44d7-83a6-746f80b05ea0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "POST /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a/action" status: 202 len: 0 microversion: 2.1 time: 1.808172 Oct 04 20:38:53.855165 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 688/1355] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:52 2022] POST /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a/action => generated 0 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:38:53.868155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1df8dbe0-96b6-4946-8ce4-8eb955282e65 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61c29d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:53.952496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:53.998976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.014804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.077611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1df8dbe0-96b6-4946-8ce4-8eb955282e65 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.216632 Oct 04 20:38:54.097165 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 689/1356] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:53 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:54.106296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-82a4818d-9f96-4ec3-8ebd-c7c2c46ef1f2 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.584743 Oct 04 20:38:54.130950 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 668/1357] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:53 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:54.222312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:54.237649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:54.276878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.277520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.282235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.298615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.299701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.300540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.490161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.491111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.491973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.492845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 5a7fd5e5-0050-4545-8fa6-1494ecb88003 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:54.645618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.669361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2c748dc-f622-4be1-a1a2-f7baba14eb71 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 200 len: 1368 microversion: 2.1 time: 0.460693 Oct 04 20:38:54.670756 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 690/1358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:54 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 1368 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:55.107429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d0ee012-9955-45e6-806b-3d515c1dc3a5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f628bb80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:55.191651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:55.205442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:55.221465 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:38:55.221780 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 20:38:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb (ip 10.222.0.36) !!! Oct 04 20:38:55.299271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.300148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.313450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.314936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.326886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.332166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.417428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d0ee012-9955-45e6-806b-3d515c1dc3a5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.313095 Oct 04 20:38:55.442569 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 669/1359] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:55.785169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.837771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.848268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.887721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9a347f1-328e-4015-8e0d-11eb903fc20b tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.696546 Oct 04 20:38:55.918739 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 691/1360] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:55.971850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:55.974496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 5a7fd5e5-0050-4545-8fa6-1494ecb88003] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:55.989283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.992704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.995154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.997218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.000003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.002731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.048068 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] HTTP exception thrown: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Request method failure captured: Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 HTTP/1.1 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJf8jO7HV77FSVp3qWoAlN0MKeLnZGMr_Y1z4Z7ctyTXppgd8FUn5RHW6Tr9YnsOkAMMn2jfQELQV_QYl2BChAtQvkNhTOE2235d-ZMHyzV3oUty68q-ROhBVYCukMLaOFvrVPu6PxEvBuyDiyj5g7Jt3vtbEqZSzFyP7JZ664H_S6c Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:38:56.061170 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 589b60499a914b8886201a339bbef1fe Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-MigrationsAdminTest-910030547-project Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. Oct 04 20:38:56.064374 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5a7fd5e5-0050-4545-8fa6-1494ecb88003'} Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:56.066097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. Oct 04 20:38:56.070973 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:38:56.078470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Returning 404 to user: Instance 5a7fd5e5-0050-4545-8fa6-1494ecb88003 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:56.078470 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ac77e6e-0114-41d4-9c9b-a55a82188051 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003" status: 404 len: 111 microversion: 2.1 time: 0.125607 Oct 04 20:38:56.078470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 692/1361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/servers/5a7fd5e5-0050-4545-8fa6-1494ecb88003 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:56.092755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c156360f-ec47-4ab7-812b-1fb1a9186ca8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '.version_select at 0x7f54f61fdaf0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.222110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da388b4b-12a9-46d7-8649-817d36ae9ad2 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.231146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c156360f-ec47-4ab7-812b-1fb1a9186ca8 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260979865" status: 202 len: 0 microversion: 2.1 time: 0.149369 Oct 04 20:38:56.232676 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 693/1362] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260979865 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:56.262899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da388b4b-12a9-46d7-8649-817d36ae9ad2 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.818268 Oct 04 20:38:56.268449 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 670/1363] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:56.306777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2db0d373-acf1-4bd0-bd67-5b8775a6ba9a tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.438618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2db0d373-acf1-4bd0-bd67-5b8775a6ba9a tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.146432 Oct 04 20:38:56.460358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7264b09-5f96-4f90-93a1-8604ec8d0901 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f628b550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.474800 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 694/1364] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:56.537191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b50c742-8702-4c0e-92e3-d06f1e907d4f tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.590131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b50c742-8702-4c0e-92e3-d06f1e907d4f tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.083850 Oct 04 20:38:56.624520 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 695/1365] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:56.656899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c2d7347-8b3d-444a-81fd-217b1aba6af0 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.680887 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7264b09-5f96-4f90-93a1-8604ec8d0901 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.234102 Oct 04 20:38:56.706000 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 671/1366] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:56.739447 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c2d7347-8b3d-444a-81fd-217b1aba6af0 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.111242 Oct 04 20:38:56.745262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 696/1367] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:56.769168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-36efcfcb-09c7-4530-8b9e-c47f3ee1c8d3 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.989076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.998135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:57.072686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.075857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.087650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.089179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.093900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.094962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-36efcfcb-09c7-4530-8b9e-c47f3ee1c8d3 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.331331 Oct 04 20:38:57.097476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.100372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 672/1368] 10.222.0.36 () {58 vars in 1165 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:57.153312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c8e8ab6-aafa-4bca-ba90-e400e5fba36b tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.180549 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c8e8ab6-aafa-4bca-ba90-e400e5fba36b tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048285 Oct 04 20:38:57.190487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 673/1369] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:57.216329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b39ed8b-76b1-4b59-a840-91408b7fc955 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.340587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4b39ed8b-76b1-4b59-a840-91408b7fc955 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.139619 Oct 04 20:38:57.344895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 674/1370] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:57.388221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16d10b7b-aa90-4385-92fe-5ca6fee37271 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.440891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16d10b7b-aa90-4385-92fe-5ca6fee37271 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.062270 Oct 04 20:38:57.443171 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 675/1371] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:57.476197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56c1cd82-ad43-43ed-a946-bb1c0a2eb6f7 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.524055 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56c1cd82-ad43-43ed-a946-bb1c0a2eb6f7 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055043 Oct 04 20:38:57.539541 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 676/1372] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:57.564766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.567432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fe58b1c-10e6-4cea-ae07-6baf9852c9de tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.635915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.647197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.722879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1f5b269-c268-4054-af6c-80908df1bf33 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.748211 Oct 04 20:38:57.732494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 697/1373] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:57.799938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9a57f42-b250-4fcc-83db-8ec9395d4278 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62970d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.801857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fe58b1c-10e6-4cea-ae07-6baf9852c9de tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.260000 Oct 04 20:38:57.818878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 677/1374] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:57.836064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed1c315a-f018-4e9a-8247-ed0f9525b938 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.939763 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed1c315a-f018-4e9a-8247-ed0f9525b938 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.104726 Oct 04 20:38:57.951447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 678/1375] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:58.169981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46680432-eeff-4419-b2c5-28d87f352327 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.185666 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9a57f42-b250-4fcc-83db-8ec9395d4278 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.450064 Oct 04 20:38:58.189365 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 698/1376] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.217346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46680432-eeff-4419-b2c5-28d87f352327 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.090321 Oct 04 20:38:58.219544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 679/1377] 10.222.0.36 () {58 vars in 1144 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.256815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa57bed2-7503-45c8-a384-debb40fa763c tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.285192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa57bed2-7503-45c8-a384-debb40fa763c tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034830 Oct 04 20:38:58.297572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 699/1378] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:58.324584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2221b045-f7bb-4ad0-9d9b-864cad476b31 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.407734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2221b045-f7bb-4ad0-9d9b-864cad476b31 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.073416 Oct 04 20:38:58.408875 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 680/1379] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.446178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f74dbcc-f5a8-4130-8002-10e6722726a3 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.490066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f74dbcc-f5a8-4130-8002-10e6722726a3 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.059409 Oct 04 20:38:58.492276 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 700/1380] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:58.522538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79ea1e04-1944-4fb7-aa3b-cf0239870657 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.566378 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79ea1e04-1944-4fb7-aa3b-cf0239870657 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052102 Oct 04 20:38:58.567825 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 681/1381] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:58.601182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1f9d699-298b-4dc8-96ea-69e5834fc818 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.802640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.810541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:58.857507 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1f9d699-298b-4dc8-96ea-69e5834fc818 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.272735 Oct 04 20:38:58.864146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.868302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.872067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.875346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.883696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.885818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.888821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 701/1382] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.919620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f0f2682-a9d1-4ba0-af11-8d7141bc42f5 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.048053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f0f2682-a9d1-4ba0-af11-8d7141bc42f5 tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.139379 Oct 04 20:38:59.052046 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 702/1383] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:59.105104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-856a0867-3291-42c1-acbe-2d244d302cfe tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.165407 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-856a0867-3291-42c1-acbe-2d244d302cfe tempest-FlavorsV2TestJSON-1514734155 tempest-FlavorsV2TestJSON-1514734155-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.066016 Oct 04 20:38:59.178953 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 703/1384] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:59.217841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b74704f9-b004-4190-9f17-ab1b25493f01 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f64728b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.400812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.435638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.442158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.467702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80618a74-46f1-46eb-8ca1-1a5f19bb3f63 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.675518 Oct 04 20:38:59.472088 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 682/1385] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:59.702773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b74704f9-b004-4190-9f17-ab1b25493f01 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.447070 Oct 04 20:38:59.704892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 704/1386] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:00.262229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.268005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.290275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.295924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.300874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.302481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.307817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.466486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:00.546441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.547696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.582188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.604057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.605088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.609956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.610896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.611764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.977646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.030714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.045685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.071619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a96b922b-41db-4960-8e82-ac466726f412 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.534394 Oct 04 20:39:01.079208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 705/1387] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:01.097382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3df51251-3e88-4a95-bf5c-258548896823 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f614f8b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:01.114089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:01.199243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bbd6961-f9f4-457c-b0cf-f18baeadfb7e tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 204 len: 0 microversion: 2.1 time: 0.944196 Oct 04 20:39:01.201209 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 683/1388] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:00 2022] DELETE /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:01.218164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0422c951-c614-4e78-b356-73b150405154", "device": "/dev/xvdb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:01.230188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:01.260207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.265932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.267316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:01.268949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.273379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.274831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.079904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6cc0b70d-b751-4ad7-888b-17d5d0b982c1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.861759 Oct 04 20:39:03.086693 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 684/1389] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 20:39:01 2022] POST /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments => generated 194 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:03.136062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02469548-4738-4fb9-b254-4ec697edb7ac", "device": "/dev/xvdb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:03.150786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:03.178372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.183958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.185394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.192649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.194397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.195691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.931584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-292b52b8-6b40-4a8c-bda0-4afbbad7189d tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 3.834352 Oct 04 20:39:06.936748 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 685/1390] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 4 20:39:03 2022] POST /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments => generated 194 bytes in 3850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:39:06.971283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.977670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:07.050598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.056980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.068098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.072388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.079071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.088241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.295870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.298377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.300725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.303499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 43413b3d-6994-4c34-8fd2-3933257d69e2 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:07.516305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:07.548690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1fe3a44-afd2-4c99-9a37-f6adf0958719 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 200 len: 1303 microversion: 2.1 time: 0.609179 Oct 04 20:39:07.574717 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 686/1391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 1303 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:07.604203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:07.606259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:07.622084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.626173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.627515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.647770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.648771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.649729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.023825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.161991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.199803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.276273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3f06f98-8028-46c1-92ff-0d206b8d92fc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.715374 Oct 04 20:39:08.279897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 687/1392] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:07 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:08.310056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43413b3d-6994-4c34-8fd2-3933257d69e2", "name": "network-vif-deleted", "tag": "e091fc60-a11f-43d3-b91c-b2549fd99533"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:08.379331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.389548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.395642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.461172 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] Creating event network-vif-deleted:e091fc60-a11f-43d3-b91c-b2549fd99533 for instance 43413b3d-6994-4c34-8fd2-3933257d69e2 on n-h2-851029-13 Oct 04 20:39:08.517648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-30706262-1c2e-4bbb-802a-d3621a366ec2 req-e2ad1a0f-c56f-4b90-92f1-9fcc1e89dca8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230754 Oct 04 20:39:08.520080 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 688/1393] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:08.614479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.623396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 43413b3d-6994-4c34-8fd2-3933257d69e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:08.657902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.662529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.670984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.673526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.674769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.675909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.712502 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] HTTP exception thrown: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Request method failure captured: Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 HTTP/1.1 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJf8jO7HV77FSVp3qWoAlN0MKeLnZGMr_Y1z4Z7ctyTXppgd8FUn5RHW6Tr9YnsOkAMMn2jfQELQV_QYl2BChAtQvkNhTOE2235d-ZMHyzV3oUty68q-ROhBVYCukMLaOFvrVPu6PxEvBuyDiyj5g7Jt3vtbEqZSzFyP7JZ664H_S6c Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:39:08.717389 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MigrationsAdminTest-910030547-project Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 589b60499a914b8886201a339bbef1fe Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MigrationsAdminTest-910030547-project Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. Oct 04 20:39:08.720484 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '43413b3d-6994-4c34-8fd2-3933257d69e2'} Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:08.721970 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. Oct 04 20:39:08.724709 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:08.731080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Returning 404 to user: Instance 43413b3d-6994-4c34-8fd2-3933257d69e2 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:08.731080 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1895185-4bc1-420f-a967-8ba240c64b1b tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2" status: 404 len: 111 microversion: 2.1 time: 0.125907 Oct 04 20:39:08.731080 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 689/1394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:08 2022] GET /compute/v2.1/servers/43413b3d-6994-4c34-8fd2-3933257d69e2 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:08.747771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.763686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:08.791659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.793241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.795218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.805848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.807606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.811481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.918563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3df51251-3e88-4a95-bf5c-258548896823 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 7.830575 Oct 04 20:39:08.934022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:08.955926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 706/1395] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:01 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 7875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:08.959885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:09.007616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-plugged", "status": "completed", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:09.053359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:09.065663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.071015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.072574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.128815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] Creating event network-vif-plugged:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:39:09.162959 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f9102918-3fe5-4b1c-8888-6923540b23c5 req-392aaf1d-6966-45bc-b66c-1d45c4e1df5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200807 Oct 04 20:39:09.167352 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 707/1396] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:09.349433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:09.355367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:09.375395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.376679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.378583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.381308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.382566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.383794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.590367 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6fa19a8c-96ce-4325-8d35-7952441c4ad4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 204 len: 0 microversion: 2.1 time: 0.851070 Oct 04 20:39:09.597494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 690/1397] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:08 2022] DELETE /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:09.623424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:09.624119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.626570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:09.667163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.674480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.683749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.687891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.690282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.697044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.700372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.705417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.715514 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34bb4c03-54c0-4e6e-84ae-fe8809d7beff tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.375846 Oct 04 20:39:09.719697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 708/1398] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:39:09.958108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a0ec325-579f-419f-a47c-9e49593716e8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f614fee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.212207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a0ec325-579f-419f-a47c-9e49593716e8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.266705 Oct 04 20:39:10.224820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 709/1399] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:10.789513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.790784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.822330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.829710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.838789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.841753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.842338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.843438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.321728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.373625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.379445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.405138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1178db97-e6ae-49a8-9585-b2670456729e tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.617845 Oct 04 20:39:11.412382 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 710/1400] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:39:11.440839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-459317c1-db62-4cc2-a680-4964361eb72c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f614f790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.535731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.574303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e2ec1d9-1a39-457e-a977-9334b2cb85e4 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1467 microversion: 2.1 time: 1.969293 Oct 04 20:39:11.575969 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 691/1401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1467 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.632966 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-459317c1-db62-4cc2-a680-4964361eb72c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.216835 Oct 04 20:39:11.651891 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 711/1402] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.492679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.493979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.628721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.631046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.632332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.634089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.635654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.651327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.660668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.672243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.712995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.714112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.718348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.722884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.726186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.730352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.484343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.503134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.530433 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b0a4767-ab11-421c-8f65-bd03c97e2d40 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1425 microversion: 2.1 time: 0.906661 Oct 04 20:39:13.548845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.552850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.563552 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 712/1403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1425 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:13.589734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3050d074-6bd1-44ae-bee7-1cfa56baab2a tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 1.122343 Oct 04 20:39:13.594838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b11a5858-3c8d-4d22-aa2b-4c812de91857 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61053a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:13.604413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 692/1404] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:13.625673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1ac426-4974-4dd8-8538-f0f50f6d752b", "name": "network-vif-deleted", "tag": "f39bba36-3050-412d-9142-0620a7286d17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:13.689802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.690921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.691941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.741124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] Creating event network-vif-deleted:f39bba36-3050-412d-9142-0620a7286d17 for instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b on n-h2-851029-13 Oct 04 20:39:13.757169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-59d69b31-daa2-4191-a26f-9ad37f05678f req-38872eea-bff1-451a-9c1f-fdc5be6822c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136443 Oct 04 20:39:13.759894 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 693/1405] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:14.603782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.606615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.631450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.632995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.634251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.636278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.638176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.640576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.737664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.740580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.742001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.743320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lazy-loading 'fault' on Instance uuid 8f1ac426-4974-4dd8-8538-f0f50f6d752b {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:14.912266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b60499a914b8886201a339bbef1fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3831b450653944e38a3f7e37b0e68d82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.961741 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e2faa56-466e-4afa-b72d-edd2f44bec23 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 200 len: 1302 microversion: 2.1 time: 0.359005 Oct 04 20:39:14.966006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 694/1406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 1302 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:14.988366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.993856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:15.039781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.072845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.075738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.079883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.086725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.087788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.505892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.545581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.549074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.584658 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-431216b6-244b-4368-8274-bd85a0ef11ca tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 0.604118 Oct 04 20:39:15.586143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 695/1407] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:16.021500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.029676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] [instance: 8f1ac426-4974-4dd8-8538-f0f50f6d752b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.046634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.048239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.051456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.055352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.055352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.058872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.133898 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] HTTP exception thrown: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Request method failure captured: Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b HTTP/1.1 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJf8jO7HV77FSVp3qWoAlN0MKeLnZGMr_Y1z4Z7ctyTXppgd8FUn5RHW6Tr9YnsOkAMMn2jfQELQV_QYl2BChAtQvkNhTOE2235d-ZMHyzV3oUty68q-ROhBVYCukMLaOFvrVPu6PxEvBuyDiyj5g7Jt3vtbEqZSzFyP7JZ664H_S6c Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:39:16.142106 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3831b450653944e38a3f7e37b0e68d82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 3831b450653944e38a3f7e37b0e68d82 Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MigrationsAdminTest-910030547 Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MigrationsAdminTest-910030547-project Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 589b60499a914b8886201a339bbef1fe Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MigrationsAdminTest-910030547-project Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. Oct 04 20:39:16.150628 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8f1ac426-4974-4dd8-8538-f0f50f6d752b'} Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:16.152124 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. Oct 04 20:39:16.155441 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:16.157792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] Returning 404 to user: Instance 8f1ac426-4974-4dd8-8538-f0f50f6d752b could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:16.157792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53393c9d-dfaf-4486-a00c-0697aa0dd079 tempest-MigrationsAdminTest-910030547 tempest-MigrationsAdminTest-910030547-project] 10.222.0.36 "GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b" status: 404 len: 111 microversion: 2.1 time: 0.134220 Oct 04 20:39:16.157792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 696/1408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/8f1ac426-4974-4dd8-8538-f0f50f6d752b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:16.666399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.673935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.705892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.711751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.717319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.721886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.724702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.726346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.294928 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b11a5858-3c8d-4d22-aa2b-4c812de91857 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 3.729217 Oct 04 20:39:17.306192 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 713/1409] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:13 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 3742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:17.777416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:17.830253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:17.843990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:17.876000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8672dd84-713a-4393-91fa-b5d1955a4f04 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1544 microversion: 2.91 time: 1.225010 Oct 04 20:39:17.877831 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 697/1410] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1544 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:39:18.341376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd0ddf4c-e0fe-4596-8808-3354c59661f6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61059d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.540200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd0ddf4c-e0fe-4596-8808-3354c59661f6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.210046 Oct 04 20:39:18.542490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 714/1411] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.942323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.952671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:18.987076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.990298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.991949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.996613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.000831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.006240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.585114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f2ca1b8-d400-4d56-af61-2b864650ba68 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61b21f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.816764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f2ca1b8-d400-4d56-af61-2b864650ba68 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.250190 Oct 04 20:39:19.829874 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 715/1412] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:20.419606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.462981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.466179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.502281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:20.519367 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2dc9e2a-508f-4596-ac5a-76e4b4ba09be tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1531 microversion: 2.91 time: 1.576028 Oct 04 20:39:20.552334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 698/1413] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1531 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:20.594089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.594997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.726880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.727769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.728593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.754709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.754995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.772625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.873273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11bb45b2-7529-4265-a469-316a133d6f7f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6411550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:21.191297 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11bb45b2-7529-4265-a469-316a133d6f7f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.329588 Oct 04 20:39:21.210894 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 699/1414] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:21.442519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] Lazy-loading 'services' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:21.548272 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1024ed3-5bc5-43ea-b6c8-4105f57aa12d tempest-UnshelveToHostMultiNodesTest-264202913 tempest-UnshelveToHostMultiNodesTest-264202913-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1938 microversion: 2.91 time: 0.968875 Oct 04 20:39:21.584426 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 716/1415] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1938 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:21.661036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:21.663054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:21.682920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.696365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.697777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:21.699806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.701161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.702436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:21.800972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:22.233238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81ff0b77-ecf8-4212-a81e-46e208f36bd4 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62bd3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.425112 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81ff0b77-ecf8-4212-a81e-46e208f36bd4 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.204683 Oct 04 20:39:22.426170 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 717/1416] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:22.503563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf009793-7063-4c0f-9b1e-7b8118403ffe tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 204 len: 0 microversion: 2.91 time: 0.850403 Oct 04 20:39:22.505262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 700/1417] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:39:21 2022] DELETE /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:39:22.523429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.526285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.542465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.544978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.548509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.550756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.552034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.553059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.071664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.099644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.112676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.136858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a307b4ba-fc10-431c-ba66-29983dc52cfc tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.624430 Oct 04 20:39:23.143175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 718/1418] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:23.456665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3a3b3c9-af60-4de4-abc4-d0e4ae902e86 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6bcd4c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.673186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3a3b3c9-af60-4de4-abc4-d0e4ae902e86 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.225846 Oct 04 20:39:23.683362 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 701/1419] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:24.236483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.250902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:24.301323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.303442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.309087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.312066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.319853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.331412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.363537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:24.702808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecc183c6-7bb2-4735-9291-170bae454c93 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6761940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.912958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecc183c6-7bb2-4735-9291-170bae454c93 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.218085 Oct 04 20:39:24.925808 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 702/1420] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:24 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:25.047312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.078619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.092489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.107807 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f450bb5-c070-4461-940d-28a54a9d9920 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1537 microversion: 2.91 time: 0.909004 Oct 04 20:39:25.114089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 719/1421] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:24 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1537 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:25.310352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.311956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.325656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.327152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.328091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.329557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.330563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.331549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.462682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:25.956866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a220af8-b28e-4417-9ec1-24e1da3054ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f625c0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.202383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a220af8-b28e-4417-9ec1-24e1da3054ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.247954 Oct 04 20:39:26.209420 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 720/1422] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:26.225918 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b6b94e5-5aee-4858-bf5d-b9d3841840b1 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "DELETE /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 204 len: 0 microversion: 2.1 time: 0.930191 Oct 04 20:39:26.228713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 703/1423] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:25 2022] DELETE /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:26.253903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.261108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.264432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.266844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.300651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.302645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.305636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.311032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.311424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.314029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.315605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.318940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.320054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.320955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.326588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.330831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.748040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.752269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.756946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.760107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lazy-loading 'fault' on Instance uuid 8146f778-de61-4131-ac99-a59e3f57aefb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:27.914646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.962213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.987149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b23fda1792f41e3b16873a2c73aa09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbe92b2e1d4746a370e163eb3a8a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.020606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84360729-04b8-4b48-b3ec-64d3ad64f29f tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 200 len: 1542 microversion: 2.91 time: 1.803104 Oct 04 20:39:28.031440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.032090 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 721/1424] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 1542 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:28.068598 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb4b059b-8219-4ae7-ade5-70b5da8b87c3 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1667 microversion: 2.1 time: 1.832306 Oct 04 20:39:28.070242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 704/1425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1667 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:28.072267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8652ccd0-ac55-4f33-93be-88e139ee5818 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6108b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.358953 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8652ccd0-ac55-4f33-93be-88e139ee5818 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.322284 Oct 04 20:39:28.378059 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 722/1426] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.100822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.112723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] [instance: 8146f778-de61-4131-ac99-a59e3f57aefb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.120442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.134041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.178014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.179375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.180219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.181598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.182470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.183310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.184939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.186430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.199257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.202048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.214710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.215555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.269362 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] HTTP exception thrown: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Request method failure captured: Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb HTTP/1.1 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJjeUT-FPoxeY4PBSEiO2i5UOGKoGLgncWbWtsaZahsm0bK2wXbQI6hKU0tmRKi3i9_nRpeNpJk7_a7OHpSsnFhA17xia7-LtXFYfqZ7zvAMuJg0lUCeKVcgMJz7tbv00-8kZzP0s8ESbP0Wfyhabo5cpp3K3ucV9FMOok1C_j1EfbY Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b6fbe92b2e1d4746a370e163eb3a8a28 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-234085022 Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:39:29.273562 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6fbe92b2e1d4746a370e163eb3a8a28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6fbe92b2e1d4746a370e163eb3a8a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6fbe92b2e1d4746a370e163eb3a8a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6fbe92b2e1d4746a370e163eb3a8a28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-234085022 Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b6fbe92b2e1d4746a370e163eb3a8a28 Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-234085022 Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-UnshelveToHostMultiNodesTest-234085022-project Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4b23fda1792f41e3b16873a2c73aa09f Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-234085022-project Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. Oct 04 20:39:29.284263 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8146f778-de61-4131-ac99-a59e3f57aefb'} Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:29.285854 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. Oct 04 20:39:29.288477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:29.296002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] Returning 404 to user: Instance 8146f778-de61-4131-ac99-a59e3f57aefb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:29.296002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6af22ac-a087-4615-931b-3b721295bc16 tempest-UnshelveToHostMultiNodesTest-234085022 tempest-UnshelveToHostMultiNodesTest-234085022-project] 10.222.0.36 "GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb" status: 404 len: 111 microversion: 2.91 time: 0.211281 Oct 04 20:39:29.296002 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 705/1427] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/8146f778-de61-4131-ac99-a59e3f57aefb => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:39:29.407428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b63496d-8ea8-4a44-838c-03ec484beec7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62d6dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.684706 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b63496d-8ea8-4a44-838c-03ec484beec7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.291814 Oct 04 20:39:29.700703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 706/1428] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:30.737046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5e1335e-4438-4154-9b59-a9220dbdebb7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f694a3a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.031735 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5e1335e-4438-4154-9b59-a9220dbdebb7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.311459 Oct 04 20:39:31.039200 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 707/1429] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:30 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.808926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.876955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3bd456c4-16e2-436d-867f-3848b9a9ff9a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1667 microversion: 2.1 time: 2.765945 Oct 04 20:39:31.897903 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 723/1430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1667 bytes in 2788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:32.069160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-733edf0f-ce41-4d0e-b668-20ce8f6ba2ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f680a9d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.410163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-733edf0f-ce41-4d0e-b668-20ce8f6ba2ed tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.356379 Oct 04 20:39:32.411132 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 708/1431] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:32 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:32.957401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.962007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.038264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.041352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.057281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.065803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.067862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.078124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.458075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a2f26a1-c0aa-481a-a143-cf10c16e9acd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6761c10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.689092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a2f26a1-c0aa-481a-a143-cf10c16e9acd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.248679 Oct 04 20:39:33.717127 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 709/1432] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:33.857789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:33.916885 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcf90d43-1c25-4cad-bc0b-3eaaad7876b8 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1599 microversion: 2.1 time: 0.972188 Oct 04 20:39:33.922047 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 724/1433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:32 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1599 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:34.605466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ce4cdc0-2dcd-4ddd-8be7-ee285c1f2eaf tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] Calling method '.version_select at 0x7f54f6b20b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:34.709687 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ce4cdc0-2dcd-4ddd-8be7-ee285c1f2eaf tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.785836 Oct 04 20:39:34.715790 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 710/1434] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:39:34.733738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c340cc3-4686-47a4-9727-bf1e9110de24 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61e29d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:34.747926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b29f7e04-a424-4bd8-ae7f-eaa6115a97fa tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] Action: 'update', calling method: .version_select at 0x7f54f628b280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:34.934439 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c340cc3-4686-47a4-9727-bf1e9110de24 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.219269 Oct 04 20:39:34.946914 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 725/1435] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:34 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:35.013433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:35.016243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:35.088038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.096808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.102305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.104084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.116837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.121881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.812257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.844210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0edde568-56e6-4aa4-9eca-7e0accbb4824 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1599 microversion: 2.1 time: 0.875836 Oct 04 20:39:35.852781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 726/1436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:34 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1599 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.912555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99682fbd-7ae5-4afa-825c-4be5bed0870c", "name": "network-vif-deleted", "tag": "54ee3188-3589-4012-af7b-f07a79da4dc4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:35.952443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.954018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.955086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.003700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] Creating event network-vif-deleted:54ee3188-3589-4012-af7b-f07a79da4dc4 for instance 99682fbd-7ae5-4afa-825c-4be5bed0870c on n-h1-851029-13 Oct 04 20:39:36.027748 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ad81ccd5-248f-4225-902b-04cdf337fabb req-9e1d07a4-e90a-49ce-8780-2c3f342def1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172634 Oct 04 20:39:36.033490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 727/1437] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:36.052450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8314f9a1-47b0-4aa4-b68f-6668323aac5c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62a1280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.225205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8314f9a1-47b0-4aa4-b68f-6668323aac5c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.169249 Oct 04 20:39:36.226652 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 728/1438] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.907081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.920627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:36.980090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.990811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.000279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.012452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.012452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.012452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.293667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.296322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.296322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.335700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lazy-loading 'fault' on Instance uuid 99682fbd-7ae5-4afa-825c-4be5bed0870c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:37.761930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2712aab84bfb4eae9501a0e6839efe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afffb2be165246a390dfb756e136ec64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:37.790641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e781da71-11e0-4d48-b027-cb588b11f3a9 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 200 len: 1316 microversion: 2.1 time: 0.893913 Oct 04 20:39:37.792195 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 729/1439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:37.817816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46ef51de-57ff-441b-832a-3cf5039db59c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61c2f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.034291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b29f7e04-a424-4bd8-ae7f-eaa6115a97fa tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 3.291612 Oct 04 20:39:38.036453 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 711/1440] 10.222.0.36 () {60 vars in 1206 bytes} [Tue Oct 4 20:39:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 3303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:38.063046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb732035-e019-456b-916b-008b35c0ee49 tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] Calling method '.version_select at 0x7f54f6b20d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.123879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46ef51de-57ff-441b-832a-3cf5039db59c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.326855 Oct 04 20:39:38.128889 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 730/1441] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:38.157048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb732035-e019-456b-916b-008b35c0ee49 tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.106349 Oct 04 20:39:38.161709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 712/1442] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 20:39:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:38.201741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c463492-ebc5-452b-b00b-d40e7602577d tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] Action: 'update', calling method: .version_select at 0x7f54f614f8b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:38.852508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.857726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] [instance: 99682fbd-7ae5-4afa-825c-4be5bed0870c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:38.924466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.925546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.941150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.949717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.950943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.957914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.102841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] HTTP exception thrown: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Request method failure captured: Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c HTTP/1.1 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJl8r9vovLH6ADKPux4LA10hMMnlrFvYYLvfe6HoxyHwdJdlM9XfxlsVdAnsWpoUrZbmiHyLFLeVAIwnAffaqIvXzxb7DqBGszKQ8SbX1TbEWMPpGcmZQJwiyYfj6q4HVIrrGwXsYj-_j4Ad1Ns2S5x5RmEnzRlT8dq5FyUyvUrFoaQ Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: afffb2be165246a390dfb756e136ec64 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestFqdnHostnames-201240215 Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:39:39.129576 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/afffb2be165246a390dfb756e136ec64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/afffb2be165246a390dfb756e136ec64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/afffb2be165246a390dfb756e136ec64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_afffb2be165246a390dfb756e136ec64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestFqdnHostnames-201240215 Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: afffb2be165246a390dfb756e136ec64 Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-201240215 Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestFqdnHostnames-201240215-project Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 2712aab84bfb4eae9501a0e6839efe44 Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestFqdnHostnames-201240215-project Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. Oct 04 20:39:39.132711 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '99682fbd-7ae5-4afa-825c-4be5bed0870c'} Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:39.134463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. Oct 04 20:39:39.138324 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:39:39.148951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Returning 404 to user: Instance 99682fbd-7ae5-4afa-825c-4be5bed0870c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:39.159545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-945c6f8d-c9e0-46bf-856d-cedd0b617eb7 tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c" status: 404 len: 111 microversion: 2.1 time: 0.320158 Oct 04 20:39:39.163320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 713/1443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:38 2022] GET /compute/v2.1/servers/99682fbd-7ae5-4afa-825c-4be5bed0870c => generated 111 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:39.184769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0459ce87-93fd-4c63-9648-9d6db62f0dce tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f641c310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.419469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0459ce87-93fd-4c63-9648-9d6db62f0dce tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.251186 Oct 04 20:39:39.420484 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 714/1444] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.450900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffad468e-5dc9-4347-a07a-59d1f7bc947a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] Calling method '.version_select at 0x7f54f641cd30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.597479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=11 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:39.629828 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffad468e-5dc9-4347-a07a-59d1f7bc947a tempest-ServersTestFqdnHostnames-201240215 tempest-ServersTestFqdnHostnames-201240215-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912963784" status: 202 len: 0 microversion: 2.1 time: 0.197558 Oct 04 20:39:39.635770 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 715/1445] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912963784 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:39:39.885318 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c463492-ebc5-452b-b00b-d40e7602577d tempest-QuotaClassesAdminTestJSON-706051201 tempest-QuotaClassesAdminTestJSON-706051201-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.693133 Oct 04 20:39:39.892311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 731/1446] 10.222.0.36 () {60 vars in 1206 bytes} [Tue Oct 4 20:39:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:40.456613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1908fe83-e1a0-4f0e-8425-ee342ee32290 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f624b310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.682487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1908fe83-e1a0-4f0e-8425-ee342ee32290 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.239344 Oct 04 20:39:40.694696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 716/1447] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.718227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c33b62e-2ac8-403c-9f41-2ecbe2ae7271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6211280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.933619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c33b62e-2ac8-403c-9f41-2ecbe2ae7271 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.228294 Oct 04 20:39:41.946581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1663385324", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "eaa81373-5c68-4ae7-accb-762c1b6d583f"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:41.955462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 717/1448] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:42.196589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] validate_networks() for [('eaa81373-5c68-4ae7-accb-762c1b6d583f', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:42.971312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f10692c1-74f6-46fe-a6ed-084b4c84c92c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f64503a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.181720 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f10692c1-74f6-46fe-a6ed-084b4c84c92c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.222547 Oct 04 20:39:43.230009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 718/1449] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:44.275321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f097400d-c6f3-4096-8895-5c9dcd2a62e2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62479d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:44.436424 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f097400d-c6f3-4096-8895-5c9dcd2a62e2 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.199451 Oct 04 20:39:44.458995 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 719/1450] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:44 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.472813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39394c98-58ee-4b94-95ed-98a494c51927 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f624b310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.750121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39394c98-58ee-4b94-95ed-98a494c51927 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.287800 Oct 04 20:39:45.751245 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 720/1451] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:46.033610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:46.035668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:46.036631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:46.037555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:46.039013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:46.070225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.079874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.082821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.085285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.095318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.098726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.239491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Getting quotas for project 5183c91fd7184d16a0cb7d7e364c317d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:46.284348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Getting quotas for user 174a016af11c4609af9410fa95ff16d4 and project 5183c91fd7184d16a0cb7d7e364c317d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:46.320459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:46.349185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:46.774863 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0b5d081-e36d-4652-ac60-42ed2163396b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.438069 Oct 04 20:39:46.776767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 732/1452] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:46.802545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-acc1ff79-e31c-4a40-802c-fcba31a722d9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f623c820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:46.806929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ed7b225-6b5c-4024-b334-504426d59e41 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:46.816298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2ed7b225-6b5c-4024-b334-504426d59e41 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:47.171583 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-acc1ff79-e31c-4a40-802c-fcba31a722d9 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.389022 Oct 04 20:39:47.180487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 721/1453] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:47.599302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2ed7b225-6b5c-4024-b334-504426d59e41 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:47.630654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2ed7b225-6b5c-4024-b334-504426d59e41 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1224 microversion: 2.1 time: 0.840075 Oct 04 20:39:47.654878 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 733/1454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1224 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.209344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:48.264774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-142edcb2-bcdb-4191-bf71-7570d8836177 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f67b5b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.620585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-142edcb2-bcdb-4191-bf71-7570d8836177 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.408972 Oct 04 20:39:48.628130 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 722/1455] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.714587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-42256e52-0fcd-473f-8865-33faef20032c tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.745611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-42256e52-0fcd-473f-8865-33faef20032c tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:49.221112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-42256e52-0fcd-473f-8865-33faef20032c tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:49.261956 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-42256e52-0fcd-473f-8865-33faef20032c tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1224 microversion: 2.1 time: 0.564043 Oct 04 20:39:49.298561 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 734/1456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1224 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:49.649552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:49.654292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=14,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:49.691924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-257c5dda-b43a-405d-8a19-989d52c5d65d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6253820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.989246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-257c5dda-b43a-405d-8a19-989d52c5d65d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.340785 Oct 04 20:39:50.013979 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 723/1457] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:50.361297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d9e6ac6-ee89-4c59-bea6-5fdba7cc4d24 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.367180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d9e6ac6-ee89-4c59-bea6-5fdba7cc4d24 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:51.024745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d85c023d-ff74-4f2b-887d-15b39084b9d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6211940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:51.208301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d9e6ac6-ee89-4c59-bea6-5fdba7cc4d24 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:51.267020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d85c023d-ff74-4f2b-887d-15b39084b9d0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.251137 Oct 04 20:39:51.268458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d9e6ac6-ee89-4c59-bea6-5fdba7cc4d24 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1224 microversion: 2.1 time: 0.931482 Oct 04 20:39:51.269955 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 735/1458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1224 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:51.274995 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 724/1459] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:51 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:52.319529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bf709e0-10f9-48e3-a699-456280d0870c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f611f160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.346535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.350387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.390908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.393694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.396937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.401274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.410577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.410577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.551381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bf709e0-10f9-48e3-a699-456280d0870c tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.247122 Oct 04 20:39:52.552570 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 736/1460] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:52.654599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:52.693792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab0ec668-a2af-44be-825b-906d2582b5d1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1220 microversion: 2.1 time: 0.372240 Oct 04 20:39:52.700882 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 725/1461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1220 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:53.592649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7fd22f01-7a98-4f82-b556-f882b795b76f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f63018b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.644067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.646294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:53.657472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.658577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.659484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.661355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.662609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.663770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.690110 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7fd22f01-7a98-4f82-b556-f882b795b76f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.109188 Oct 04 20:39:53.707493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 726/1462] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:53.756048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.757409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:53.783452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.785213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.786816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.789432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.789990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.791202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.036130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d29673af-f6af-42ad-aef9-e120b45edb5e tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1859 microversion: 2.1 time: 1.447166 Oct 04 20:39:54.038822 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 737/1463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1859 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:54.045113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:54.086251 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7dc5704-f672-41fc-a8e6-9d097b84fcf3 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1276 microversion: 2.1 time: 0.337853 Oct 04 20:39:54.102248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851029-13", "block_migration": true, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:54.110093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:54.125057 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 727/1464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1276 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:54.153125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.153899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.162146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.175315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.177302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.180724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.332800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lazy-loading 'flavor' on Instance uuid 091134c5-522b-43bf-969e-84f525b93ee0 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:54.369956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Going to try to live migrate instance to n-h2-851029-13 {{(pid=123541) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:39:54.690360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:54.722299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16f00dd8-b001-47e4-976d-45bee09922ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f641caf0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:54.908042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16f00dd8-b001-47e4-976d-45bee09922ae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.180848 Oct 04 20:39:54.927247 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 728/1465] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:54 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:55.195075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:55.195075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:55.248216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.250178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.252220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.254492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.256218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.258624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.722689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:55.768473 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abf695e3-82ce-46ef-8215-b409b04d2cbd tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1294 microversion: 2.1 time: 0.590310 Oct 04 20:39:55.774256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 729/1466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1294 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:55.971944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6513376-9017-48f1-a441-baa3b6892b7b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6211f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.189501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:56.195367 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6513376-9017-48f1-a441-baa3b6892b7b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1452 microversion: 2.1 time: 0.248871 Oct 04 20:39:56.199803 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 730/1467] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:56.830874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.837993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:56.892885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.900475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.910145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.913684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.925858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.929524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.417128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:58.455133 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0951f7fe-e167-4cb3-8708-ee80989d84f6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 1.632902 Oct 04 20:39:58.457500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 731/1468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:58.471390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-207d49a7-d583-43a6-94c3-014f86a1296e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f641c5e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.627362 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-207d49a7-d583-43a6-94c3-014f86a1296e tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1461 microversion: 2.1 time: 0.166645 Oct 04 20:39:58.628632 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 732/1469] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1461 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:58.668716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec3f7647-cb37-4ffe-a61b-11d44180ed8d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62fa8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.797314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec3f7647-cb37-4ffe-a61b-11d44180ed8d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 200 len: 1461 microversion: 2.1 time: 0.145236 Oct 04 20:39:58.805922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 733/1470] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 1461 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:58.840237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.840237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:58.881075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.883735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.887490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.888834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.889899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.893541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.704590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:59.743601 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4c49431-5b59-423a-bdfe-6aee00d3a138 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1481 microversion: 2.1 time: 0.917700 Oct 04 20:39:59.745256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 734/1471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1481 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:59.761213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.779205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:59.806559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.810706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.818260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.821563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.823127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.824574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.039709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.080049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74bcea85-6ab4-49fa-ac86-3c7358f6619d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 1.331075 Oct 04 20:40:01.093479 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 735/1472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:59 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:01.104111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:01.105798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:01.141110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.144893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.150050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.155895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.157286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.158510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.255626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=14 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:01.757290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.811809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59981641-f389-42d3-b127-e292940f0b34 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1468 microversion: 2.1 time: 0.715670 Oct 04 20:40:01.812873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 736/1473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1468 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.809519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.811489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.865749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.868433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.875500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.877083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.878303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.879093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.815842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:03.899127 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b4e1487-9b36-4a48-8769-39f5ca688830 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 2422 microversion: 2.25 time: 2.083841 Oct 04 20:40:03.900823 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 737/1474] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 2422 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:03.911099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b31eedbd-a8c3-449f-bb39-b3cc17265bae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62df8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:04.292592 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b31eedbd-a8c3-449f-bb39-b3cc17265bae tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?changes-since=2022-10-04T20%3A35%3A48Z" status: 200 len: 1902 microversion: 2.1 time: 0.388189 Oct 04 20:40:04.307294 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 738/1475] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/images?changes-since=2022-10-04T20%3A35%3A48Z => generated 1902 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:04.324685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:04.330527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:04.371862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.373170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.374315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.375467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.381412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.382515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.393889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:05.055072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.100832 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a282ce7-2e1e-4567-8a96-f94881f49fd6 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 0.793743 Oct 04 20:40:05.102172 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 739/1476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:04 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.126802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-unplugged", "status": "completed", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:05.138075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:05.164027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.165426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.170612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.213453 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] Creating event network-vif-unplugged:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:40:05.255538 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3a9f76d8-9b9d-4cad-9721-1f8ea6a33596 req-11c29b92-9982-4ee4-b533-849b9644d889 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150399 Oct 04 20:40:05.256834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 740/1477] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:05.285263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": "auto"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:05.302699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.321749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.329493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.331071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.336548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.337862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.346148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.421209 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1611f73c-f72b-4e51-a828-6a0c1192b56d tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/action" status: 202 len: 0 microversion: 2.1 time: 11.346433 Oct 04 20:40:05.430332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 738/1478] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:54 2022] POST /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/action => generated 0 bytes in 11357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:05.448996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5ceae49-6c0f-49ac-9df9-290bd4a590e3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61054c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.467778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'flavor' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:05.527371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:40:05.864425 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5ceae49-6c0f-49ac-9df9-290bd4a590e3 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1151862739" status: 200 len: 485 microversion: 2.1 time: 0.425395 Oct 04 20:40:05.869364 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 739/1479] 10.222.0.36 () {58 vars in 1231 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1151862739 => generated 485 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:05.897744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:05.959007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.959007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.959007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.983364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] Creating event network-changed:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:40:05.998255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e30d5ed8-af8d-490f-bdf8-7291b2bda080 req-85ae46a3-0de1-4046-b6fe-2e6e1455ec29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124613 Oct 04 20:40:06.000177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 740/1480] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:06.014171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.022230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.038118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.038565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.039679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.041298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.044142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.045467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.361808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.384853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f1a18c9f-f008-43b5-af2e-ee36b651427b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.382010 Oct 04 20:40:06.402698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 741/1481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:06.409820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1c9866f-83cd-48b8-a96b-b45f5ae08d77 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f61321f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.799149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1c9866f-83cd-48b8-a96b-b45f5ae08d77 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?server=e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 957 microversion: 2.1 time: 0.402537 Oct 04 20:40:06.828379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 742/1482] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/images?server=e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 957 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:06.857053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.860270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.904067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.907871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.908973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.911799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.913122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.914302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.484120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.504396 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71547569-b839-4a99-97d8-e954134450b9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 0.672590 Oct 04 20:40:07.505617 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 743/1483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:07.533419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26ceb605-809d-4556-888f-ac4a971931aa tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6135a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.719376 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26ceb605-809d-4556-888f-ac4a971931aa tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 484 microversion: 2.1 time: 0.211539 Oct 04 20:40:07.734707 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 744/1484] 10.222.0.36 () {58 vars in 1317 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 484 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:07.744169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.746881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.763238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.767190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.768479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.770267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.772284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.773757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.234431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.288973 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ed5eb24-c08a-4511-97ae-e0d1e0c8b0f9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.539654 Oct 04 20:40:08.290099 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 745/1485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.306755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf96100d-ec6d-4c9f-a64e-3df934bbacc6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6132670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:08.464910 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf96100d-ec6d-4c9f-a64e-3df934bbacc6 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 484 microversion: 2.1 time: 0.172014 Oct 04 20:40:08.469608 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 746/1486] 10.222.0.36 () {58 vars in 1303 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 484 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:08.501670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d4ef022-a922-4f8d-bda8-55fea7e94182 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f622e700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:09.046581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d4ef022-a922-4f8d-bda8-55fea7e94182 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.553118 Oct 04 20:40:09.048863 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 747/1487] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:09.082863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:09.083934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:09.095985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.097427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.101263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.103164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.104423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.105624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.646819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:09.672537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b0dfd17-23d3-474a-b3e6-cba41267b68a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 0.607015 Oct 04 20:40:09.677144 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 748/1488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:09 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:09.703832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61470486-7fe8-430b-baa8-faafefea86c0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f611b820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.037060 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61470486-7fe8-430b-baa8-faafefea86c0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.355918 Oct 04 20:40:10.050107 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 749/1489] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:40:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:10.067946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.072167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:10.107968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.108970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.109821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.111305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.112246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.113055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.071692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.100196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a6a411b-ee83-4fa5-864d-019531d20586 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.047685 Oct 04 20:40:11.115227 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 750/1490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:11.142584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed8529ef-04a5-4476-8900-a929161d6bc8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f614f8b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.456431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed8529ef-04a5-4476-8900-a929161d6bc8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.329258 Oct 04 20:40:11.470742 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 751/1491] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:11.485331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.486990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.501607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.502973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.504081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.505832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.507083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.508205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.243018 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77bd4b92-b9c1-4fa2-905d-0b757dfcbb73 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/action" status: 202 len: 0 microversion: 2.25 time: 6.969485 Oct 04 20:40:12.243821 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 741/1492] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:40:05 2022] POST /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/action => generated 0 bytes in 6986 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:12.269626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-088da888-0809-4552-8da5-48c4fe3ef1eb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6a948b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.641280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-088da888-0809-4552-8da5-48c4fe3ef1eb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A35%3A37Z" status: 200 len: 6327 microversion: 2.1 time: 0.395339 Oct 04 20:40:12.650757 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 742/1493] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A35%3A37Z => generated 6327 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:12.669041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.670779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.693901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.701643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.707693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.709858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.711316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.712504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.243499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.273263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e54a0c55-4ebc-4775-a0b4-ce667eb59265 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 1.800083 Oct 04 20:40:13.279821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 752/1494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:13.306457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.317831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:13.362790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.388788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.389939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.406332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.407349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.407967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.929260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.955529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-774e4a15-5eb7-4719-8721-4d656d4b6695 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.305418 Oct 04 20:40:13.962071 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 743/1495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:13.985663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-923aaabd-7978-4b0a-beb3-b90a7367f44b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f623c1f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.176663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-923aaabd-7978-4b0a-beb3-b90a7367f44b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1151862739" status: 200 len: 665 microversion: 2.1 time: 0.211217 Oct 04 20:40:14.187852 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 744/1496] 10.222.0.36 () {58 vars in 1252 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1151862739 => generated 665 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:14.223464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "name": "network-vif-plugged", "status": "completed", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:14.266200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.267277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.268924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.355526 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] Creating event network-vif-plugged:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:40:14.393089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-af71b749-ef1c-425c-98b9-07259d1eb4ee req-35312b78-521c-4157-9736-6c1ca93d6fb6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187197 Oct 04 20:40:14.394255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 745/1497] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:14.444762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b3755da-94d6-48a4-9a25-d7deffc714a1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6a4adc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.572567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b3755da-94d6-48a4-9a25-d7deffc714a1 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1464 microversion: 2.1 time: 0.167774 Oct 04 20:40:14.575109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 746/1498] 10.222.0.36 () {58 vars in 1338 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:14.585221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.588460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:14.609807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.616506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.616506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.616506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.616506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.617143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.347278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.395662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.399146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.422043 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b2654e3-bcf1-47c1-b2e7-1820e25a1b71 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 2.139654 Oct 04 20:40:15.424443 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 753/1499] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:15.435124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5255157b-0d30-45c1-943a-844c893f439b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f622e700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.674446 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5255157b-0d30-45c1-943a-844c893f439b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1464 microversion: 2.1 time: 0.245013 Oct 04 20:40:15.697452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 754/1500] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:15.717318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.718788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:15.743549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.743549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.743549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.744306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.745634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.747252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.912439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.941928 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40056d56-2f3b-4261-97bf-dce09843b900 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1324 microversion: 2.1 time: 2.362890 Oct 04 20:40:16.949629 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 747/1501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1324 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:16.966217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-119b9032-5f70-48f6-89bb-cba255ca682a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6a4a9d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.148731 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-119b9032-5f70-48f6-89bb-cba255ca682a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.196934 Oct 04 20:40:17.168128 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 748/1502] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.409944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.469817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e583c60-a53e-484f-a333-e796d2ff56cd tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.755222 Oct 04 20:40:17.479606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 755/1503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.516369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.526140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.562736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.579982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.581747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.586550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.595498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.596344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.914619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b091b80-16d4-41be-9903-024e9380de35 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Calling method '.version_select at 0x7f54f677cb80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.266761 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b091b80-16d4-41be-9903-024e9380de35 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 371 microversion: 2.1 time: 1.095492 Oct 04 20:40:18.272152 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 749/1504] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 371 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:18.285840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.328336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.333016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.337032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c68f591e-4cb3-4c23-b1bc-c6b77ac65cb5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.853815 Oct 04 20:40:18.353467 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 756/1505] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:18.386545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4e3210e-55ba-4fcd-aafa-4060a17ffed8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6132790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.699346 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4e3210e-55ba-4fcd-aafa-4060a17ffed8 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.339473 Oct 04 20:40:18.703409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 757/1506] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.752899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.757469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:18.788082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.789463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.794716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.800499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.801783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.806291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.925370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e169862a-5305-425a-9e01-2d542f05b01b tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] Action: 'create', calling method: .version_select at 0x7f54f6263700>, body: {"security_group": {"name": "tempest-securitygroup-90085460", "description": "tempest-description-851399284"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:19.905065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:19.941067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-442ae238-2d47-4bff-b4b4-0d059d06bc20 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1521 microversion: 2.1 time: 1.208956 Oct 04 20:40:19.944500 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 758/1507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1521 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:19.967382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f622e0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:20.213144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.216921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.219486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.222687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.228899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.230467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.547097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-283338fa-d81b-4ba5-aa92-d52b31edf202 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 328 microversion: 2.1 time: 0.600053 Oct 04 20:40:20.589601 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 759/1508] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:19 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 328 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:20.616907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:20.620786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:20.645260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.646639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.647921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.649661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.650890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.652620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.421141 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e169862a-5305-425a-9e01-2d542f05b01b tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 3.142593 Oct 04 20:40:21.424452 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 750/1509] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:18 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:21.463818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51e620d9-418f-4dae-86de-e9726feb2a10 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6a94f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.620395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:21.623908 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51e620d9-418f-4dae-86de-e9726feb2a10 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163" status: 200 len: 784 microversion: 2.1 time: 0.196458 Oct 04 20:40:21.625763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 751/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163 => generated 784 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:21.646131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.653948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:21.662390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80f64e34-074a-461a-ae5d-029203738528 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.066414 Oct 04 20:40:21.663683 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 760/1511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:21.689087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.695460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.696851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.698721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.702991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.706292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.734211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-120627f0-9f48-40ee-8632-1d33d586adaf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'create', calling method: .version_select at 0x7f54f611fe50>, body: {"pool": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:23.303778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.313294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:23.339826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.347867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.358287 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6fc4405a-b7d1-462b-a423-3434aabfd185 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 1.729225 Oct 04 20:40:23.368329 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 752/1512] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:23.695225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1729108176", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:23.741238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:23.991958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:24.428089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:24.429153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:24.430175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:24.431018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:24.431800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:24.470270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.475562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.476462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.478034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.479010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.480389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.561195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:24.588060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for user 29e512e1027141a6916a9dc6678e6d6a and project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:24.660090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.utils [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] cores quota exceeded for 0e0ee9e6e76340d3a30be8a7dec2fa4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123542) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:40:24.661617 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Request method failure captured: Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 145 Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJorxdDeVZoCcXVFJxg176iIypkixDn10tnDZxAgjnkgLa6leteczeN16BW1uslbpr28mwFLfzFD-4MLUvjc4D0La0BZDHIFNA_h8uR_ErEo1Qjs_M_cj8mNNMUZZF7ammbVHGdrsUVBhXVM9zZDY1YhoTzLcIhCBf2m8bGrWef8eyU Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:40:24.710751 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 29e512e1027141a6916a9dc6678e6d6a Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1729108176", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} Oct 04 20:40:24.714421 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1729108176', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452'}}} Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:40:24.718016 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.723484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.728629 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e31d86e-bda3-4c1e-9fe6-2764fb0769af tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.349061 Oct 04 20:40:24.749095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 753/1513] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 1359 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:24.750546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bc1a0bb-3ff0-489f-84d7-6a87d3aa7743 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] Action: 'create', calling method: .version_select at 0x7f54f6411ee0>, body: {"security_group": {"name": "tempest-securitygroup-565769711", "description": "tempest-description-1460228829"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:25.980566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bc1a0bb-3ff0-489f-84d7-6a87d3aa7743 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.255632 Oct 04 20:40:25.995326 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 754/1514] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:26.012956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-241b9be0-b233-4f61-9e6e-4189b2de0ebb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6465e50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:26.202155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-241b9be0-b233-4f61-9e6e-4189b2de0ebb tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.191245 Oct 04 20:40:26.202155 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 755/1515] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:26.217089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:26.219050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:26.236619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.237856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.240256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:26.242158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.243647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.245484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:26.939499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:26.975797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75ce86cb-8b0a-42f2-9261-2418795c86c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.771321 Oct 04 20:40:26.977260 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 756/1516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:26 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:27.183043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1916094606", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "1dd8cc8f-b05d-4a0f-ba91-33403b044b22"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:27.411814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] validate_networks() for [('1dd8cc8f-b05d-4a0f-ba91-33403b044b22', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:28.745771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-120627f0-9f48-40ee-8632-1d33d586adaf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.064348 Oct 04 20:40:28.747394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 761/1517] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:40:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:28.769338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:28.776888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:28.825200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.835793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.835793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.839984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.843905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.845230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.411910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:29.428672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:29.431697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:29.434305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:29.435744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:29.440064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:29.442426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:29.448090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:29.457147 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee070a91-6a0f-42ae-8d44-8350e1250171 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.704139 Oct 04 20:40:29.458324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 762/1518] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:28 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:29.484533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.493345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.499828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.505677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.521088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.528521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f60ca790>, body: {"quota_set": {"cores": 20}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:29.530463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.614864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Getting quotas for project 5a40e18958af4ebdb49dfbeda7bc50bc. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:29.653572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Getting quotas for user f9db85dc2fa94539bad50a4996d5b910 and project 5a40e18958af4ebdb49dfbeda7bc50bc. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:29.700683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:29.715352 n-d-851029-13 devstack@n-api.service[123542]: WARNING nova.utils [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1916094606 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-191609460 Oct 04 20:40:29.726168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:29.795007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.799017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.800541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.803281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.809708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.811121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.999324 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-339bb034-a493-421a-bb2c-70f0e177107f tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.017320 Oct 04 20:40:30.020153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 757/1519] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:30.161018 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53aaaa05-91f9-41d1-834e-f03c9a5c9695 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 329 microversion: 2.1 time: 0.663667 Oct 04 20:40:30.162127 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 763/1520] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:29 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 329 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:30.177506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-307759f7-abd0-4867-b014-263d79a140c0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f611fe50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:30.265788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20a4fafa-1181-4036-979e-f431793384c1 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] Action: 'create', calling method: .version_select at 0x7f54f6b33d30>, body: {"security_group": {"name": "tempest-securitygroup-344229726", "description": "tempest-description-621715748"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:32.203469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20a4fafa-1181-4036-979e-f431793384c1 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.177318 Oct 04 20:40:32.205421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 758/1521] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:30 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:32.245530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:32.248687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:32.312357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.312357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.316711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:32.319078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.324735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.326273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:32.970612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:32.998431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e687977-0762-40bf-bed7-5e46d38105b0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.790739 Oct 04 20:40:33.000835 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 759/1522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:32 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:33.013469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1362400973", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "eaa81373-5c68-4ae7-accb-762c1b6d583f"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:33.205964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] validate_networks() for [('eaa81373-5c68-4ae7-accb-762c1b6d583f', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:34.388031 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-307759f7-abd0-4867-b014-263d79a140c0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94" status: 204 len: 0 microversion: 2.1 time: 4.222284 Oct 04 20:40:34.389887 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 764/1523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:30 2022] DELETE /compute/v2.1/images/8b104ecf-c70b-47c4-86e0-d136e737fb94 => generated 0 bytes in 4227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:34.406001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:34.411839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:34.440665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.442345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.443517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.445585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.447871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.449048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.796075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:34.835641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0e0e8b31-495e-4c18-a3a5-d7d2cc59793b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1228 microversion: 2.1 time: 0.443383 Oct 04 20:40:34.841733 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 765/1524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:34 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1228 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:34.850200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78d2f633-a996-4a58-8e9d-9408caa07821 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Calling method '.version_select at 0x7f54f61e29d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:34.943951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:34.944931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:34.945869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:34.948377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:34.953012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:34.988036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.988913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.993662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.999974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.002185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.003145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.070469 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78d2f633-a996-4a58-8e9d-9408caa07821 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 371 microversion: 2.1 time: 0.226897 Oct 04 20:40:35.080312 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 766/1525] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:40:34 2022] GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:35.097787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.104449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Getting quotas for project 5183c91fd7184d16a0cb7d7e364c317d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:35.105511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:35.131410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.134082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Getting quotas for user 174a016af11c4609af9410fa95ff16d4 and project 5183c91fd7184d16a0cb7d7e364c317d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:35.144472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.145867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.149126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.152891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.157537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.197515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:35.210056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:35.540525 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0104462-1663-43b1-bc9e-3fac871d2c1f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.535950 Oct 04 20:40:35.560094 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 760/1526] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:35.587773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.599732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e479eea5-96f2-4746-a9b2-cac9cfb0dab3 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] Action: 'create', calling method: .version_select at 0x7f54f6af8040>, body: {"security_group": {"name": "tempest-securitygroup-1525094723", "description": "tempest-description-1587445333"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:35.610033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=89 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:35.638298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.642162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.645247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7e59cee-a2f6-47b1-817a-c5a808a1e2fc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.561109 Oct 04 20:40:35.663325 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 767/1527] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:35 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:35.849148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbdee660-089d-42c8-907b-ccc2e3c9b35c tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Action: 'create', calling method: .version_select at 0x7f54f60e0ee0>, body: {"keypair": {"name": "tempest-keypair-558909897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6EKpIsNPiGBdWV8cbAVXpSPZmDweUdHzX83uAlBW/pElJP3P5AD7mFiWE0PmhaShkm64jn2xpmdA2/OYT2FAjF5alOzYnc+Sem4dhff7BqLAVnxqex+OIGkTV1UnG++A=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:35.882399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:35.915223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fbdee660-089d-42c8-907b-ccc2e3c9b35c tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for project b02ad762c9524c89b51e640167845308. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:35.938498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fbdee660-089d-42c8-907b-ccc2e3c9b35c tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for user 37a5270bf013448dbdee85b496ff115f and project b02ad762c9524c89b51e640167845308. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:36.093506 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbdee660-089d-42c8-907b-ccc2e3c9b35c tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.431599 Oct 04 20:40:36.106944 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 768/1528] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:40:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:36.117406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.121433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:36.152115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.158231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.160345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.191877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.194347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.198156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.860736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.889811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-522a5850-ddef-4d38-beee-224e6f90c4c9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.778670 Oct 04 20:40:36.892289 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 769/1529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:37.247816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75a0b0a8-7921-41d5-80ac-4e1100ec8b4d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f614f550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:37.348308 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e479eea5-96f2-4746-a9b2-cac9cfb0dab3 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.781509 Oct 04 20:40:37.353983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 761/1530] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:40:35 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:37.452259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f61d0310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:37.734887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:37.735778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:37.742946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:37.748682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:37.755806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:37.757878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.187902 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd0292a4-065a-403f-a028-471ded1664fa tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 328 microversion: 2.1 time: 0.797048 Oct 04 20:40:38.191092 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 762/1531] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:37 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 328 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:38.201199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-324ea233-f09c-41b8-8b4c-78b440220d06 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.203007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-324ea233-f09c-41b8-8b4c-78b440220d06 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:38.394370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-324ea233-f09c-41b8-8b4c-78b440220d06 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.457318 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-324ea233-f09c-41b8-8b4c-78b440220d06 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1224 microversion: 2.1 time: 0.263813 Oct 04 20:40:38.463377 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 763/1532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1224 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:38.469457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.470913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:38.488501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.489617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.490393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.492920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.501218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.501218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.704563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.721567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb3b9cec-9318-4869-80cd-bf1b9520e934 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1290 microversion: 2.1 time: 0.260201 Oct 04 20:40:38.740194 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 764/1533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1290 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:38.764183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.765796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:38.780923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.784492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.784492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.785302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.786571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.787777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.222574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.275122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.275122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.275122 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-238fff1a-d666-4381-98b5-6fba31717222 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.513275 Oct 04 20:40:39.275714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 765/1534] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:39.275714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f269eab-3805-4b83-841d-f0e9bf25b63a tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] Calling method '.version_select at 0x7f54f61c6160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.837894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:40.396082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75a0b0a8-7921-41d5-80ac-4e1100ec8b4d tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320" status: 204 len: 0 microversion: 2.1 time: 3.501249 Oct 04 20:40:40.397258 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 770/1535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:36 2022] DELETE /compute/v2.1/images/32e74888-c76f-42ff-a429-c9738c09e320 => generated 0 bytes in 3504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:40.430787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.432652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:40.462873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.477054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.478004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.485363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.489686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.495578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.477961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:41.527894 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c35edb4-8ff6-4c4a-ba5b-d0d742449707 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.113087 Oct 04 20:40:41.531876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 771/1536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:40 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:41.558126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-504916304", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:42.221574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:43.787855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:43.788971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:43.790916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:43.794138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:43.795205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:43.810764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=23 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:43.830824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.832508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.833927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.836539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.837814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.839606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.900651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:43.915126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for user 29e512e1027141a6916a9dc6678e6d6a and project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:43.944843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.utils [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] instances quota exceeded for 0e0ee9e6e76340d3a30be8a7dec2fa4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123541) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:40:43.946441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Request method failure captured: Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 144 Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJorxdDeVZoCcXVFJxg176iIypkixDn10tnDZxAgjnkgLa6leteczeN16BW1uslbpr28mwFLfzFD-4MLUvjc4D0La0BZDHIFNA_h8uR_ErEo1Qjs_M_cj8mNNMUZZF7ammbVHGdrsUVBhXVM9zZDY1YhoTzLcIhCBf2m8bGrWef8eyU Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:40:43.954703 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 29e512e1027141a6916a9dc6678e6d6a Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-504916304", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} Oct 04 20:40:43.957646 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-504916304', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452'}}} Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:40:43.959308 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:43.962079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.967206 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a22c690a-e5a4-4279-8bb5-9341464e6f05 tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 2.422431 Oct 04 20:40:43.970238 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 772/1537] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 2431 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:43.975372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.975372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.988263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.989148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.990163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.992588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.993039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.995120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.212007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.247130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33a0ac3f-88db-4edb-b3e5-c8d041614d19 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1282 microversion: 2.1 time: 0.277184 Oct 04 20:40:44.249791 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 773/1538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.263392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.268247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.281768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.283079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.283614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.285177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.286052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.286883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.072169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.090358 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1b9ad71-6fed-4ced-9983-5ab941aa3f03 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1332 microversion: 2.1 time: 0.837764 Oct 04 20:40:45.104536 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 774/1539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1332 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:45.123706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.124920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.141193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.143051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.144500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.145489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.146453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.147354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.888133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.908411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.911911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.914620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf551e02-41db-4811-b345-3befa517b3b2 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.798634 Oct 04 20:40:45.931310 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 775/1540] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:45.964240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8013a9ca-8357-4dab-aba3-04d3b60a6de0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f6105430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.716069 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f269eab-3805-4b83-841d-f0e9bf25b63a tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11607 microversion: 2.1 time: 8.456947 Oct 04 20:40:47.727349 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 766/1541] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11607 bytes in 8460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:47.763094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4a828-6650-409d-a2e2-45eaf7944a05", "tag": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:47.792913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:47.796469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.797496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.798379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.827212 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] Creating event network-changed:ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 for instance a3a4a828-6650-409d-a2e2-45eaf7944a05 on n-h2-851029-13 Oct 04 20:40:47.839418 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-acf93265-bd30-4793-8a83-bb7d706ddff0 req-23ac3840-d0c5-40f8-89d5-30e704236445 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118653 Oct 04 20:40:47.841691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 767/1542] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:47.856024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.857668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.870988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.877677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.877677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.877677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.877677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.878391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.231446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.242833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a2310e6-a2be-444f-b544-95519c3797d9 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.396971 Oct 04 20:40:48.243784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 768/1543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:48.252240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f62c8550>, body: {"quota_set": {"instances": 10}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:48.366732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:48.373666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.374462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.376739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.378294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.379230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.380049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.415350 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8013a9ca-8357-4dab-aba3-04d3b60a6de0 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4" status: 204 len: 0 microversion: 2.1 time: 2.480264 Oct 04 20:40:48.428311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 776/1544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] DELETE /compute/v2.1/images/5728bb39-3b81-4b1f-b9e2-70edb2ee7af4 => generated 0 bytes in 2496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:48.473840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.478178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.503744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.504626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.505405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.506953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.507910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.508701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.754174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5baf37ce-909f-4e8d-8f54-af7f512ec558 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 329 microversion: 2.1 time: 0.506123 Oct 04 20:40:48.755736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 769/1545] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:48 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 329 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:48.768819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-933807162", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f2585bb6-6f36-4ddc-a443-426cbd12e481"}], "security_groups": [{"name": "tempest-securitygroup--1426499281"}], "key_name": "tempest-keypair-558909897", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:49.188101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.211850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b3507c0-e68c-4794-8353-286c402f9977 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1324 microversion: 2.1 time: 0.773649 Oct 04 20:40:49.213168 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 777/1546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1324 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.224108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.226464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.240589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.243090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.243090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.245625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.247137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.248340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.312747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] validate_networks() for [('f2585bb6-6f36-4ddc-a443-426cbd12e481', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:50.044439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:50.064949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f61e61cb-255e-4ce6-903a-4720c5e2627c tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1332 microversion: 2.1 time: 0.849073 Oct 04 20:40:50.067134 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 778/1547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1332 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:50.079865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.081614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:50.095475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.096378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.097257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.098630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.099415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.100104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.239114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.259120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.262954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.265274 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7597d19b-d0c7-47a5-8772-2858f2646b89 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 1.195550 Oct 04 20:40:51.266455 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 779/1548] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:51.275872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7872d27-3ced-40b8-8faf-cda29764fb33 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] Calling method '.version_select at 0x7f54f624c940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.009479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for project b02ad762c9524c89b51e640167845308. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:52.021456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for user 37a5270bf013448dbdee85b496ff115f and project b02ad762c9524c89b51e640167845308. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:52.042176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:52.051264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:52.051264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:52.058210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:52.058210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:52.058210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:52.069859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.070895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.071673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.073646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.074828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.075407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.113984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for project b02ad762c9524c89b51e640167845308. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:52.126163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Getting quotas for user 37a5270bf013448dbdee85b496ff115f and project b02ad762c9524c89b51e640167845308. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:52.151506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:52.155372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:52.366563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48a7c419-c1a2-4cd2-a12f-fb4650042eed tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.607522 Oct 04 20:40:52.385824 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 770/1549] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 3628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:52.399239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.400592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.412426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.414392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.415502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.417624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.423849 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7872d27-3ced-40b8-8faf-cda29764fb33 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 1.155149 Oct 04 20:40:52.425095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 780/1550] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 4 20:40:51 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:52.434550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.437442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.441999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57809429-01d5-4ec8-a613-3af06a889f9a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Calling method '.version_select at 0x7f54f6105ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.525991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:52.663290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57809429-01d5-4ec8-a613-3af06a889f9a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 371 microversion: 2.1 time: 0.236033 Oct 04 20:40:52.664815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 781/1551] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:52.675490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4a828-6650-409d-a2e2-45eaf7944a05", "name": "network-vif-plugged", "status": "completed", "tag": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:52.695298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.696572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.697796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.724273 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] Creating event network-vif-plugged:ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 for instance a3a4a828-6650-409d-a2e2-45eaf7944a05 on n-h2-851029-13 Oct 04 20:40:52.737072 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9659a648-83f6-4301-9183-25c62fa1cebb req-4c41fb88-bc9c-46af-b2eb-b44e2b8842af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069057 Oct 04 20:40:52.739026 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 782/1552] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:52.757075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.760178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.795611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.804018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.806574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.809932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.810897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.818861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.977898 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a44095ab-93c9-45ba-bbf2-4d9fc2eeebfd tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 204 len: 0 microversion: 2.1 time: 0.586929 Oct 04 20:40:52.979879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 771/1553] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:52 2022] DELETE /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:53.008069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "name": "network-vif-unplugged", "status": "completed", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}, {"name": "network-changed", "server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:53.052171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.053177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.053967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.090068 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Creating event network-vif-unplugged:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h1-851029-13 Oct 04 20:40:53.092485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] Creating event network-changed:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h1-851029-13 Oct 04 20:40:53.112712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e18f5214-0418-49c5-8e2b-64e02848e46c req-d2fe3c2b-7d77-4a24-ab5e-dfdb9f1bf79e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.123969 Oct 04 20:40:53.123334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 772/1554] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:53.131415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.133099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.146841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.147952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.149179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.152302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.153584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.156690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.388060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:53.410911 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d71fd04-22c4-4c2c-8cff-f13bd0bee522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.669291 Oct 04 20:40:53.412056 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 783/1555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:53.448763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541dc842-3d80-4824-ade1-014cd5281a5a", "tag": "63d7e9d4-043c-43c3-8b9f-51eab3638c74"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:53.469992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.474009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.474920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.503458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] Creating event network-changed:63d7e9d4-043c-43c3-8b9f-51eab3638c74 for instance 541dc842-3d80-4824-ade1-014cd5281a5a on n-h1-851029-13 Oct 04 20:40:53.515417 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b109503a-6fa1-4b51-8af5-3fa211f8c483 req-d889f2ca-5bb4-4aaf-905b-8488cc790b4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074139 Oct 04 20:40:53.517826 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 784/1556] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:53.528932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.537041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.546547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.547500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.548857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.550415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.551318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.552292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.722226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:53.727701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:53.748462 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-070db496-6825-4cb2-ab6b-60754ba1adf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1324 microversion: 2.1 time: 0.625473 Oct 04 20:40:53.751188 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 773/1557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1324 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:53.762239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.763980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.782494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.784128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.786458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.788362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.789619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.790797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.878604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:53.923637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:53.950601 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb3fa117-7c4b-4692-999e-05cf1520d0da tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1332 microversion: 2.1 time: 0.430649 Oct 04 20:40:53.956094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 785/1558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1332 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:53.968549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bda7b228-5007-48b8-a0c1-a66e1a000bbf tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.970693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bda7b228-5007-48b8-a0c1-a66e1a000bbf tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.133708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bda7b228-5007-48b8-a0c1-a66e1a000bbf tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.153571 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bda7b228-5007-48b8-a0c1-a66e1a000bbf tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1268 microversion: 2.1 time: 0.199386 Oct 04 20:40:54.165692 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 786/1559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1268 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:54.165692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23dd0daf-0557-448e-b0dd-e592ac59c9db tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] Calling method '.version_select at 0x7f54f62a1ee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.230320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.280366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.290103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.302399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62d9b0f1-b00b-496e-b5f6-7cf3f0c6da6a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.548591 Oct 04 20:40:54.314030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 774/1560] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:54.346455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f62111f0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:54.529005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.530233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.531091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.533603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.535263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.536399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.787949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a1e8310f-57d7-476b-8575-7f3e5fe6fe88 tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 325 microversion: 2.1 time: 0.472165 Oct 04 20:40:54.801925 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 775/1561] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:54 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:54.801925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.802357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.815847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.816987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.817806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.819233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.820492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.822220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.826419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23dd0daf-0557-448e-b0dd-e592ac59c9db tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c7ecd637-222b-43fb-9a21-92a98b7c3bf7" status: 202 len: 0 microversion: 2.1 time: 0.669341 Oct 04 20:40:54.828159 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 787/1562] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:54 2022] DELETE /compute/v2.1/os-security-groups/c7ecd637-222b-43fb-9a21-92a98b7c3bf7 => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:54.836786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.844884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.858466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.871495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.871495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.872371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.873273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.873940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.199235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.215492 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7d66977-ea94-4a46-b919-4faa7cb45f56 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1473 microversion: 2.1 time: 0.423441 Oct 04 20:40:55.216764 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 776/1563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.231082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.231082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.232236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.243398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.244450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.245562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.247499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.248510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.249423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.256598 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b3053fa8-e17f-417e-9e69-9bc2e65c1eac tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.426189 Oct 04 20:40:55.262164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 788/1564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.269945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40c8b6b3-d9ae-4d95-9621-8a12394843e6 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] Calling method '.version_select at 0x7f54f7bf3af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.673200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.689020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-033413d8-0597-48e3-99f7-154dcf03d431 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1324 microversion: 2.1 time: 0.469915 Oct 04 20:40:55.690525 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 777/1565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:55 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.701387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-620016278", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:55.816500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:56.064465 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40c8b6b3-d9ae-4d95-9621-8a12394843e6 tempest-SecurityGroupsTestAdminJSON-966400759 tempest-SecurityGroupsTestAdminJSON-966400759-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/98d10736-7825-4eb4-a0bb-99f832f1e9b5" status: 202 len: 0 microversion: 2.1 time: 0.802788 Oct 04 20:40:56.066081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 789/1566] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:55 2022] DELETE /compute/v2.1/os-security-groups/98d10736-7825-4eb4-a0bb-99f832f1e9b5 => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:56.077977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.080342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.096560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.098012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.098821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.100367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.101240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.102415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.241263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:56.242113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:56.243262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:56.244758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:56.245624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:56.268101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.269440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.270400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.272405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.273463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.274414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.333585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:56.345250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Getting quotas for user 29e512e1027141a6916a9dc6678e6d6a and project 0e0ee9e6e76340d3a30be8a7dec2fa4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:56.379037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.utils [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] ram quota exceeded for 0e0ee9e6e76340d3a30be8a7dec2fa4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123542) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:40:56.384665 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Request method failure captured: Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 144 Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJorxdDeVZoCcXVFJxg176iIypkixDn10tnDZxAgjnkgLa6leteczeN16BW1uslbpr28mwFLfzFD-4MLUvjc4D0La0BZDHIFNA_h8uR_ErEo1Qjs_M_cj8mNNMUZZF7ammbVHGdrsUVBhXVM9zZDY1YhoTzLcIhCBf2m8bGrWef8eyU Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:40:56.386328 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 29e512e1027141a6916a9dc6678e6d6a Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-620016278", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} Oct 04 20:40:56.389954 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-620016278', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452'}}} Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:40:56.391988 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:56.395953 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.403120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1af3c25f-a345-431f-989e-59530e5fdf8d tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.696492 Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 778/1567] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 698 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:56.408358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.409979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.412556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.413789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.414636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.417987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.418324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.419136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.442204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.458970 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b6690d7-c8d6-4137-b6c2-ebcc23f72de9 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1535 microversion: 2.1 time: 0.390248 Oct 04 20:40:56.470971 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 790/1568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1535 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:56.495080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.496920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.512988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.515200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.516393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.517775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.518828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.519954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.658243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.676919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a849b55-03d0-48bf-ae4b-e70f2a308b05 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1320 microversion: 2.1 time: 0.284898 Oct 04 20:40:56.678314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 779/1569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:56.690745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "name": "network-vif-unplugged", "status": "completed", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}, {"name": "network-changed", "server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:56.713871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.714825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.715605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.742810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Creating event network-vif-unplugged:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h2-851029-13 Oct 04 20:40:56.745273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] Creating event network-changed:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h2-851029-13 Oct 04 20:40:56.756189 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fea217a0-6f35-4b5a-b477-d31a3ad765e7 req-360db7a4-4197-4a98-b103-fefa4ac07056 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.074950 Oct 04 20:40:56.757346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 780/1570] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:56.770564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a68a7119-32c3-4a1e-a388-40f0b8066323 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] Calling method '.version_select at 0x7f54f6465430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.499773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:57.521086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:57.524475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:57.527570 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f1214f8-4ef5-47a9-9a2b-68b53956e4a3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 1.051482 Oct 04 20:40:57.529513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 791/1571] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:57.541388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.543129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:57.557567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.558952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.560049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.561726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.563294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.564461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.259470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:59.284014 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9097c787-2d82-462c-9621-30f0f151f4d7 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 200 len: 1473 microversion: 2.1 time: 1.752171 Oct 04 20:40:59.286248 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 792/1572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:57 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 1473 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:59.299030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:59.301135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:59.323790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.325491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.326823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.328688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.329935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.331353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.566384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a68a7119-32c3-4a1e-a388-40f0b8066323 tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/24036426-5645-48c1-b8cd-1ec06a81069e" status: 202 len: 0 microversion: 2.1 time: 2.806443 Oct 04 20:40:59.568003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 781/1573] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:40:56 2022] DELETE /compute/v2.1/os-security-groups/24036426-5645-48c1-b8cd-1ec06a81069e => generated 0 bytes in 2810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:59.598934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Action: 'update', calling method: .version_select at 0x7f54f61c6af0>, body: {"quota_set": {"ram": 51200}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:59.882202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.883491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.887284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.888992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.889815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.890618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:00.236515 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47c63bfc-dc15-40f4-9eb6-31376e37956a tempest-QuotasAdminNegativeTest-1056035315 tempest-QuotasAdminNegativeTest-1056035315-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 200 len: 329 microversion: 2.1 time: 0.666178 Oct 04 20:41:00.238502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 782/1574] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:40:59 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 329 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:00.247276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d5c5246-9b45-4984-a9f7-3d00a9a30089 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'create', calling method: .version_select at 0x7f54f61c6160>, body: {"pool": "225389d0-e589-4bcf-8210-aff3365ff792"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:00.318354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:00.335057 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d96a9cd4-ab29-4817-afb6-1592e0e81186 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 1.045538 Oct 04 20:41:00.337558 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 793/1575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:59 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:00.348103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:00.349741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:00.379598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:00.380519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:00.387534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:00.389981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:00.393711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:00.395073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:00.443329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:01.066762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:01.107627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30ae2f4d-92e9-4c36-bf07-c8bb43d7e828 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1324 microversion: 2.1 time: 0.745523 Oct 04 20:41:01.107627 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 794/1576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:00 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1324 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:01.153986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:01.155675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:01.185409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.189587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.189587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.189587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.197904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.200851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.679016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:01.706978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25525d29-49c1-4e2d-b434-d80e672155ab tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1394 microversion: 2.1 time: 0.588406 Oct 04 20:41:01.709109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 795/1577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:01 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1394 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:01.722322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:01.723932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:01.740115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.743560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.746070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.748753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.749755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.751342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.146416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:02.167157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:02.171295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:02.174321 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad52b3bd-bb7e-4a66-a8f2-56399ee1b72c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.460269 Oct 04 20:41:02.175482 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 796/1578] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:01 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:02.186935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bc06a5-c7c8-4f58-8fa4-3593dbdd5794", "name": "network-vif-deleted", "tag": "04e7bb18-0cec-4ce4-8e6a-b645fb606a91"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:02.203078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.204140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.205226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.231300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] Creating event network-vif-deleted:04e7bb18-0cec-4ce4-8e6a-b645fb606a91 for instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 on n-h1-851029-13 Oct 04 20:41:02.244303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-554b326b-d7cb-46f0-8944-9069ebec3c0a req-ea57b8f0-7d87-49a4-ba2e-9f037720bf84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065732 Oct 04 20:41:02.245861 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 797/1579] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:02.258407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7bfe06a-2e61-4a9c-b778-8d6d66cef59f tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] Calling method '.version_select at 0x7f54f6105e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:02.986740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7bfe06a-2e61-4a9c-b778-8d6d66cef59f tempest-SecurityGroupsTestAdminJSON-1810213570 tempest-SecurityGroupsTestAdminJSON-1810213570-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/7fe2b577-1627-437e-a2d0-5a8dcbc28d36" status: 202 len: 0 microversion: 2.1 time: 0.736959 Oct 04 20:41:02.988710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 798/1580] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:02 2022] DELETE /compute/v2.1/os-security-groups/7fe2b577-1627-437e-a2d0-5a8dcbc28d36 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:03.008989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1dedebc-f046-439b-8a6b-bd07d33327bd tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Action: 'update', calling method: .version_select at 0x7f54f62bd4c0>, body: {"quota_set": {"ram": 0}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:03.022446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b1dedebc-f046-439b-8a6b-bd07d33327bd tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '29e512e1027141a6916a9dc6678e6d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e0ee9e6e76340d3a30be8a7dec2fa4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1dedebc-f046-439b-8a6b-bd07d33327bd tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Request method failure captured: Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b HTTP/1.1 Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 25 Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJorxdDeVZoCcXVFJxg176iIypkixDn10tnDZxAgjnkgLa6leteczeN16BW1uslbpr28mwFLfzFD-4MLUvjc4D0La0BZDHIFNA_h8uR_ErEo1Qjs_M_cj8mNNMUZZF7ammbVHGdrsUVBhXVM9zZDY1YhoTzLcIhCBf2m8bGrWef8eyU Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:03.040907 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e0ee9e6e76340d3a30be8a7dec2fa4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0e0ee9e6e76340d3a30be8a7dec2fa4b Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1631933886 Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 29e512e1027141a6916a9dc6678e6d6a Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-QuotasAdminNegativeTest-1631933886-project Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: {"quota_set": {"ram": 0}} Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:41:03.043023 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '0e0ee9e6e76340d3a30be8a7dec2fa4b', 'body': {'quota_set': {'ram': 0}}} Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:03.044283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.045604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.049250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1dedebc-f046-439b-8a6b-bd07d33327bd tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:03.050304 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b1dedebc-f046-439b-8a6b-bd07d33327bd tempest-QuotasAdminNegativeTest-1631933886 tempest-QuotasAdminNegativeTest-1631933886-project] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b" status: 403 len: 116 microversion: 2.1 time: 0.057307 Oct 04 20:41:03.059437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 799/1581] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:41:02 2022] PUT /compute/v2.1/os-quota-sets/0e0ee9e6e76340d3a30be8a7dec2fa4b => generated 116 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:03.071351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:03.073810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:03.093491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.094852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.096055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.097807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.099020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.101260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.134064 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] HTTP exception thrown: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Request method failure captured: Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 HTTP/1.1 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJkYkPTi-DzkBhzOPEGg1iTOJrdl-26U5dh2n5F1pj7_gb8jPI9oE85ZtiY5Lj_KGiH0U9G-lJURMjf82C5m-589xlGjC71pQ2cBu-hH7EQ7CMpxjjigOX1s5U8Pi-PV7sccSybxUT8DMDXKQw0Iem7nTM1WrZYjBkxqneAe2mtbrf4 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 07d97bc82450455982de0d09d2448851 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:03.137778 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07d97bc82450455982de0d09d2448851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07d97bc82450455982de0d09d2448851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07d97bc82450455982de0d09d2448851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07d97bc82450455982de0d09d2448851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 07d97bc82450455982de0d09d2448851 Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListImageFiltersTestJSON-621871276-project Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 51c24c1c94784ab88d7f9b31c26682b5 Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListImageFiltersTestJSON-621871276-project Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. Oct 04 20:41:03.140259 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '37bc06a5-c7c8-4f58-8fa4-3593dbdd5794'} Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:03.141669 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. Oct 04 20:41:03.146468 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:03.149185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Returning 404 to user: Instance 37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:03.149185 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aac9bffb-7504-4601-9302-7941360b639b tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794" status: 404 len: 111 microversion: 2.1 time: 0.081589 Oct 04 20:41:03.149491 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 800/1582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:03 2022] GET /compute/v2.1/servers/37bc06a5-c7c8-4f58-8fa4-3593dbdd5794 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:03.159357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541dc842-3d80-4824-ade1-014cd5281a5a", "name": "network-vif-plugged", "status": "completed", "tag": "63d7e9d4-043c-43c3-8b9f-51eab3638c74"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:03.183660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.184540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.185631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.213219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] Creating event network-vif-plugged:63d7e9d4-043c-43c3-8b9f-51eab3638c74 for instance 541dc842-3d80-4824-ade1-014cd5281a5a on n-h1-851029-13 Oct 04 20:41:03.224887 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-df2fc13b-ac4e-4e05-a8d4-32b9ae69b9e5 req-3d368d6d-8cbf-418e-8b65-cb559e6b0b73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072198 Oct 04 20:41:03.226777 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 801/1583] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:03.265199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:03.268480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:03.304139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.305218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.306244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.316794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.316794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.316794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.907821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.920048 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45a78bfc-3c96-40b2-85a6-75d32311df3c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1716 microversion: 2.1 time: 0.691341 Oct 04 20:41:03.935490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 802/1584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:03 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1716 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:03.960363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:03.961283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:03.977632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.977632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.977632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.977632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.978360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.978360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.152125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:04.386562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:04.404969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a5b1c72-4935-4816-94ae-dd23939a399d tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1324 microversion: 2.1 time: 0.466420 Oct 04 20:41:04.427493 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 803/1585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:03 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:04.446402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:04.448267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:04.459824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.461119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.465346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.465346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.465346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.465346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.022395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:05.040138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60145a3a-bc1a-4295-b2bd-10cbf2b6249e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1394 microversion: 2.1 time: 0.610663 Oct 04 20:41:05.059539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 804/1586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:04 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1394 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:05.081247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:05.082446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.094280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.095912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.097138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.098937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.100156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.101246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.175327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:05.309026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d5c5246-9b45-4984-a9f7-3d00a9a30089 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.068004 Oct 04 20:41:05.309946 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 783/1587] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:05.319614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:05.322888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.346574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.348912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.349781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.357126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.362612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.362612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.735472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff2b41aa-3c82-48f3-8abc-eef910dc32d5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 204 len: 0 microversion: 2.1 time: 0.672393 Oct 04 20:41:05.745715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 805/1588] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:05 2022] DELETE /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:05.779481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74841450-cc9f-4202-9fa8-eef287d1bc60", "tag": "40437564-269a-4f42-8092-49d30013af85"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:05.816871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.817810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.820922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.844553 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] Creating event network-changed:40437564-269a-4f42-8092-49d30013af85 for instance 74841450-cc9f-4202-9fa8-eef287d1bc60 on n-h2-851029-13 Oct 04 20:41:05.860363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:05.861936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2f896a2e-06e6-49e4-a1ce-8ef325baf0d2 req-c91568a0-e612-485b-9e7d-b0d50e98c76a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112308 Oct 04 20:41:05.864958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 806/1589] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:05.873794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:05.875060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.879766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:05.888454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:05.889135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.889737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.890370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.891493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.892362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.892870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.893452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23677115-2eb4-4442-bb17-7ab9bf5b59fb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.580614 Oct 04 20:41:05.911255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 784/1590] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:05 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:05.942122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: .version_select at 0x7f54f7f5d3a0>, body: {"addFloatingIp": {"address": "172.25.6.89"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:05.947413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.959507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.961053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.962321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.964595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.965890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.967062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.113721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:06.116840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquired lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:06.385210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:06.402996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd1eeb47-f7b6-4e24-9a86-e79918acfdb3 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1706 microversion: 2.1 time: 0.535143 Oct 04 20:41:06.405056 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 807/1591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:05 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1706 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:06.428050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:06.430478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:06.451752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:06.455072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.456003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.456875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.459591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.460579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.461456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.990824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:07.029873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e8469bd-0908-4e8a-878b-4b6072fa91ec tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 200 len: 1520 microversion: 2.1 time: 0.622362 Oct 04 20:41:07.043424 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 808/1592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:06 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 1520 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:07.091036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:07.092822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:07.106417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.109965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.109965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.110837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.111834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.112738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.662614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c24c1c94784ab88d7f9b31c26682b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d97bc82450455982de0d09d2448851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:07.684091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-faa6e6b9-cf0b-41ca-af28-99d6764f1179 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 200 len: 1474 microversion: 2.1 time: 0.637512 Oct 04 20:41:07.766226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 809/1593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:07 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 1474 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:07.766226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:07.766226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:07.766226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.766226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.769241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.769241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.769241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.769241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.040165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:09.080129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04f04c6a-d9a0-4cb1-99b8-51aee98a3453 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1394 microversion: 2.1 time: 1.374096 Oct 04 20:41:09.087657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 810/1594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:07 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1394 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:09.094470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2ccfe01-60d0-48cb-a5e3-822fbbb18207 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '.version_select at 0x7f54f62a1d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:09.104414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2ccfe01-60d0-48cb-a5e3-822fbbb18207 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.106342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2ccfe01-60d0-48cb-a5e3-822fbbb18207 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.107901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2ccfe01-60d0-48cb-a5e3-822fbbb18207 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.131452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2ccfe01-60d0-48cb-a5e3-822fbbb18207 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2341 microversion: 2.1 time: 0.047025 Oct 04 20:41:09.133767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 811/1595] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:41:09 2022] GET /compute/v2.1/os-migrations => generated 2341 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:09.146452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:09.149356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:09.162787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.167799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.167799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.167799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.167799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.168569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.912848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:09.925149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:09.965471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:09.977367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:09.984398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09508677-3aa9-458c-b1a6-f4a4b062261a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.847373 Oct 04 20:41:09.985514 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 812/1596] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:09 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:10.005859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: .version_select at 0x7f54f7faad30>, body: {"addFloatingIp": {"address": "172.25.6.102"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:10.013767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:10.027226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:10.028596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:10.029556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:10.031355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:10.033580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:10.034991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:10.221558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=39 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:10.227124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:10.233539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquired lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:10.522044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:14.945147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Updating instance_info_cache with network_info: [{"id": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01", "address": "fa:16:3e:8f:6a:00", "network": {"id": "1dd8cc8f-b05d-4a0f-ba91-33403b044b22", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-267605053-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5a40e18958af4ebdb49dfbeda7bc50bc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffdfb3ed-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:15.100874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Releasing lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:15.102958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2335c65a-e8d1-4013-b88e-250f199fe170 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 202 len: 0 microversion: 2.1 time: 9.188907 Oct 04 20:41:15.106167 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 785/1597] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:05 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 0 bytes in 9193 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:41:15.125290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:15.126469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] [instance: e32ac124-8fdf-4377-8f7d-7c6a1be7643a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:15.144859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.145749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.147513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.149209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.150369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.151442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.193438 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] HTTP exception thrown: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Request method failure captured: Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a HTTP/1.1 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJkYkPTi-DzkBhzOPEGg1iTOJrdl-26U5dh2n5F1pj7_gb8jPI9oE85ZtiY5Lj_KGiH0U9G-lJURMjf82C5m-589xlGjC71pQ2cBu-hH7EQ7CMpxjjigOX1s5U8Pi-PV7sccSybxUT8DMDXKQw0Iem7nTM1WrZYjBkxqneAe2mtbrf4 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 07d97bc82450455982de0d09d2448851 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:41:15.209494 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07d97bc82450455982de0d09d2448851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07d97bc82450455982de0d09d2448851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07d97bc82450455982de0d09d2448851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07d97bc82450455982de0d09d2448851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 07d97bc82450455982de0d09d2448851 Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-621871276 Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListImageFiltersTestJSON-621871276-project Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 51c24c1c94784ab88d7f9b31c26682b5 Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListImageFiltersTestJSON-621871276-project Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. Oct 04 20:41:15.212915 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e32ac124-8fdf-4377-8f7d-7c6a1be7643a'} Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:15.216834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. Oct 04 20:41:15.220347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:41:15.227897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Returning 404 to user: Instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:15.227897 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-809edc4f-afbd-4d3a-a92b-595d027897f5 tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a" status: 404 len: 111 microversion: 2.1 time: 0.103349 Oct 04 20:41:15.227897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 786/1598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:15 2022] GET /compute/v2.1/servers/e32ac124-8fdf-4377-8f7d-7c6a1be7643a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:15.230833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:15.232049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:15.245991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.247295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.248104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.250068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.250963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.251797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:16.094905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Building network info cache for instance {{(pid=123541) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:16.533399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e86c7604-32ab-40b3-b901-a7cbebdbd3b1 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1859 microversion: 2.1 time: 1.316041 Oct 04 20:41:16.535520 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 787/1599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:15 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1859 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:16.545113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:16.547055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:16.563434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:16.565243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:16.566364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:16.568212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:16.570903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:16.573431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:17.178133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:17.194510 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8a125456-33b4-47b4-bab0-ddb3e6341d8d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1394 microversion: 2.1 time: 0.656781 Oct 04 20:41:17.196087 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 788/1600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:16 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1394 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:17.236120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4a828-6650-409d-a2e2-45eaf7944a05", "tag": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:17.260459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:17.261307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:17.263216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:17.291314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] Creating event network-changed:ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 for instance a3a4a828-6650-409d-a2e2-45eaf7944a05 on n-h2-851029-13 Oct 04 20:41:17.303696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ef6181bf-ddfc-4379-a8e7-fcbbe226c3f3 req-c16f2ffc-b2c7-41d8-89d5-defa835b2b9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086250 Oct 04 20:41:17.304979 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 789/1601] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:17.330185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:17.332780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:17.369217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:17.370182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:17.371034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:17.372355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:17.373416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:17.374189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:17.895303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:17.933196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:17.937179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:17.939644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a966a41e-470d-40cb-82d6-28eeeffb466b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1812 microversion: 2.25 time: 0.622929 Oct 04 20:41:17.940532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 790/1602] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:17 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1812 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:17.950498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ac124-8fdf-4377-8f7d-7c6a1be7643a", "name": "network-vif-deleted", "tag": "178838b7-f940-4e61-b1fb-98e9da9d0d96"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:17.971000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:17.972056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:17.972906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:17.999823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] Creating event network-vif-deleted:178838b7-f940-4e61-b1fb-98e9da9d0d96 for instance e32ac124-8fdf-4377-8f7d-7c6a1be7643a on n-h2-851029-13 Oct 04 20:41:18.009387 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d4cc823d-2c26-4a93-9627-1c2cb1d6b44a req-063d5f7c-2fd1-4145-a03d-dc16e0afff14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065668 Oct 04 20:41:18.009897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 791/1603] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:18.018535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74841450-cc9f-4202-9fa8-eef287d1bc60", "name": "network-vif-plugged", "status": "completed", "tag": "40437564-269a-4f42-8092-49d30013af85"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:18.038370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:18.038370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:18.038782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:18.063774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] Creating event network-vif-plugged:40437564-269a-4f42-8092-49d30013af85 for instance 74841450-cc9f-4202-9fa8-eef287d1bc60 on n-h2-851029-13 Oct 04 20:41:18.076748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-092d3c10-8047-44c1-add5-1598ac2e32a3 req-c9fcc574-a45a-4731-8c8a-e51612a481dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064627 Oct 04 20:41:18.077765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 792/1604] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:18.095332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Updating instance_info_cache with network_info: [{"id": "a0951431-2d06-4411-95e7-4a3558816f15", "address": "fa:16:3e:ed:1a:5f", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0951431-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123541) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:18.099095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-811a8875-1653-4443-97d9-13c63537dd31 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'create', calling method: .version_select at 0x7f54f61ac820>, body: {"pool": "225389d0-e589-4bcf-8210-aff3365ff792"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:18.128070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:18.260396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Releasing lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:18.262817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86bd30aa-589f-4d00-8568-9e19ce0183be tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action" status: 202 len: 0 microversion: 2.1 time: 8.270710 Oct 04 20:41:18.269173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 813/1605] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:09 2022] POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action => generated 0 bytes in 8283 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:41:18.283731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a84d0ba1-8e09-4f87-8440-1f260b50818f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f63ae310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:19.821136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a84d0ba1-8e09-4f87-8440-1f260b50818f tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5" status: 204 len: 0 microversion: 2.1 time: 1.548263 Oct 04 20:41:19.825418 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 814/1606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:18 2022] DELETE /compute/v2.1/images/a968be67-f3bc-449d-afd3-3e0b1e4826d5 => generated 0 bytes in 1551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:20.072999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-487161305", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:20.169950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:21.111522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:21.112929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:21.114199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:21.115642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:21.117122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:21.141976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:21.142962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:21.146649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:21.146649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:21.147529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:21.149075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:21.193813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Getting quotas for project c6e860fd94e64334b3dfc2387ba40b15. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:21.205533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Getting quotas for user e68659d5f8ac4a87995428261eee3b8f and project c6e860fd94e64334b3dfc2387ba40b15. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:21.231039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:21.235442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:21.415492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c53436d-5bdf-4393-8dd7-b69e8c2ea9e6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588386 Oct 04 20:41:21.416670 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 815/1607] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:41:21.549714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2020243444", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:21.658060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:22.284389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:22.286184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:22.287207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:22.294866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:22.294866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:22.300686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-811a8875-1653-4443-97d9-13c63537dd31 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.212752 Oct 04 20:41:22.306985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 793/1608] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:22.311979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.314453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.315018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:22.316570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.316859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:22.318933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.319946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.320732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.331098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:22.335496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.336499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.337673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.339538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.340753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.341483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.363282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Getting quotas for project 0eab8aee5f8246e0b591c79fa04e589b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:22.374888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Getting quotas for user e89a0d119d08451a9cda88ec4a20c557 and project 0eab8aee5f8246e0b591c79fa04e589b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:22.405175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:22.410011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:22.593167 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8191f80e-1ef3-4db2-baed-7b4cbc318afe tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174483 Oct 04 20:41:22.611297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 816/1609] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:41:22.621457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:22.623233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:22.627270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-caace478-3e50-4bef-a50f-8aafc8bb0030 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1859 microversion: 2.1 time: 0.322122 Oct 04 20:41:22.628259 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 794/1610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:22 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1859 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:22.637829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.102"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:22.642771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:22.653995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.656460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.657292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.658351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.658587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.660186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.660430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.661318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.662400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.662946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.664205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.674889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.761473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:22.762819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquired lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:23.197804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:23.222254 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d175a673-f89d-4c82-91ce-d729f4627e43 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1574 microversion: 2.1 time: 0.620360 Oct 04 20:41:23.225908 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 817/1611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:22 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1574 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:23.237081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:23.258455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:23.258455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.258455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.258455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.260424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.260424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.260424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.828522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:23.840927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:23.844808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:23.847228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47da27e6-0a8c-46f8-b4ae-d48b5e240086 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1802 microversion: 2.25 time: 0.618636 Oct 04 20:41:23.848254 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 818/1612] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:23 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1802 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:23.856866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:23.880775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.882066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.883270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.906418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] Creating event network-changed:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:41:23.917726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cfebfec3-df5d-4ef6-a4e2-061b2b1894c5 req-c99edead-df1b-4675-99f8-2aaff63548a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066854 Oct 04 20:41:23.919261 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 819/1613] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:23.930403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b96deb2-2a4b-4a26-876e-7a79f2b7827a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f60be940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:25.004705 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b96deb2-2a4b-4a26-876e-7a79f2b7827a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f" status: 204 len: 0 microversion: 2.1 time: 1.080964 Oct 04 20:41:25.009759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 820/1614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:23 2022] DELETE /compute/v2.1/images/cf6e3015-c6f2-4d6c-9501-4bee3c90f58f => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:25.023471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:25.026066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:25.047177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.049034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.050989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.053587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.056896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.058688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.210782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:25.226691 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-265af719-3704-4651-9ea2-47628853dcf0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1217 microversion: 2.1 time: 0.212537 Oct 04 20:41:25.228148 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 821/1615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:25 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:25.238194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.23"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:25.245560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:25.261999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.261999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.263219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.265372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.266791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.268373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.344153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:25.345382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquired lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:26.599291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792.", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:41:26.602785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Releasing lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:26.604375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.604375 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Request method failure captured: Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action HTTP/1.1 Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 45 Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJo3SeWWJwhw3lOcyIjwppfku371VwSwkoEe3MVSP_sH2LTccMqkaufuuWkPWrr8LPz7_LBxRL8zXQQ3tdNYeJnXOBojz2gOjE3LP5mE7m9juL51NjU3z9R8XEl9NxpRQ5DqD7pY76JKxl52-AtvUeMP6dJSr-Vn4X-hNPvesuLj8sg Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:26.616658 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f9db85dc2fa94539bad50a4996d5b910 Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: {"addFloatingIp": {"address": "172.25.6.23"}} Oct 04 20:41:26.621050 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a3a4a828-6650-409d-a2e2-45eaf7944a05', 'body': {'addFloatingIp': {'address': '172.25.6.23'}}} Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.623775 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:41:26.627681 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.635152 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.637912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Returning 400 to user: Cannot associate floating IP 172.25.6.23 (d8e0b374-dedb-4c2d-9288-8957273333df) with port ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 225389d0-e589-4bcf-8210-aff3365ff792. Oct 04 20:41:26.640100 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-55dce537-ed65-48b2-aada-36c5bfe9f371'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:26.642049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a06c61f4-4249-4dda-ab1b-8325af1dcf60 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 400 len: 380 microversion: 2.1 time: 1.402140 Oct 04 20:41:26.642049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 822/1616] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:25 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 380 bytes in 1405 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:41:26.645920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:26.646940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:26.656478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.657203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.657805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:26.659153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.659877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.660446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:26.796616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:26.818343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e08859f9-e600-46cc-91cd-f93c10c97d27 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1275 microversion: 2.1 time: 0.181662 Oct 04 20:41:26.819509 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 823/1617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:26 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:26.830374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:26.831810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:26.854974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.856485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.858692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:26.860302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.861439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.862489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:27.279631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lazy-loading 'services' on Instance uuid 091134c5-522b-43bf-969e-84f525b93ee0 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:27.840821 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6e2dc71-c73f-4102-99eb-67c5a76d8b35 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments/0422c951-c614-4e78-b356-73b150405154" status: 202 len: 0 microversion: 2.1 time: 1.008305 Oct 04 20:41:27.849031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 824/1618] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 20:41:26 2022] DELETE /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments/0422c951-c614-4e78-b356-73b150405154 => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:27.873633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:27.875696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:27.891451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:27.892855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:27.894237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:27.895953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:27.897239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:27.898439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:28.219223 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.neutron [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] re-assign floating IP 172.25.6.102 from instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf Oct 04 20:41:28.299157 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d772b0c-9ddb-4e55-859b-7e5cd464910b tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.443509 Oct 04 20:41:28.317298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 825/1619] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:41:27 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60/os-interface => generated 284 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:28.328392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d12ca81-4a69-40ef-b02d-b904c2a3708d tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '.version_select at 0x7f54f61e6670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:28.334974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:28.337662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d12ca81-4a69-40ef-b02d-b904c2a3708d tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:28.339287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d12ca81-4a69-40ef-b02d-b904c2a3708d tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:28.340703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d12ca81-4a69-40ef-b02d-b904c2a3708d tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:28.342483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:28.395499 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d12ca81-4a69-40ef-b02d-b904c2a3708d tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2561 microversion: 2.25 time: 0.074907 Oct 04 20:41:28.397612 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 826/1620] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 4 20:41:28 2022] GET /compute/v2.1/os-migrations => generated 2561 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:28.426322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-077d0809-9e97-45cd-b377-a671937a7f3a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] Calling method '.version_select at 0x7f54f62bde50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:29.880651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-077d0809-9e97-45cd-b377-a671937a7f3a tempest-ListImageFiltersTestJSON-621871276 tempest-ListImageFiltersTestJSON-621871276-project] 10.222.0.36 "DELETE /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd" status: 204 len: 0 microversion: 2.1 time: 1.480228 Oct 04 20:41:29.881762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 827/1621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:28 2022] DELETE /compute/v2.1/images/f1f5e094-229c-462e-9ce8-9c455516cecd => generated 0 bytes in 1483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:29.910998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:29.912324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:29.957129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.958062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.963244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:29.969206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.973713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.975349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:31.446990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:31.494578 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b4a2c65-a5bb-42d9-bab9-d6ed767e4b75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1321 microversion: 2.1 time: 1.610066 Oct 04 20:41:31.501854 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 828/1622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:29 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1321 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:31.534241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-124f15c8-edc8-47d5-a631-0f6b2b8a41e6 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '.version_select at 0x7f54f611f0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:31.939654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Updating instance_info_cache with network_info: [{"id": "a0951431-2d06-4411-95e7-4a3558816f15", "address": "fa:16:3e:ed:1a:5f", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0951431-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:32.118308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:32.343677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:32.391571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:32.757295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:36.028728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Updating instance_info_cache with network_info: [{"id": "63d7e9d4-043c-43c3-8b9f-51eab3638c74", "address": "fa:16:3e:0c:e7:30", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap63d7e9d4-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:36.142241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Releasing lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:36.145049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85fe395b-1485-455d-a79b-441925fd96e1 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a/action" status: 202 len: 0 microversion: 2.1 time: 13.514567 Oct 04 20:41:36.147911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 795/1623] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:22 2022] POST /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a/action => generated 0 bytes in 13519 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:41:36.462448 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-124f15c8-edc8-47d5-a631-0f6b2b8a41e6 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/d8e0b374-dedb-4c2d-9288-8957273333df" status: 202 len: 0 microversion: 2.1 time: 4.958644 Oct 04 20:41:36.469701 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 829/1624] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:31 2022] DELETE /compute/v2.1/os-floating-ips/d8e0b374-dedb-4c2d-9288-8957273333df => generated 0 bytes in 4963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:36.513601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:36.515268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:36.539917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:36.542434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:36.545298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:36.552741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:36.554094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:36.556410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:36.959484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:36.980654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19bbf89-30ae-4f07-973e-65785436661a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1323 microversion: 2.1 time: 0.512892 Oct 04 20:41:36.982405 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 830/1625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:36 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:36.995253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:37.001116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:37.011103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:37.017322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.018612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.019700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.022049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.023716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.024880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.049719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.050820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.059799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.103968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79c709be-c945-4de3-ac66-f40aeb1aa4f4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117654 Oct 04 20:41:37.106027 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 831/1626] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:36 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:37.106738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] Creating event network-changed:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:41:37.133862 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-79a187d6-4f4a-4b1b-86a3-878429396c2f req-04f53fcd-d74b-42aa-b53a-8ac62ef475dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.982899 Oct 04 20:41:37.135754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 796/1627] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:37.148316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:37.153529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:37.154709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:37.163929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:37.182412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.184338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.186975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.187229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.187692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.189062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.190821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.192526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.193342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.194852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.195714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.196498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.665865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:37.678972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:37.688700 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ea12912-4749-4279-8804-66cea7ce79f6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1321 microversion: 2.1 time: 0.550296 Oct 04 20:41:37.690581 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 797/1628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:37 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:37.700297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:37.702073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:37.735073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.735869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.736719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.738281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.740294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.741207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.749661 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbabea75-e805-4176-b66d-1833469fd32c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 2422 microversion: 2.25 time: 0.641074 Oct 04 20:41:37.752433 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 832/1629] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:37 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 2422 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:37.943810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5266e87f-41f1-4e9d-9d34-fb2b569d08c9", "tag": "f6732cd1-8009-4cee-bebd-aadfe464a055"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:37.990929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.990929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.991390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.048361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] Creating event network-changed:f6732cd1-8009-4cee-bebd-aadfe464a055 for instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 on n-h2-851029-13 Oct 04 20:41:38.059927 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cd7653c0-6a78-416a-be20-47462209ba0e req-deb50531-1690-4a35-a901-6f82349481cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305689 Oct 04 20:41:38.061633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 833/1630] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:38.072630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: .version_select at 0x7f54f7faaca0>, body: {"removeFloatingIp": {"address": "172.25.6.102"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:38.223140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:38.259324 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe67f010-a911-4a3c-b314-e3e9e944e29a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1574 microversion: 2.1 time: 0.555091 Oct 04 20:41:38.260172 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 798/1631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:37 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1574 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:38.293887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: .version_select at 0x7f54f7f5d4c0>, body: {"removeFloatingIp": {"address": "172.25.6.89"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:38.483565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:38.524998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.528086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.532932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.538251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.539222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.540613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.677190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:38.706027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.707372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.708246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.710120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.711166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.715060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.969680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] HTTP exception thrown: Floating IP 172.25.6.102 is not associated with instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf. Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Request method failure captured: Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action HTTP/1.1 Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 49 Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJoLuVj0MMDEDg3H99ZBKRQonne9F2qheh3ht0c_E_yaNyEPXb8gEort4uBm7kSAPlC-pLYLikTO997emEjs12dmX5d6FaeH05SzgRF0Y5pcVd_7yvZqJDgE999lmSb90Nqop1nzjB3jd7Z7cIe0810YYB9HLWCVVBc8JOAoTUaFRXc Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:39.973618 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 174a016af11c4609af9410fa95ff16d4 Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: {"removeFloatingIp": {"address": "172.25.6.102"}} Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:41:39.976993 n-d-851029-13 devstack@n-api.service[123541]: exception: Floating IP 172.25.6.102 is not associated with instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf. Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'eabdc6d9-69e4-4273-970b-c4bbbc714bbf', 'body': {'removeFloatingIp': {'address': '172.25.6.102'}}} Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.102 is not associated with instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf. Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:39.980381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.102 is not associated with instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf. Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Returning 409 to user: Floating IP 172.25.6.102 is not associated with instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:39.983733 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3c0cb25-e4c5-4799-928c-95194b70d627 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action" status: 409 len: 146 microversion: 2.1 time: 1.915878 Oct 04 20:41:39.992687 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 834/1632] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:38 2022] POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action => generated 146 bytes in 1930 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:41:40.002734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.004271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:40.018808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.022984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.022984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.022984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.023743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.025263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.125142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:40.126860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquired lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:40.621568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:40.673794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32ce3af2-ad0f-4ac5-aca5-fd4c05ecacba tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 2422 microversion: 2.25 time: 0.678529 Oct 04 20:41:40.679991 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 835/1633] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:39 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 2422 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:40.700350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.702912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:40.713354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:40.725199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.726400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.729168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.731875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.733196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.734427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.306281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:41.323008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a20ea9a-b69e-4648-a113-732454a5c51f tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1323 microversion: 2.1 time: 0.638842 Oct 04 20:41:41.324124 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 836/1634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:40 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1323 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:41.350935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:41.350935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:41.353517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.354921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.355898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.357668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.358583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.359477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.399958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:41.428666 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae4c9488-3213-4aed-979e-382dffaa8c14 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102528 Oct 04 20:41:41.429996 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 837/1635] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:41 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:41:41.441581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:41.442885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:41.455148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.456093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.456918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.458315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:41.459194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:41.459980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.035848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:42.088930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-207eeec4-5748-4065-bc1f-2e923e3d6ddf tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1321 microversion: 2.1 time: 0.655761 Oct 04 20:41:42.097932 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 838/1636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:41 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1321 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:42.122540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541dc842-3d80-4824-ade1-014cd5281a5a", "tag": "63d7e9d4-043c-43c3-8b9f-51eab3638c74"}, {"name": "network-changed", "server_uuid": "74841450-cc9f-4202-9fa8-eef287d1bc60", "tag": "40437564-269a-4f42-8092-49d30013af85"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:42.147479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.148245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.149004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.185639 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Creating event network-changed:63d7e9d4-043c-43c3-8b9f-51eab3638c74 for instance 541dc842-3d80-4824-ade1-014cd5281a5a on n-h1-851029-13 Oct 04 20:41:42.186543 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] Creating event network-changed:40437564-269a-4f42-8092-49d30013af85 for instance 74841450-cc9f-4202-9fa8-eef287d1bc60 on n-h2-851029-13 Oct 04 20:41:42.218129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-686d2b80-e5ad-4d89-a87f-14ce805249dc req-bfa79e4f-973c-429a-8c1c-ec2635b42d61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117676 Oct 04 20:41:42.219653 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 839/1637] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:42.253486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.102"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:42.811490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:42.825502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.826633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.828514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.830044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.831182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.832133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.916574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:44.322897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:44.326611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquired lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:46.940449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Updating instance_info_cache with network_info: [{"id": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01", "address": "fa:16:3e:8f:6a:00", "network": {"id": "1dd8cc8f-b05d-4a0f-ba91-33403b044b22", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-267605053-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5a40e18958af4ebdb49dfbeda7bc50bc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffdfb3ed-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:47.081406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Releasing lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:47.087857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2d530f6-faec-436d-af99-c42d8fee1240 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 202 len: 0 microversion: 2.1 time: 8.822259 Oct 04 20:41:47.094280 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 799/1638] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:38 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 0 bytes in 8831 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:41:47.108349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d41ddfd1-4ed6-4a64-9772-63d8e4a92adc", "tag": "2a51389f-3c8c-4b18-965a-bb8feb43bd81"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:47.130610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.132012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.133706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.200266 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] Creating event network-changed:2a51389f-3c8c-4b18-965a-bb8feb43bd81 for instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc on n-h2-851029-13 Oct 04 20:41:47.214002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-178613b9-2980-4515-a0b5-02cc064db676 req-193ff841-84eb-4ec6-94bc-ed9f0253e81a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118547 Oct 04 20:41:47.225190 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 800/1639] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:47.240570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.242429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:47.264926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.266291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.267138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.274863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.274863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.274863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.862370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lazy-loading 'services' on Instance uuid a7abbef5-41aa-40aa-81f8-07b2c73c27be {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:48.363799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e91e4263-5ed7-41c7-9b91-ed6d8ff545d3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments/02469548-4738-4fb9-b254-4ec697edb7ac" status: 202 len: 0 microversion: 2.25 time: 1.129038 Oct 04 20:41:48.366109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 801/1640] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 4 20:41:47 2022] DELETE /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments/02469548-4738-4fb9-b254-4ec697edb7ac => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:48.388734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:48.392767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:48.414902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.433211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.433211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.433211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.433211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.434101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.229837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Building network info cache for instance {{(pid=123541) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:41:49.271058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:49.290430 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28ec81bc-5fd9-4545-ac29-75ccbd23cca0 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1323 microversion: 2.1 time: 0.921382 Oct 04 20:41:49.303134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 802/1641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:48 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:49.306287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:49.318854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:49.330473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.331425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.332255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.333666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.335020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.340822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.161986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:50.227055 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f98fc07d-546a-4496-8bc6-48646ed2a33b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1321 microversion: 2.1 time: 0.932467 Oct 04 20:41:50.235082 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 803/1642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:49 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1321 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:50.255780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4a828-6650-409d-a2e2-45eaf7944a05", "tag": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:50.276121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.277064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.277819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.300865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] Creating event network-changed:ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 for instance a3a4a828-6650-409d-a2e2-45eaf7944a05 on n-h2-851029-13 Oct 04 20:41:50.311242 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b1b16b71-9188-41b1-8a7b-4c0c4572bcf2 req-54acc973-f93d-453d-83ac-783e236b037d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073855 Oct 04 20:41:50.312458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 804/1643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:50.575996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5266e87f-41f1-4e9d-9d34-fb2b569d08c9", "name": "network-vif-plugged", "status": "completed", "tag": "f6732cd1-8009-4cee-bebd-aadfe464a055"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:50.647194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.648189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.648939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.724483 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] Creating event network-vif-plugged:f6732cd1-8009-4cee-bebd-aadfe464a055 for instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 on n-h2-851029-13 Oct 04 20:41:50.756014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a5c09a24-ea2f-436f-b8ad-1c54b6ef7d77 req-24dc6725-a700-4c4f-9af4-04e165faf968 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440739 Oct 04 20:41:50.767145 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 805/1644] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:50.790968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b866fb48-6dd1-425c-8f3a-b430e40c7260 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '.version_select at 0x7f54f61e5670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:52.823898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:53.280774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Updating instance_info_cache with network_info: [{"id": "63d7e9d4-043c-43c3-8b9f-51eab3638c74", "address": "fa:16:3e:0c:e7:30", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap63d7e9d4-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123541) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:41:53.433147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Releasing lock "refresh_cache-541dc842-3d80-4824-ade1-014cd5281a5a" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:53.435207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64e716a6-67ab-4522-87bf-e9de16926d50 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a/action" status: 202 len: 0 microversion: 2.1 time: 11.212837 Oct 04 20:41:53.436266 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 840/1645] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:42 2022] POST /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a/action => generated 0 bytes in 11216 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:41:53.461081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.471508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:53.486433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.487793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.490200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.492095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.493429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.494527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.635604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e1fd1fc-af6a-43cc-b296-d2489c0c2b4b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.196702 Oct 04 20:41:53.649979 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 841/1646] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:41:53.663311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.665178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:53.704162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.706382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.709656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.711280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.713684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.715396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.516824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:54.535810 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fff9a1c1-7d8c-4755-b3ed-85451832744a tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1323 microversion: 2.1 time: 0.883514 Oct 04 20:41:54.563620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 842/1647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1323 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:54.578560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:54.580148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:54.597204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.598602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.599846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.606694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.609543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.610936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.941002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b866fb48-6dd1-425c-8f3a-b430e40c7260 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/f5c93d84-3e35-4b37-aac5-1c1f1024adb9" status: 202 len: 0 microversion: 2.1 time: 4.168554 Oct 04 20:41:54.942897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 806/1648] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:50 2022] DELETE /compute/v2.1/os-floating-ips/f5c93d84-3e35-4b37-aac5-1c1f1024adb9 => generated 0 bytes in 4173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:54.957390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541dc842-3d80-4824-ade1-014cd5281a5a", "tag": "63d7e9d4-043c-43c3-8b9f-51eab3638c74"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:54.992008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.993949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.995631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.038990 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] Creating event network-changed:63d7e9d4-043c-43c3-8b9f-51eab3638c74 for instance 541dc842-3d80-4824-ade1-014cd5281a5a on n-h1-851029-13 Oct 04 20:41:55.069187 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e436d8d8-ef08-44ae-a708-3f462b94f214 req-0afc9db8-2eb7-410f-b849-736727a836f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124066 Oct 04 20:41:55.071226 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 807/1649] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:55.082041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41ddfd1-4ed6-4a64-9772-63d8e4a92adc", "name": "network-vif-plugged", "status": "completed", "tag": "2a51389f-3c8c-4b18-965a-bb8feb43bd81"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:55.111507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.112875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.115416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.148349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] Creating event network-vif-plugged:2a51389f-3c8c-4b18-965a-bb8feb43bd81 for instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc on n-h2-851029-13 Oct 04 20:41:55.162552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7134a027-4b92-4fae-99d6-36aef250744a req-dc1ffa0e-dc26-4957-8536-182c980e9f96 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085663 Oct 04 20:41:55.168785 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 808/1650] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:55.196630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:55.198211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:55.240536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.245684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.249832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.259118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.260688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.262562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.302349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:55.353584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:55.360644 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa96ef34-097a-4b4c-8813-db7cac3e87da tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1470 microversion: 2.1 time: 0.785207 Oct 04 20:41:55.362220 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 843/1651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:54 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1470 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:55.408682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:55.414138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:55.445057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.446701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.447697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.453112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.455711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.462002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.578389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e0e9e3f-7167-4e8b-b914-61d7ad046fa6 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.200950 Oct 04 20:41:55.584660 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 844/1652] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:41:55 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6637121-3e7d-4751-b193-3f714bd33473 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6637121-3e7d-4751-b193-3f714bd33473 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Request method failure captured: Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action HTTP/1.1 Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 34 Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJo3SeWWJwhw3lOcyIjwppfku371VwSwkoEe3MVSP_sH2LTccMqkaufuuWkPWrr8LPz7_LBxRL8zXQQ3tdNYeJnXOBojz2gOjE3LP5mE7m9juL51NjU3z9R8XEl9NxpRQ5DqD7pY76JKxl52-AtvUeMP6dJSr-Vn4X-hNPvesuLj8sg Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:55.622022 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f9db85dc2fa94539bad50a4996d5b910 Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: {"addFloatingIp": {"address": ""}} Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:41:55.626040 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a3a4a828-6650-409d-a2e2-45eaf7944a05', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '' Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:55.632417 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:41:55.646763 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:41:55.651847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:41:55.651847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:55.651847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6637121-3e7d-4751-b193-3f714bd33473 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:55.651847 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6637121-3e7d-4751-b193-3f714bd33473 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 400 len: 142 microversion: 2.1 time: 0.034046 Oct 04 20:41:55.651847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 845/1653] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:55 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 142 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:41:56.058460 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ea8d4e3-2142-4603-b5f3-e261050bf74b tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 204 len: 0 microversion: 2.1 time: 0.883129 Oct 04 20:41:56.069810 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 809/1654] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:55 2022] DELETE /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:56.092944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:56.101777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.122462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:56.127543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] [instance: 80a9db8f-3bda-4bf5-b286-2d191fa1c882] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.139276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.144594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.149438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.150867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.152000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.155209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.184654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] HTTP exception thrown: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Request method failure captured: Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/80a9db8f-3bda-4bf5-b286-2d191fa1c882/action HTTP/1.1 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpryDaRPyAtv1ZpL2QxyxSa0bpnBc2O4W3LtJU6DiNK7BnyE47s0CjwuN9vEu5zXYjVqqVBo-H9o43OGIgM7-3EyZDo2ZODZPp8PlsGyP2s3t8SkpxjBwVng1Q5bZtR7K6qYq47oE1CGzirSzC57bXtCSLh6CdONTA_YSupQ6UrKnA Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:41:56.189231 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: c4042ff4dbe8459398adfca5c619611e Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: {"migrate": {}} Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:41:56.191947 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '80a9db8f-3bda-4bf5-b286-2d191fa1c882', 'body': {'migrate': {}}} Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:56.193289 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. Oct 04 20:41:56.195584 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.198194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Returning 404 to user: Instance 80a9db8f-3bda-4bf5-b286-2d191fa1c882 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:56.201709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8eab6e63-3d1f-4b86-b85e-06cd1e8064db tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/80a9db8f-3bda-4bf5-b286-2d191fa1c882/action" status: 404 len: 111 microversion: 2.1 time: 0.568522 Oct 04 20:41:56.207132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 846/1655] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:55 2022] POST /compute/v2.1/servers/80a9db8f-3bda-4bf5-b286-2d191fa1c882/action => generated 111 bytes in 578 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:56.251840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:56.257612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.283264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.284881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.286470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.288356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.289753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.290969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.347398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:56.352709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquired lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:56.734729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:56.762623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-908da5c4-e673-40f8-b8a4-5cec1c95db25 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1323 microversion: 2.1 time: 0.690127 Oct 04 20:41:56.782266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 810/1656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:56 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1323 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:56.788336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.102"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:56.813557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.850072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.851036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.853920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.855133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.858086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.860085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.976679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:41:56.980341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquired lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:41:56.982212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Releasing lock "refresh_cache-a3a4a828-6650-409d-a2e2-45eaf7944a05" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:41:56.984448 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] HTTP exception thrown: floating IP not found Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Request method failure captured: Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action HTTP/1.1 Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 41 Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJo3SeWWJwhw3lOcyIjwppfku371VwSwkoEe3MVSP_sH2LTccMqkaufuuWkPWrr8LPz7_LBxRL8zXQQ3tdNYeJnXOBojz2gOjE3LP5mE7m9juL51NjU3z9R8XEl9NxpRQ5DqD7pY76JKxl52-AtvUeMP6dJSr-Vn4X-hNPvesuLj8sg Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:41:56.988229 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f9db85dc2fa94539bad50a4996d5b910 Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:41:56.991700 n-d-851029-13 devstack@n-api.service[123541]: exception: floating IP not found Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a3a4a828-6650-409d-a2e2-45eaf7944a05', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.994092 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 20:41:56.997652 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:41:57.002471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Returning 404 to user: floating IP not found {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:57.002471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30d2937c-a6ad-469c-9eba-a98dea3151d0 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 404 len: 67 microversion: 2.1 time: 0.790023 Oct 04 20:41:57.011238 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 847/1657] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:56 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 67 bytes in 796 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:41:57.068469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.068469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:57.068469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Searching by: {'deleted': False, 'project_id': 'b02ad762c9524c89b51e640167845308'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:41:57.070222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.070222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.070222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.070222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.071488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.071488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.168521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:41:57.338970 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b5788d0-16a5-4793-8dd1-a149b1966d76 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.316304 Oct 04 20:41:57.340291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 848/1658] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:41:57 2022] GET /compute/v2.1/servers => generated 333 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:57.368895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.377477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:57.415371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.416669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.417568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.424126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.425028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.425815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.541265 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed6f81ac-5fd5-4eb7-b472-0701b2c3eb88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.183473 Oct 04 20:41:57.546186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 849/1659] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:41:57 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:41:57.595943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1125131633", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:57.963295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:00.554093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:00.561936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:00.563395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:00.568854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:00.573730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:00.614478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:00.615919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:00.620731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:00.628372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:00.629743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:00.631353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:00.736925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Getting quotas for project c6e860fd94e64334b3dfc2387ba40b15. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:00.790217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Getting quotas for user e68659d5f8ac4a87995428261eee3b8f and project c6e860fd94e64334b3dfc2387ba40b15. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:00.846431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:00.860123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:01.176397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-af3f01cd-f95a-451c-8f60-642ddfce7a7f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.620786 Oct 04 20:42:01.184652 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 850/1660] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:01.215509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22e548cb-7695-49ff-983c-7acba32a5c65 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:01.436721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-22e548cb-7695-49ff-983c-7acba32a5c65 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22e548cb-7695-49ff-983c-7acba32a5c65 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Request method failure captured: Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action HTTP/1.1 Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 44 Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJo3SeWWJwhw3lOcyIjwppfku371VwSwkoEe3MVSP_sH2LTccMqkaufuuWkPWrr8LPz7_LBxRL8zXQQ3tdNYeJnXOBojz2gOjE3LP5mE7m9juL51NjU3z9R8XEl9NxpRQ5DqD7pY76JKxl52-AtvUeMP6dJSr-Vn4X-hNPvesuLj8sg Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:01.439823 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f9db85dc2fa94539bad50a4996d5b910 Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:01.442842 n-d-851029-13 devstack@n-api.service[123541]: exception: Floating IP not found for address 0.0.0.0. Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a3a4a828-6650-409d-a2e2-45eaf7944a05', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:01.445747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 20:42:01.450797 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:01.458889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22e548cb-7695-49ff-983c-7acba32a5c65 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:01.458889 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22e548cb-7695-49ff-983c-7acba32a5c65 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action" status: 404 len: 88 microversion: 2.1 time: 0.255474 Oct 04 20:42:01.459503 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 851/1661] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:01 2022] POST /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05/action => generated 88 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:01.470454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:01.499157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:01.511007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Searching by: {'deleted': False, 'project_id': 'b02ad762c9524c89b51e640167845308'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:42:01.520809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.522577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.524906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:01.527304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.528555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.530394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.018227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:42:02.340775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:02.354251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.355641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.356849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.282194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-993a95a9-75a1-48bd-ae38-10976815afb9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1694 microversion: 2.1 time: 1.817960 Oct 04 20:42:03.286039 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 852/1662] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:42:01 2022] GET /compute/v2.1/servers/detail => generated 1694 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:03.314732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.316230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:03.360901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.362103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.368935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.370448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.376458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.385185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.880675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.921641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99aa6c60-a70b-4a38-a40f-c33d6627c8b7 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1472 microversion: 2.1 time: 0.633421 Oct 04 20:42:03.923980 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 853/1663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1472 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:03.950492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.960196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:03.985751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.987452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.989519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.991183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.992143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.999629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.095680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bc4b769-39ca-41ed-82c1-f03a4dbe1f80 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.167644 Oct 04 20:42:04.097498 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 854/1664] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:04.112583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.120997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:04.132799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.134455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.135085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.140861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.143229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.144286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.247189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:42:04.260549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.435884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:04.469744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81091f3e-c1e0-4189-8fb6-817726aca63f tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1226 microversion: 2.1 time: 0.370221 Oct 04 20:42:04.476000 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 855/1665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1226 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:04.640776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-58964973", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "36886eac-a0ea-4ff3-9554-bbdc3d9a0164"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:04.841954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] validate_networks() for [('36886eac-a0ea-4ff3-9554-bbdc3d9a0164', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:06.845515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:06.880166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Updating instance_info_cache with network_info: [{"id": "a0951431-2d06-4411-95e7-4a3558816f15", "address": "fa:16:3e:ed:1a:5f", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0951431-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:42:07.031716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Releasing lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:42:07.034114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a44ce05a-abdb-4bf5-94ff-f6f821a54b10 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action" status: 202 len: 0 microversion: 2.1 time: 10.249721 Oct 04 20:42:07.041196 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 811/1666] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:56 2022] POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action => generated 0 bytes in 10258 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:42:07.047431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:07.049413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:07.050597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:07.051854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:07.052831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:07.054407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.056489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:07.073003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.078934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.078934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.078934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.079664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.079664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.092406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.095195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.095979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.098704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.100733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.103965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.145924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:07.153456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Getting quotas for project 0d16464ad008493dbe85c55353afbe8a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:07.162758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Getting quotas for user 4598575bd2894e0086b165b08b85cd14 and project 0d16464ad008493dbe85c55353afbe8a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:07.259732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:07.265867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:07.554555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-421a0180-47c7-4d2c-b324-feb992661bb2 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.075703 Oct 04 20:42:07.575177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 856/1667] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:07.602508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541dc842-3d80-4824-ade1-014cd5281a5a", "name": "network-vif-deleted", "tag": "63d7e9d4-043c-43c3-8b9f-51eab3638c74"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:07.641802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.642732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.650484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.696182 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] Creating event network-vif-deleted:63d7e9d4-043c-43c3-8b9f-51eab3638c74 for instance 541dc842-3d80-4824-ade1-014cd5281a5a on n-h1-851029-13 Oct 04 20:42:07.721252 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-035dc34c-3460-4909-a50c-2313cad1f85d req-c747ed65-96a0-4de5-bfec-1a0bdf8e79e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143535 Oct 04 20:42:07.740182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 857/1668] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.804312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a58789ab-840d-4a5c-a7b6-a9620d57f62a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.847382 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4970dc28-6dcb-4fdb-85d7-f3a379b66699 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 204 len: 0 microversion: 2.1 time: 0.797962 Oct 04 20:42:07.850619 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 812/1669] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:07 2022] DELETE /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:07.860259 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a58789ab-840d-4a5c-a7b6-a9620d57f62a tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.095065 Oct 04 20:42:07.861308 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 858/1670] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.867441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.894518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.898892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:07.899770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:07.948273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.955881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.957105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.960461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:07.966582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:07.967912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:07.996685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.005514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.016591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.020684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.027587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:08.029140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.040031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.119256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Request method failure captured: Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc/diagnostics HTTP/1.1 Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJpoYkBdBIZtLCjGjQQ4SWeKU90_VSC0aWp4HsVZWkqeUvb59f29H54rkdBcxzdq745d87aowb_TvVBJ6UFmcbALmB9lm7xmptseFda662Nu9EC6aG8jEGzY74uzNjR-w9aZXwikdPji3nc4b7LI--ZAT-bEXXcQJ8-0YDOI6SHdx3M Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0eab8aee5f8246e0b591c79fa04e589b Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:42:08.130810 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0eab8aee5f8246e0b591c79fa04e589b Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerDiagnosticsNegativeTest-1177210964-project Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e89a0d119d08451a9cda88ec4a20c557 Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1177210964-project Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:42:08.134830 n-d-851029-13 devstack@n-api.service[123542]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'd41ddfd1-4ed6-4a64-9772-63d8e4a92adc'} Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:42:08.136389 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:42:08.159949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:08.163558 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-634e5ad6-5d79-4962-bf33-bfb86616b79c tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.294876 Oct 04 20:42:08.163558 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 813/1671] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc/diagnostics => generated 117 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:08.171427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5e2cfd2-505d-45ae-a276-37ea7449cd14 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '.version_select at 0x7f54f6059f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.342589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:08.391575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0ab3d30-9200-4776-8ced-bb52058515e1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1292 microversion: 2.1 time: 0.527229 Oct 04 20:42:08.393212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 859/1672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:08.441384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-309cf731-4a0d-474f-89c6-d09f709acaff tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.443009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-309cf731-4a0d-474f-89c6-d09f709acaff tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:08.684974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-309cf731-4a0d-474f-89c6-d09f709acaff tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:08.714007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-309cf731-4a0d-474f-89c6-d09f709acaff tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1215 microversion: 2.1 time: 0.304709 Oct 04 20:42:08.716349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 860/1673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:08.734177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.740451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:08.769925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.770885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.772781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.777921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.782254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.786274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.752512 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5e2cfd2-505d-45ae-a276-37ea7449cd14 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/97302521-0d38-48be-a632-892ef8bb9471" status: 200 len: 185 microversion: 2.1 time: 1.599797 Oct 04 20:42:09.754432 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 814/1674] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/os-floating-ips/97302521-0d38-48be-a632-892ef8bb9471 => generated 185 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:09.771244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:09.780512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:09.828507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:09.837254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:09.848650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.848650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:09.848650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:09.851580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.972748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:10.001275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:10.033491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf455477-e306-4dee-ae81-a4f1ee359938 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1541 microversion: 2.1 time: 1.314745 Oct 04 20:42:10.039673 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 861/1675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1541 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:10.051114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:10.053253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:10.119440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.120032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.122291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.126601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.128913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.131510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.285063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:10.849821 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7faf5cf-79ed-4f89-a4cf-4bdd17429392 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 204 len: 0 microversion: 2.1 time: 1.088341 Oct 04 20:42:10.861785 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 815/1676] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:09 2022] DELETE /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:10.924197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:10.928946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:10.983894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.984499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.985695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.986924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.987780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.988529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.528584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:11.531323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b8145ff0-d907-42db-938c-73d48eea4c98 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 204 len: 0 microversion: 2.1 time: 1.485961 Oct 04 20:42:11.533540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 862/1677] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:10 2022] DELETE /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 0 bytes in 1490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:11.578842 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98990089-e898-4224-bf7a-e7b5b0c6e904 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 0.698208 Oct 04 20:42:11.586919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:11.589553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:11.605089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.605851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 816/1678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:10 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:11.607173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.609756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.614018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.621146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.622587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.660735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.102"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:11.924370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:11.964440 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-636d865b-0d37-4a8f-9615-a9bfa68ef145 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1219 microversion: 2.1 time: 0.424656 Oct 04 20:42:11.970490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 863/1679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:11 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1219 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:12.027742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:12.084300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.084694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.096676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.136034 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] Creating event network-changed:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:42:12.146449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1057ef9e-3526-44bb-bdda-b626757efc16 req-90941c29-d2bf-4a9d-96ad-3146de954ad5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165775 Oct 04 20:42:12.149459 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 864/1680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:12.172125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:12.182593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:12.204569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.207801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.208984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.210707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.211626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.212901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.513565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:12.528742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.529695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.530600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.532300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.533688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.535184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.923455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:12.944826 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-083888a2-2a8f-4b9e-b919-a4969b211b06 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1478 microversion: 2.1 time: 0.791733 Oct 04 20:42:12.946541 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 865/1681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:12 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1478 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:12.956428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:12.959545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:12.973170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.974717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.975916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.977719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:12.979019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:12.980127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.159785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db85dc2fa94539bad50a4996d5b910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a40e18958af4ebdb49dfbeda7bc50bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:13.177574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7633097-1b18-4a6c-9639-a0bc7478129b tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 200 len: 1499 microversion: 2.1 time: 0.228395 Oct 04 20:42:13.191644 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 866/1682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:12 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 1499 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:13.226246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:13.228272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:13.243803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.245298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.246545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.248353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.249649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.251795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.500757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:42:13.502186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquired lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:42:15.377410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:15.393584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ebbe6a18-9b12-4d46-99fc-0cb3851a204e tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1697 microversion: 2.1 time: 2.198960 Oct 04 20:42:15.395683 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 867/1683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:13 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1697 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:15.405147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4a828-6650-409d-a2e2-45eaf7944a05", "name": "network-vif-deleted", "tag": "ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:15.425375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.427003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.428411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.457351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] Creating event network-vif-deleted:ffdfb3ed-fb05-4d6a-b5d1-6710f2422d01 for instance a3a4a828-6650-409d-a2e2-45eaf7944a05 on n-h2-851029-13 Oct 04 20:42:15.469836 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a4ae4434-8791-41da-9a43-b2b38a9de2d1 req-72e0c5bb-33b7-4721-a3e6-baf9eff15385 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071204 Oct 04 20:42:15.471914 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 868/1684] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:15.489499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:15.494835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:15.517449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.521818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.527085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.529555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.533130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.536121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:16.639987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:16.671731 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6ad6fb8-7c75-42af-95ca-a930bfe3bab8 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 1.197227 Oct 04 20:42:16.672816 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 869/1685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:15 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:16.728582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:16.729755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:16.760358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:16.761330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:16.762098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:16.767017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:16.768508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:16.773732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.118303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:17.133957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:17.156346 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb1a4649-a12d-4a8e-964b-4c03d75d7cf0 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1273 microversion: 2.1 time: 0.443295 Oct 04 20:42:17.171155 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 870/1686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:16 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:17.177625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41ddfd1-4ed6-4a64-9772-63d8e4a92adc", "name": "network-vif-unplugged", "status": "completed", "tag": "2a51389f-3c8c-4b18-965a-bb8feb43bd81"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:17.208783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:17.209746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:17.210217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.245635 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] Creating event network-vif-unplugged:2a51389f-3c8c-4b18-965a-bb8feb43bd81 for instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc on n-h2-851029-13 Oct 04 20:42:17.274014 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5f0d4fb0-336e-46c2-a8bb-a8ebff2437e6 req-aaa1fa83-1e15-4977-aab8-7eef978cfd02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109226 Oct 04 20:42:17.296530 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 871/1687] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:17.321727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:17.330806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:17.364156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:17.367301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:17.378756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.380338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:17.381260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:17.382095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.933414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89a0d119d08451a9cda88ec4a20c557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eab8aee5f8246e0b591c79fa04e589b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:17.970049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb2303a2-d269-4c73-a17a-96a1bb50569d tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 200 len: 1436 microversion: 2.1 time: 0.670171 Oct 04 20:42:17.971174 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 872/1688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:17 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 1436 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:17.989871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:17.997325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] [instance: a3a4a828-6650-409d-a2e2-45eaf7944a05] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:18.018720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:18.021887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.022860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.024192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.025589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.027048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.038948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.110424 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] HTTP exception thrown: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Request method failure captured: Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 HTTP/1.1 Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJo3SeWWJwhw3lOcyIjwppfku371VwSwkoEe3MVSP_sH2LTccMqkaufuuWkPWrr8LPz7_LBxRL8zXQQ3tdNYeJnXOBojz2gOjE3LP5mE7m9juL51NjU3z9R8XEl9NxpRQ5DqD7pY76JKxl52-AtvUeMP6dJSr-Vn4X-hNPvesuLj8sg Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:18.113601 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a40e18958af4ebdb49dfbeda7bc50bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5a40e18958af4ebdb49dfbeda7bc50bc Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438 Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f9db85dc2fa94539bad50a4996d5b910 Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:18.116818 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a3a4a828-6650-409d-a2e2-45eaf7944a05'} Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:18.118777 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. Oct 04 20:42:18.122429 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:18.126100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] Returning 404 to user: Instance a3a4a828-6650-409d-a2e2-45eaf7944a05 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:18.126100 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c38b9af-89fe-44fb-aa68-4c78c332d655 tempest-FloatingIPsAssociationNegativeTestJSON-462855438 tempest-FloatingIPsAssociationNegativeTestJSON-462855438-project] 10.222.0.36 "GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05" status: 404 len: 111 microversion: 2.1 time: 0.143263 Oct 04 20:42:18.126100 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 873/1689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:17 2022] GET /compute/v2.1/servers/a3a4a828-6650-409d-a2e2-45eaf7944a05 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:18.151941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:18.153241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:18.175449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.176254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.177039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.178388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.188362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.189160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.668255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5270bf013448dbdee85b496ff115f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ad762c9524c89b51e640167845308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:18.696443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8aaafe89-56df-4983-87a1-bb617106cac7 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 200 len: 1629 microversion: 2.1 time: 0.569448 Oct 04 20:42:18.698803 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 874/1690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:18 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 1629 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:18.712063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41ddfd1-4ed6-4a64-9772-63d8e4a92adc", "name": "network-vif-deleted", "tag": "2a51389f-3c8c-4b18-965a-bb8feb43bd81"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:18.736801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:18.741602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.751998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.751998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.772172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] Creating event network-vif-deleted:2a51389f-3c8c-4b18-965a-bb8feb43bd81 for instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc on n-h2-851029-13 Oct 04 20:42:18.784950 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ff96c746-528d-442a-b6e9-3d30776bb71a req-0f5aefe4-0701-4f6d-a20b-a91401094e9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082933 Oct 04 20:42:18.786066 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 875/1691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:18.799043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:18.802137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:18.826167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.827166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.827990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.829446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.830961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.831747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.545866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:42:21.970476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:22.003575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-675c643c-d38e-41de-a49c-e007261e4b76 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 3.214494 Oct 04 20:42:22.017526 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 876/1692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:18 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 3230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:22.043397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:22.046152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:22.076863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.080175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.083325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:22.099824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.106783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.109636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:22.528703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:22.635407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:22.661281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c1d7d28-da05-4e30-ae48-38d6cc0faab5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1273 microversion: 2.1 time: 0.636054 Oct 04 20:42:22.666609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 877/1693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:22 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1273 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:22.686320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:22.688174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] [instance: d41ddfd1-4ed6-4a64-9772-63d8e4a92adc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:22.741473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.751429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.761360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:22.763905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.765044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.765970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:22.910151 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] HTTP exception thrown: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Request method failure captured: Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc HTTP/1.1 Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpoYkBdBIZtLCjGjQQ4SWeKU90_VSC0aWp4HsVZWkqeUvb59f29H54rkdBcxzdq745d87aowb_TvVBJ6UFmcbALmB9lm7xmptseFda662Nu9EC6aG8jEGzY74uzNjR-w9aZXwikdPji3nc4b7LI--ZAT-bEXXcQJ8-0YDOI6SHdx3M Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0eab8aee5f8246e0b591c79fa04e589b Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:22.968415 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0eab8aee5f8246e0b591c79fa04e589b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0eab8aee5f8246e0b591c79fa04e589b Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1177210964 Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiagnosticsNegativeTest-1177210964-project Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e89a0d119d08451a9cda88ec4a20c557 Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1177210964-project Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. Oct 04 20:42:22.972620 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd41ddfd1-4ed6-4a64-9772-63d8e4a92adc'} Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:22.975091 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. Oct 04 20:42:22.992540 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.020273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] Returning 404 to user: Instance d41ddfd1-4ed6-4a64-9772-63d8e4a92adc could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:23.022486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c5a4779-8c7a-4262-bbe1-73a246041b58 tempest-ServerDiagnosticsNegativeTest-1177210964 tempest-ServerDiagnosticsNegativeTest-1177210964-project] 10.222.0.36 "GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc" status: 404 len: 111 microversion: 2.1 time: 0.353349 Oct 04 20:42:23.029857 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 878/1694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:22 2022] GET /compute/v2.1/servers/d41ddfd1-4ed6-4a64-9772-63d8e4a92adc => generated 111 bytes in 362 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:23.067934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}, {"name": "network-changed", "server_uuid": "0b5340ca-9c09-42d4-a621-8348dfec9894", "tag": "53cd8731-5002-48c6-9612-db1b4e47ecbb"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:23.188443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.192989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.197816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.264738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Creating event network-changed:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:42:23.272131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] Creating event network-changed:53cd8731-5002-48c6-9612-db1b4e47ecbb for instance 0b5340ca-9c09-42d4-a621-8348dfec9894 on n-h1-851029-13 Oct 04 20:42:23.312955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d1e00331-5120-4161-954b-062893334e67 req-233e7d1f-c731-4061-a759-db158c0a72bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.276072 Oct 04 20:42:23.315781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 879/1695] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:23.334976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:23.357026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] [instance: 74841450-cc9f-4202-9fa8-eef287d1bc60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:23.386174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.392631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.401266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.404138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.405180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.405898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.442172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:23.507716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] HTTP exception thrown: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Request method failure captured: Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 HTTP/1.1 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpAE5eoOxDZNY2DI1gn9_IkVXiOrM_mRX00a2pl1K5_o9Nfru4Bs4kj_S1Zd8HeCgrlUFmNHTIUIlCpI01E4lCU-dWTAMBoDlwNu-QDXQU6fwTcBw7ACcamKzlF1LqrZPpIdo8G20733pOIkfkRotsImViwFrxxCz0D5nxTN88zR64 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b02ad762c9524c89b51e640167845308 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-2120199858 Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:23.522746 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b02ad762c9524c89b51e640167845308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b02ad762c9524c89b51e640167845308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b02ad762c9524c89b51e640167845308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b02ad762c9524c89b51e640167845308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-2120199858 Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b02ad762c9524c89b51e640167845308 Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-2120199858 Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-2120199858-project Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 37a5270bf013448dbdee85b496ff115f Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-2120199858-project Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. Oct 04 20:42:23.527699 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '74841450-cc9f-4202-9fa8-eef287d1bc60'} Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:23.529395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. Oct 04 20:42:23.531981 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:23.536873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Returning 404 to user: Instance 74841450-cc9f-4202-9fa8-eef287d1bc60 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:23.543228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1583580a-0f3f-4442-81e8-3f51156690f9 tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60" status: 404 len: 111 microversion: 2.1 time: 0.224609 Oct 04 20:42:23.555348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 880/1696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:23 2022] GET /compute/v2.1/servers/74841450-cc9f-4202-9fa8-eef287d1bc60 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:23.599549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74841450-cc9f-4202-9fa8-eef287d1bc60", "name": "network-vif-deleted", "tag": "40437564-269a-4f42-8092-49d30013af85"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:23.657317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.662365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.665264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.730922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] Creating event network-vif-deleted:40437564-269a-4f42-8092-49d30013af85 for instance 74841450-cc9f-4202-9fa8-eef287d1bc60 on n-h2-851029-13 Oct 04 20:42:23.742456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-20c5d837-6574-414d-a95f-3a84d8963a2d req-e24b8b55-fe8d-4eaa-a8ce-98f406b8f7b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184093 Oct 04 20:42:23.743475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 881/1697] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:23.755566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:23.759243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:23.776761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.781813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.783921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.789829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.791500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.792972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:25.270143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:25.285298 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2ab4374-e5ba-40a8-9a59-b07527b63d18 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 1.539847 Oct 04 20:42:25.287504 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 882/1698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:23 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:25.301911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b8e9765-48e7-4c53-9018-210e1aae004d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] Calling method '.version_select at 0x7f54f5f4cdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:26.053132 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b8e9765-48e7-4c53-9018-210e1aae004d tempest-ServersTestJSON-2120199858 tempest-ServersTestJSON-2120199858-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558909897" status: 202 len: 0 microversion: 2.1 time: 0.763115 Oct 04 20:42:26.054557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 883/1699] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:42:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558909897 => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:42:26.100456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:26.102356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:26.166803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.167834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.168499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.169737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.193083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.194177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:27.526795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Updating instance_info_cache with network_info: [{"id": "a0951431-2d06-4411-95e7-4a3558816f15", "address": "fa:16:3e:ed:1a:5f", "network": {"id": "eaa81373-5c68-4ae7-accb-762c1b6d583f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2123037337-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5183c91fd7184d16a0cb7d7e364c317d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0951431-2d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:42:27.655288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Releasing lock "refresh_cache-eabdc6d9-69e4-4273-970b-c4bbbc714bbf" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:42:27.657183 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57d136eb-3188-4b18-a2d3-0c9a25b3ef0f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action" status: 202 len: 0 microversion: 2.1 time: 16.021633 Oct 04 20:42:27.667608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 817/1700] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:11 2022] POST /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf/action => generated 0 bytes in 16061 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:42:27.687843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:27.690016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:27.733149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:27.734231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:27.739798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:27.743231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:27.747324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:27.752067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.260115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:28.278739 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-761f00d1-0e46-4ed7-881c-b9c829bbbdf9 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 2.220383 Oct 04 20:42:28.295385 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 884/1701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:26 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:28.327379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:28.328925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:28.362861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.365502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.366423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.374220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.375782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.376618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.449693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] HTTP exception thrown: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Request method failure captured: Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a HTTP/1.1 Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJoLuVj0MMDEDg3H99ZBKRQonne9F2qheh3ht0c_E_yaNyEPXb8gEort4uBm7kSAPlC-pLYLikTO997emEjs12dmX5d6FaeH05SzgRF0Y5pcVd_7yvZqJDgE999lmSb90Nqop1nzjB3jd7Z7cIe0810YYB9HLWCVVBc8JOAoTUaFRXc Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:28.460028 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 174a016af11c4609af9410fa95ff16d4 Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.463115 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '541dc842-3d80-4824-ade1-014cd5281a5a'} Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:28.464824 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.467490 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.472699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Returning 404 to user: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:28.476626 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9407b04a-37c1-4ad6-893b-1d073d7dd82f tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 404 len: 111 microversion: 2.1 time: 0.178460 Oct 04 20:42:28.481597 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 885/1702] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:28 2022] DELETE /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:28.499854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:28.511107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: 541dc842-3d80-4824-ade1-014cd5281a5a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:28.558306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.560013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.561352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.563362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.564972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.566734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.675277 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] HTTP exception thrown: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Request method failure captured: Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a HTTP/1.1 Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJoLuVj0MMDEDg3H99ZBKRQonne9F2qheh3ht0c_E_yaNyEPXb8gEort4uBm7kSAPlC-pLYLikTO997emEjs12dmX5d6FaeH05SzgRF0Y5pcVd_7yvZqJDgE999lmSb90Nqop1nzjB3jd7Z7cIe0810YYB9HLWCVVBc8JOAoTUaFRXc Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:28.682120 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 174a016af11c4609af9410fa95ff16d4 Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.684967 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '541dc842-3d80-4824-ade1-014cd5281a5a'} Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:28.687830 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. Oct 04 20:42:28.692238 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:28.697635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Returning 404 to user: Instance 541dc842-3d80-4824-ade1-014cd5281a5a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:28.697635 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8381077-1135-4242-8929-d43453fb616a tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a" status: 404 len: 111 microversion: 2.1 time: 0.196534 Oct 04 20:42:28.697635 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 886/1703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:28 2022] GET /compute/v2.1/servers/541dc842-3d80-4824-ade1-014cd5281a5a => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:42:28.721276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24e80c06-cb5d-4705-ba3e-c0c1ad3c4410 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '.version_select at 0x7f54f6031940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.270144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:31.299321 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-497c0d30-2f58-4c00-90a4-26348c94144c tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 3.629491 Oct 04 20:42:31.300504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 818/1704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:27 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 3632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:31.328858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.330848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:31.368845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.377115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.381562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.384682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.402354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.405328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.644826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:34.680151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=60,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:34.721122 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-632f1e16-70c9-4517-9862-4ca834d9f25d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 3.411230 Oct 04 20:42:34.722185 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 819/1705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:31 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 3421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:34.821551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:34.854040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:34.901052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.909689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.911076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.916494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.917734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.919526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:36.444363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:36.468889 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d38faceb-5269-4df6-aa50-dd600b53fa04 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 1.699755 Oct 04 20:42:36.484403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 820/1706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:34 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:36.539717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5340ca-9c09-42d4-a621-8348dfec9894", "name": "network-vif-plugged", "status": "completed", "tag": "53cd8731-5002-48c6-9612-db1b4e47ecbb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:36.588920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:36.588920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:36.588920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:36.654195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] Creating event network-vif-plugged:53cd8731-5002-48c6-9612-db1b4e47ecbb for instance 0b5340ca-9c09-42d4-a621-8348dfec9894 on n-h1-851029-13 Oct 04 20:42:36.682113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-273002bb-b273-47c3-b28f-4f667d5638c5 req-9e320db4-7ec7-475e-9841-b6a7cc65081e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194345 Oct 04 20:42:36.691253 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 821/1707] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:36.743129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:36.757355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:36.804501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:36.806162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:36.807284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:36.808631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:36.818371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:36.820219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.279421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:38.332668 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b021551-d745-4398-b3b0-0ab6deba20b5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 1.638546 Oct 04 20:42:38.345496 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 822/1708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:36 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:38.388678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:38.394652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:38.408504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.410019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.411765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.414271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.415624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.417054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.530648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:38.603097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=19 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:39.163542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24e80c06-cb5d-4705-ba3e-c0c1ad3c4410 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/97302521-0d38-48be-a632-892ef8bb9471" status: 202 len: 0 microversion: 2.1 time: 10.463958 Oct 04 20:42:39.165735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 887/1709] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:42:28 2022] DELETE /compute/v2.1/os-floating-ips/97302521-0d38-48be-a632-892ef8bb9471 => generated 0 bytes in 10468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:42:39.224426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c", "tag": "075281ec-6683-44b6-9300-c60d197d1707"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:39.305508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.309455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.313339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.432468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] Creating event network-changed:075281ec-6683-44b6-9300-c60d197d1707 for instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c on n-h1-851029-13 Oct 04 20:42:39.440566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:39.468094 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0dcda563-c1ad-4dd3-91d3-664e0757c1e0 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1322 microversion: 2.1 time: 1.108065 Oct 04 20:42:39.484061 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 823/1710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:38 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1322 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:39.487479 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-daed0f19-b07c-4395-983c-a0a826ff64ec req-1ff0413e-71bf-4128-9a21-d20a553c3a86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316831 Oct 04 20:42:39.494087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 888/1711] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:39.511685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:39.518014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:39.522358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:39.529348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.530525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.531597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.533560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.534649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.536225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.536479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:39.605479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:39.613172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.621216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.622162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.626318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.629695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.631046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:40.279246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40b5e005-49d9-4af9-8172-5ab5d389575e tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 204 len: 0 microversion: 2.1 time: 0.792355 Oct 04 20:42:40.282491 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 824/1712] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:39 2022] DELETE /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:40.323909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:40.330698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:40.370266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:40.371350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:40.372179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:40.373574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:40.374450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:40.376855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:40.903752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:40.933529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc9f634b-4a86-431b-8077-316640e30716 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 1.433499 Oct 04 20:42:40.935269 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 889/1713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:39 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:41.006983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:41.008514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:41.033097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:41.034143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:41.035195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:41.038012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:41.039914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:41.041044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:41.533843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:41.564166 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3878a0c-942b-4804-b5f7-f8acbeb41cf8 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1527 microversion: 2.1 time: 1.269447 Oct 04 20:42:41.571256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 825/1714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:40 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1527 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:41.888043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:41.951675 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e533b195-1130-4314-beb5-8fe9e109ea12 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1472 microversion: 2.1 time: 1.011094 Oct 04 20:42:41.959946 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 890/1715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:40 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1472 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:42.008497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:42.010510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:42.022477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:42.027562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:42.043771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.044826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.045707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.057442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.058476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.059988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.072068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.076270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.081756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.084100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.086074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.087523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.186859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lazy-loading 'flavor' on Instance uuid 0b5340ca-9c09-42d4-a621-8348dfec9894 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:43.067537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8835b270-2dc2-4d6b-8d77-d56fc9a2a4c3 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894/action" status: 202 len: 0 microversion: 2.1 time: 1.065246 Oct 04 20:42:43.071069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:43.072062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 891/1716] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:41 2022] POST /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:42:43.158405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-740ededf-28b5-4270-a92d-d0004a5552b3 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 1.159350 Oct 04 20:42:43.159694 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 826/1717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:41 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:43.184627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:43.186537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:43.217931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:43.228102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:43.229773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:43.232579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:43.234220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:43.242042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.076391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:44.095919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf37380e-5b1d-44cc-b1a4-d798f178ef53 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1527 microversion: 2.1 time: 0.932324 Oct 04 20:42:44.097052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 827/1718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:43 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1527 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:44.110166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:44.111767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:44.125724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.127151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.128502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.130346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.131846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.133337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.182086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1913318640", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:44.398579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:44.403618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:44.406275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:44.410926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:44.412361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:44.483189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.491068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.496142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.502223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:44.508276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:44.514375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.586908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Getting quotas for project c53e30efd2ef49f7af3648c2000ed570. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:44.604625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Getting quotas for user 1be25515d1574f869862c54cb9f53aa9 and project c53e30efd2ef49f7af3648c2000ed570. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:44.686951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:44.699254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:45.454904 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6d3e2ea-32ca-4f5d-8db5-98423269d17c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 2.377509 Oct 04 20:42:45.462803 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 892/1719] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:42:45.481317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:45.483373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:45.505316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:45.516721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:45.516721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:45.516721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:45.516721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:45.518979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.053653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4b9951c-471f-40e1-ba85-4ccb2f5a8cde tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1633 microversion: 2.1 time: 1.935495 Oct 04 20:42:46.061264 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 828/1720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:44 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1633 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:46.095407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabdc6d9-69e4-4273-970b-c4bbbc714bbf", "name": "network-vif-deleted", "tag": "a0951431-2d06-4411-95e7-4a3558816f15"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:46.164701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.165719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.166516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.318833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] Creating event network-vif-deleted:a0951431-2d06-4411-95e7-4a3558816f15 for instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf on n-h2-851029-13 Oct 04 20:42:46.347836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-cacb98f5-bba9-47b4-ac0c-dd228e0e011d req-7643f601-c44e-45d8-9d6e-36c9690c8f45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283074 Oct 04 20:42:46.352153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 829/1721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:46.375281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:46.388313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:46.409799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.419262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.420205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.429984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.438740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.439085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.582278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.583118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.586625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.588187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lazy-loading 'fault' on Instance uuid eabdc6d9-69e4-4273-970b-c4bbbc714bbf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:47.477573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.484283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.493175 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1847c945-c6e2-42a7-8109-505b7c2df3c0 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1314 microversion: 2.1 time: 1.136432 Oct 04 20:42:47.494196 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 830/1722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:46 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:47.503194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:47.506914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:47.531748 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a51ffbe3-0513-44c6-ae91-18002ced109f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 2.066781 Oct 04 20:42:47.533981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 893/1723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:45 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:47.841809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e271056-df54-4133-9f98-a15a8efcf1b6 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Calling method '.version_select at 0x7f54f6167f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:47.842158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.867286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.873199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.888653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2597f07-2173-4fd9-9785-47e5b14b55ec tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "PUT /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1359 microversion: 2.75 time: 0.391574 Oct 04 20:42:47.890437 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 831/1724] 10.222.0.36 () {62 vars in 1297 bytes} [Tue Oct 4 20:42:47 2022] PUT /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:47.902576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:47.903822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:47.920299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.921736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.923046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.934339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.935091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2e271056-df54-4133-9f98-a15a8efcf1b6 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:47.939391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.939391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e271056-df54-4133-9f98-a15a8efcf1b6 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/27193e79-4333-4b18-bc53-86d3f3174dc7/metadata/os_distro HTTP/1.1 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:47.998438 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': '27193e79-4333-4b18-bc53-86d3f3174dc7', 'id': 'os_distro'} Oct 04 20:42:48.001645 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.004847 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 27193e79-4333-4b18-bc53-86d3f3174dc7 Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.011463 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27193e79-4333-4b18-bc53-86d3f3174dc7 could not be found. Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:48.017541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.020097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e271056-df54-4133-9f98-a15a8efcf1b6 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:48.022738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e271056-df54-4133-9f98-a15a8efcf1b6 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "DELETE /compute/v2.1/images/27193e79-4333-4b18-bc53-86d3f3174dc7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.483181 Oct 04 20:42:48.023636 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 894/1725] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 4 20:42:47 2022] DELETE /compute/v2.1/images/27193e79-4333-4b18-bc53-86d3f3174dc7/metadata/os_distro => generated 62 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:48.045859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.053432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.259600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.277324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.281522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.299522 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09aaa545-16ca-4679-9823-1ee844188915 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1359 microversion: 2.75 time: 0.271792 Oct 04 20:42:48.308042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 895/1726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:48.334219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e43e2e07-906f-41d5-bc5f-88e9e4719757 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Calling method '.version_select at 0x7f54f6167160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.436412 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e43e2e07-906f-41d5-bc5f-88e9e4719757 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e43e2e07-906f-41d5-bc5f-88e9e4719757 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/images/cd65d8ce-d9b6-44ea-b45d-d7f4d971557c/metadata/os_version HTTP/1.1 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:48.441908 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': 'cd65d8ce-d9b6-44ea-b45d-d7f4d971557c', 'id': 'os_version'} Oct 04 20:42:48.444478 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.446087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cd65d8ce-d9b6-44ea-b45d-d7f4d971557c Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.448875 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd65d8ce-d9b6-44ea-b45d-d7f4d971557c could not be found. Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:48.467970 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.470100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e43e2e07-906f-41d5-bc5f-88e9e4719757 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:48.473256 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e43e2e07-906f-41d5-bc5f-88e9e4719757 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "GET /compute/v2.1/images/cd65d8ce-d9b6-44ea-b45d-d7f4d971557c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.133929 Oct 04 20:42:48.473256 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 896/1727] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/images/cd65d8ce-d9b6-44ea-b45d-d7f4d971557c/metadata/os_version => generated 62 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:48.473256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7efebfae-a81a-42d8-91cf-31bf913ab025 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Calling method '.version_select at 0x7f54f5f4cdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.510894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1af6c62a-e826-4837-9c82-16a94a368a90 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1616 microversion: 2.1 time: 0.616805 Oct 04 20:42:48.512751 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 832/1728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:47 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1616 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:48.547815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.549354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.552385 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7efebfae-a81a-42d8-91cf-31bf913ab025 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7efebfae-a81a-42d8-91cf-31bf913ab025 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/images/ff3f4662-c773-4ed4-a9ed-fc02c506fa58/metadata HTTP/1.1 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:48.565128 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': 'ff3f4662-c773-4ed4-a9ed-fc02c506fa58'} Oct 04 20:42:48.567957 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.569456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ff3f4662-c773-4ed4-a9ed-fc02c506fa58 Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:48.571651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff3f4662-c773-4ed4-a9ed-fc02c506fa58 could not be found. Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:48.574107 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.580003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7efebfae-a81a-42d8-91cf-31bf913ab025 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:48.599180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7efebfae-a81a-42d8-91cf-31bf913ab025 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "GET /compute/v2.1/images/ff3f4662-c773-4ed4-a9ed-fc02c506fa58/metadata" status: 404 len: 62 microversion: 2.1 time: 0.108377 Oct 04 20:42:48.599180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 897/1729] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/images/ff3f4662-c773-4ed4-a9ed-fc02c506fa58/metadata => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:48.599180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:48.599180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.601634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.601634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.602001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.604941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.606298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.607920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.611232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.611894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.613031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.616871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.618230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.619769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.702201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.708896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.709985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.733233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lazy-loading 'fault' on Instance uuid eabdc6d9-69e4-4273-970b-c4bbbc714bbf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:48.885721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a016af11c4609af9410fa95ff16d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5183c91fd7184d16a0cb7d7e364c317d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.887513 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] HTTP exception thrown: Cannot 'migrate' instance 0b5340ca-9c09-42d4-a621-8348dfec9894 while it is in vm_state suspended Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Request method failure captured: Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894/action HTTP/1.1 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpryDaRPyAtv1ZpL2QxyxSa0bpnBc2O4W3LtJU6DiNK7BnyE47s0CjwuN9vEu5zXYjVqqVBo-H9o43OGIgM7-3EyZDo2ZODZPp8PlsGyP2s3t8SkpxjBwVng1Q5bZtR7K6qYq47oE1CGzirSzC57bXtCSLh6CdONTA_YSupQ6UrKnA Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:42:48.892009 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: c4042ff4dbe8459398adfca5c619611e Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: {"migrate": {}} Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:48.895372 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'migrate' instance 0b5340ca-9c09-42d4-a621-8348dfec9894 while it is in vm_state suspended Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '0b5340ca-9c09-42d4-a621-8348dfec9894', 'body': {'migrate': {}}} Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.897309 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 0b5340ca-9c09-42d4-a621-8348dfec9894 while it is in vm_state suspended Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:48.926094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 0b5340ca-9c09-42d4-a621-8348dfec9894 while it is in vm_state suspended Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Returning 409 to user: Cannot 'migrate' instance 0b5340ca-9c09-42d4-a621-8348dfec9894 while it is in vm_state suspended {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-adfbd318-c761-4ceb-a4e8-bbce51a826cc tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894/action" status: 409 len: 148 microversion: 2.1 time: 0.330297 Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 898/1730] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:48 2022] POST /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894/action => generated 148 bytes in 335 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:48.928651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19538620-994b-498b-9c08-612b47f17dc8 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Action: 'update_all', calling method: .version_select at 0x7f54f5f06430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:48.939871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84cbe54e-4aed-4033-bd46-9a7ee5b112e9 tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 200 len: 1314 microversion: 2.1 time: 0.402508 Oct 04 20:42:48.939871 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 833/1731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:48.952532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.954281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.980130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.980130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.980130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.980130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.980826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.981582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.993654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-19538620-994b-498b-9c08-612b47f17dc8 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19538620-994b-498b-9c08-612b47f17dc8 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/images/282534a2-0f95-4cf5-b63d-3a2e540c123b/metadata HTTP/1.1 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 57 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:48.998748 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:49.001897 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': '282534a2-0f95-4cf5-b63d-3a2e540c123b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.003489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 282534a2-0f95-4cf5-b63d-3a2e540c123b Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.009019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 282534a2-0f95-4cf5-b63d-3a2e540c123b could not be found. Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.016626 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:49.023117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.030142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19538620-994b-498b-9c08-612b47f17dc8 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.030142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19538620-994b-498b-9c08-612b47f17dc8 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "PUT /compute/v2.1/images/282534a2-0f95-4cf5-b63d-3a2e540c123b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.096007 Oct 04 20:42:49.030142 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 899/1732] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:42:48 2022] PUT /compute/v2.1/images/282534a2-0f95-4cf5-b63d-3a2e540c123b/metadata => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:49.034212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37317d15-476d-44da-b282-1c194619d003 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37317d15-476d-44da-b282-1c194619d003 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Request method failure captured: Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action HTTP/1.1 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 39 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpryDaRPyAtv1ZpL2QxyxSa0bpnBc2O4W3LtJU6DiNK7BnyE47s0CjwuN9vEu5zXYjVqqVBo-H9o43OGIgM7-3EyZDo2ZODZPp8PlsGyP2s3t8SkpxjBwVng1Q5bZtR7K6qYq47oE1CGzirSzC57bXtCSLh6CdONTA_YSupQ6UrKnA Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:42:49.048241 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: c4042ff4dbe8459398adfca5c619611e Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: {"os-resetState": {"state": "invalid"}} Oct 04 20:42:49.062297 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5266e87f-41f1-4e9d-9d34-fb2b569d08c9', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.064096 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:42:49.067342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:42:49.070043 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.070043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37317d15-476d-44da-b282-1c194619d003 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.070043 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37317d15-476d-44da-b282-1c194619d003 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action" status: 400 len: 144 microversion: 2.1 time: 0.036532 Oct 04 20:42:49.070043 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 900/1733] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action => generated 144 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:42:49.070043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-42b8dde1-30dc-402f-9386-76f0168c0385 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Action: 'update', calling method: .version_select at 0x7f54f61c23a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.146248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-42b8dde1-30dc-402f-9386-76f0168c0385 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-42b8dde1-30dc-402f-9386-76f0168c0385 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/images/9ae571af-fbf7-4462-813c-a079359557ed/metadata/os_distro HTTP/1.1 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 30 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:49.151973 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: {"meta": {"os_distro": "alt"}} Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:49.155133 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': '9ae571af-fbf7-4462-813c-a079359557ed', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.156996 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ae571af-fbf7-4462-813c-a079359557ed Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.159567 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ae571af-fbf7-4462-813c-a079359557ed could not be found. Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.167987 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:49.172301 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.176727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-42b8dde1-30dc-402f-9386-76f0168c0385 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.176727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-42b8dde1-30dc-402f-9386-76f0168c0385 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "PUT /compute/v2.1/images/9ae571af-fbf7-4462-813c-a079359557ed/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.111936 Oct 04 20:42:49.178452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 901/1734] 10.222.0.36 () {60 vars in 1310 bytes} [Tue Oct 4 20:42:49 2022] PUT /compute/v2.1/images/9ae571af-fbf7-4462-813c-a079359557ed/metadata/os_distro => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:49.191023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8877571-5350-4f78-bc3f-3b3faf683054 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8877571-5350-4f78-bc3f-3b3faf683054 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Request method failure captured: Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action HTTP/1.1 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 31 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpryDaRPyAtv1ZpL2QxyxSa0bpnBc2O4W3LtJU6DiNK7BnyE47s0CjwuN9vEu5zXYjVqqVBo-H9o43OGIgM7-3EyZDo2ZODZPp8PlsGyP2s3t8SkpxjBwVng1Q5bZtR7K6qYq47oE1CGzirSzC57bXtCSLh6CdONTA_YSupQ6UrKnA Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:42:49.199211 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: c4042ff4dbe8459398adfca5c619611e Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: {"os-resetState": {"state": 1}} Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:49.202298 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5266e87f-41f1-4e9d-9d34-fb2b569d08c9', 'body': {'os-resetState': {'state': 1}}} Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 1 Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.204213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:42:49.221140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.223524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8877571-5350-4f78-bc3f-3b3faf683054 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.223524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8877571-5350-4f78-bc3f-3b3faf683054 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action" status: 400 len: 120 microversion: 2.1 time: 0.028187 Oct 04 20:42:49.223524 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 902/1735] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:42:49.223524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e708d8e-105c-4559-a56c-6f7b4e6ed9b4 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Action: 'create', calling method: .version_select at 0x7f54f61673a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.291634 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-4e708d8e-105c-4559-a56c-6f7b4e6ed9b4 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] HTTP exception thrown: Image not found. Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e708d8e-105c-4559-a56c-6f7b4e6ed9b4 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Request method failure captured: Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/images/33b114aa-4535-4192-a5fa-3df6059e013f/metadata HTTP/1.1 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 57 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrGSxbkTV_ZUVF1-EwXKJQZGv5O1Sdu-0j_v0Sn2Rw9B_6fo4KkRn7uRX6e7KvMggbfZdZJsFek0GtFvGxVwwWqAS0KXdTOEuLjeyJMQqtFyGFvKyAihhxSuZxmHGKK4xzLfGNcgQwsWe6xLsqesHg4evdo9f4RZcQcsi8sE6yL6Yw Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:49.296615 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6f99538d3dba4c7589da0c0d546e6496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 6f99538d3dba4c7589da0c0d546e6496 Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-588723586 Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 218d4902f3ae4b1599364f07e6d29c62 Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-588723586-project Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:42:49.299495 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'image_id': '33b114aa-4535-4192-a5fa-3df6059e013f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.301482 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33b114aa-4535-4192-a5fa-3df6059e013f Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:49.308026 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33b114aa-4535-4192-a5fa-3df6059e013f could not be found. Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.312481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:49.318082 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.326988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e708d8e-105c-4559-a56c-6f7b4e6ed9b4 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.327820 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e708d8e-105c-4559-a56c-6f7b4e6ed9b4 tempest-ImagesMetadataNegativeTestJSON-588723586 tempest-ImagesMetadataNegativeTestJSON-588723586-project] 10.222.0.36 "POST /compute/v2.1/images/33b114aa-4535-4192-a5fa-3df6059e013f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.109818 Oct 04 20:42:49.329922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 903/1736] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/images/33b114aa-4535-4192-a5fa-3df6059e013f/metadata => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:49.349161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.353220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Failed to fetch instance by id 999 {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:42:49.354281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Request method failure captured: Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 37 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJpryDaRPyAtv1ZpL2QxyxSa0bpnBc2O4W3LtJU6DiNK7BnyE47s0CjwuN9vEu5zXYjVqqVBo-H9o43OGIgM7-3EyZDo2ZODZPp8PlsGyP2s3t8SkpxjBwVng1Q5bZtR7K6qYq47oE1CGzirSzC57bXtCSLh6CdONTA_YSupQ6UrKnA Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:42:49.373379 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cd0ab260aec4c58aec156f52c1e30d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8cd0ab260aec4c58aec156f52c1e30d4 Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1490409825 Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: c4042ff4dbe8459398adfca5c619611e Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1490409825-project-admin Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: {"os-resetState": {"state": "error"}} Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:49.376828 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 999 could not be found. Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:42:49.378552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:49.381383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65069db0-27e5-4d8c-bef6-9d3099381f87 tempest-ServersAdminNegativeTestJSON-1490409825 tempest-ServersAdminNegativeTestJSON-1490409825-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.039448 Oct 04 20:42:49.389590 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 904/1737] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:49.393245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.403509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.404916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:49.428589 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18268048-a36b-4802-a609-db472ee2d28a tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 0.488232 Oct 04 20:42:49.442519 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 834/1738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:49.442519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.442519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:49.460974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.461947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.462820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.464207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.483590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.484535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.538969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.562092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.574124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:49.581084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.592657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2ad7f44-099e-4bed-b072-c5e39f884391 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1359 microversion: 2.75 time: 0.215992 Oct 04 20:42:49.597061 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 905/1739] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:49 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:49.693087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:49.985574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.986947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] [instance: eabdc6d9-69e4-4273-970b-c4bbbc714bbf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:49.998309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.999002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.999723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.000787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.001390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.001830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.025539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] HTTP exception thrown: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Request method failure captured: Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf HTTP/1.1 Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJoLuVj0MMDEDg3H99ZBKRQonne9F2qheh3ht0c_E_yaNyEPXb8gEort4uBm7kSAPlC-pLYLikTO997emEjs12dmX5d6FaeH05SzgRF0Y5pcVd_7yvZqJDgE999lmSb90Nqop1nzjB3jd7Z7cIe0810YYB9HLWCVVBc8JOAoTUaFRXc Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:42:50.029604 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5183c91fd7184d16a0cb7d7e364c317d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5183c91fd7184d16a0cb7d7e364c317d Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1617498223 Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 174a016af11c4609af9410fa95ff16d4 Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1617498223-project Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. Oct 04 20:42:50.032544 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'eabdc6d9-69e4-4273-970b-c4bbbc714bbf'} Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:50.034175 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. Oct 04 20:42:50.037098 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:42:50.040065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] Returning 404 to user: Instance eabdc6d9-69e4-4273-970b-c4bbbc714bbf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:50.040065 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8896e66b-272c-423b-ba7d-c4673746ffcf tempest-FloatingIPsAssociationTestJSON-1617498223 tempest-FloatingIPsAssociationTestJSON-1617498223-project] 10.222.0.36 "GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf" status: 404 len: 111 microversion: 2.1 time: 0.055043 Oct 04 20:42:50.040065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 906/1740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:49 2022] GET /compute/v2.1/servers/eabdc6d9-69e4-4273-970b-c4bbbc714bbf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:42:50.493715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:50.495754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:50.514493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.516021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.517877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.520321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.521614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.522631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.782192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66cfe0fa-bc5d-433e-a2a8-ac914ce63912 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 204 len: 0 microversion: 2.1 time: 1.349630 Oct 04 20:42:50.789909 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 835/1741] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:42:49 2022] DELETE /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 0 bytes in 1353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:50.797241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:50.799921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:50.813158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.814732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.816002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.817811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.819356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.820649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.903383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:50.927580 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-171841a6-4046-4d26-aefe-35fef07a7fe5 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 0.443555 Oct 04 20:42:50.961295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 907/1742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:50 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:50.961295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:50.961295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:50.961295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.962277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.962277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.962277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.962277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.962977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.179958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.241272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.258532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.282131 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ecfbf5e-a17a-4287-ba97-811d6bbae371 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1363 microversion: 2.75 time: 0.496104 Oct 04 20:42:51.283289 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 836/1743] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:50 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:51.495074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.526599 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57a01d5f-e890-4df4-aa79-cbae7d74c4d9 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1469 microversion: 2.1 time: 0.595504 Oct 04 20:42:51.538898 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 908/1744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:50 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:51.691508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c", "name": "network-vif-plugged", "status": "completed", "tag": "075281ec-6683-44b6-9300-c60d197d1707"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:51.740667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.742579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.743732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.823749 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] Creating event network-vif-plugged:075281ec-6683-44b6-9300-c60d197d1707 for instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c on n-h1-851029-13 Oct 04 20:42:51.852411 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e51a8698-ca05-48c7-ba6d-e9ac1c878464 req-053bc78a-396d-4fb4-8776-460fb2382af8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157400 Oct 04 20:42:51.854061 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 837/1745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:42:51.979692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.980904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.019414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.021321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.024321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.025453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.028080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.029374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.355316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:52.359943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.387010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.387921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.388940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.394417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.407394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.408302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.717392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:52.763750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:52.771440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:52.793327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:52.796401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae0382d7-23ee-4b45-a391-0b1c1ac66f17 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1411 microversion: 2.75 time: 0.452579 Oct 04 20:42:52.799644 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 838/1746] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1411 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:52.832965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:52.843394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.869066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.870141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.871027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.872439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.877211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.878631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.973406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.021224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a22fa91-4f25-418e-870a-c80a8290e79d tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 1.050326 Oct 04 20:42:53.035266 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 909/1747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.661090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.724039 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-109e7bdd-24ea-460f-acca-b87068af3559 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1469 microversion: 2.1 time: 0.914320 Oct 04 20:42:53.725156 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 839/1748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1469 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.860482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.863348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.900170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.900170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.901599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.903694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.905692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.907205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.095277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.098802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.133497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.141321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.142319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.157756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.157756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.157756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.158378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.185650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.188044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.233812 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5812042-9f58-42ba-ae3a-0b25c25e2676 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1419 microversion: 2.75 time: 0.370578 Oct 04 20:42:54.233812 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 910/1749] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1419 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:54.780138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.782004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.798879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:54.807159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.808915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.811313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.813162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.814573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.820038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.855423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.880666 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e19fc723-0cfb-4776-a961-3c2790002dcc tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1315 microversion: 2.1 time: 0.806139 Oct 04 20:42:54.887052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 840/1750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.283801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.287731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.301438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.302439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.303429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.305717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.307071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.308284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.976554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.011605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.020815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de08c4e2-f184-4542-a8bb-9c14eef3c27b tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1469 microversion: 2.1 time: 1.248992 Oct 04 20:42:56.026627 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 911/1751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1469 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:56.068465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.072702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.074287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.082716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.105773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.108359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.109294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f7b9a96-2f0a-4be4-9a0b-5ebd8634602c tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1429 microversion: 2.75 time: 0.832590 Oct 04 20:42:56.110505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.123264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.125168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.126542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.127062 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 841/1752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1429 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:56.164398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5340ca-9c09-42d4-a621-8348dfec9894", "name": "network-vif-deleted", "tag": "53cd8731-5002-48c6-9612-db1b4e47ecbb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:56.180000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.181254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.182303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.217337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] Creating event network-vif-deleted:53cd8731-5002-48c6-9612-db1b4e47ecbb for instance 0b5340ca-9c09-42d4-a621-8348dfec9894 on n-h1-851029-13 Oct 04 20:42:56.239858 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2e72682b-94f7-4a85-a8cc-00a95de73a84 req-12c5fad2-a81e-4d5b-9425-69aaf223fcf3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110443 Oct 04 20:42:56.242347 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 842/1753] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:56.734761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.746726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-271ac903-9c59-4985-ac26-da3e5312ed40 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1503 microversion: 2.1 time: 0.711019 Oct 04 20:42:56.748003 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 912/1754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:56.807299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.807299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.818533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.820823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.822521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.824795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.826853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.828535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.909621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.927631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5a8c3f2-04bb-4b15-b30d-df8341954294 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/os-instance-actions/req-421a0180-47c7-4d2c-b324-feb992661bb2" status: 200 len: 313 microversion: 2.1 time: 0.127776 Oct 04 20:42:56.928288 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 843/1755] 10.222.0.36 () {58 vars in 1419 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/os-instance-actions/req-421a0180-47c7-4d2c-b324-feb992661bb2 => generated 313 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:56.957177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:56.962139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.980649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.982785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.983857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.985839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.009362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.012642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.088200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.094066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:57.126464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.131151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.137913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.140441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.145029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.146457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.281368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.283131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.283792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.285236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lazy-loading 'fault' on Instance uuid 0b5340ca-9c09-42d4-a621-8348dfec9894 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:57.712451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:57.754022 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-534072de-2263-43dd-ae62-714c982e6f6d tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1312 microversion: 2.1 time: 0.683306 Oct 04 20:42:57.757772 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 844/1756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.781479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.784102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:57.848210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a1a8ed6-f178-448f-9df9-aa3de7696b7c tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "POST /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/action" status: 202 len: 0 microversion: 2.1 time: 0.883129 Oct 04 20:42:57.850201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.851452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 913/1757] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:56 2022] POST /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:42:57.854609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.856249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.863683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.864874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.865945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.870528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:58.189856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.214368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.217439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.239949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9f88ecf-2402-47b1-8c0a-41f300bb1be7 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1417 microversion: 2.75 time: 0.477076 Oct 04 20:42:58.254724 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 845/1758] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1417 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:58.255511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.257068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:58.307727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.309279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.313391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.315256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.316198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.317382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.373476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Calling method '.version_select at 0x7f54f611f820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.430562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.431519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.432337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.433859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.434812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.435555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.489171 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0afff551-20af-4de2-b5a1-eb6c3aa6a27f tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.640526 Oct 04 20:42:58.491037 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 914/1759] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:58.620845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-262398608", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:58.839552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:59.129649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.149792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7db55a73-1633-4ec8-9016-b0adfcd282bf tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1505 microversion: 2.1 time: 0.905846 Oct 04 20:42:59.151149 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 846/1760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1505 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:59.162043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.164964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:59.201886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.203359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.204635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.206290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.207561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.208761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.341805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.344867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.348954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.355943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lazy-loading 'fault' on Instance uuid 0b5340ca-9c09-42d4-a621-8348dfec9894 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:59.603940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.619803 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-adf8908e-b271-46d0-aeb7-320e92954945 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 200 len: 1312 microversion: 2.1 time: 0.466512 Oct 04 20:42:59.620936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 847/1761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 1312 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:59.632883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.652876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:59.684155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.685737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.687440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.689697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.691342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.692734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.032910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Getting quotas for project 31abbf9b517446c5b24568fb9d37d0d0. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:00.051179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Getting quotas for user dc4312058ef54832907b09bd94773777 and project 31abbf9b517446c5b24568fb9d37d0d0. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:00.098947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Request method failure captured: Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 1751 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrRr9cqhc9Z0QIBOVgf4FJaDvy0cQ9PchwlTLdlpW5DbhTc5Dbes-KtrQ2sZeDnWAcPyFGvlBFsKb08-igBgDgfQDGzPUK4WTbZIXFWQAhFkwzkSdYR__juDl7IH1A2fMUHfLk-g4BepPa69AtyiTvaqdjaYtdFuPJvVGmJj--JQGc Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 31abbf9b517446c5b24568fb9d37d0d0 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1271955995 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/31abbf9b517446c5b24568fb9d37d0d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/31abbf9b517446c5b24568fb9d37d0d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/31abbf9b517446c5b24568fb9d37d0d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_31abbf9b517446c5b24568fb9d37d0d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1271955995 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 31abbf9b517446c5b24568fb9d37d0d0 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1271955995 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc4312058ef54832907b09bd94773777 Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-262398608", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:43:00.104642 n-d-851029-13 devstack@n-api.service[123541]: exception: Maximum number of metadata items exceeds 128 Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-262398608', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:00.109329 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 20:43:00.129383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:00.149968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:00.157495 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16839757-f37e-4326-93e0-b0af785dae22 tempest-AbsoluteLimitsNegativeTestJSON-1271955995 tempest-AbsoluteLimitsNegativeTestJSON-1271955995-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.544170 Oct 04 20:43:00.163799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 915/1762] 10.222.0.36 () {60 vars in 1148 bytes} [Tue Oct 4 20:42:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 1553 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:43:00.205959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.214548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.218228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.259603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.261125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.266599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.268629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.272286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.274113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.281612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.297572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.325189 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1da4fa45-b3ba-4a17-9c17-a86908577af2 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1438 microversion: 2.75 time: 0.701446 Oct 04 20:43:00.331462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 848/1763] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1438 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:00.413227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:00.422553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.436647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.438140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.439855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.443203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.449283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.466877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.785916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:00.786860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:00.787845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:00.791007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:00.791577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:01.379593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:01.403611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.404668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.407938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.410277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.426778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.426778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.625867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.631399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:02.652599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.671920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.676758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.690772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:02.707348 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-129f6e96-0dcb-47b9-a3aa-4020e69e734e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "POST /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa/action" status: 202 len: 1495 microversion: 2.75 time: 2.309616 Oct 04 20:43:02.709381 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 849/1764] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:43:00 2022] POST /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa/action => generated 1495 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 20:43:02.732021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.732963 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4553e0c7-ffcc-4607-b7ee-23a0f542cae4 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1505 microversion: 2.1 time: 2.536640 Oct 04 20:43:02.734081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 916/1765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1505 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:02.736135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 0b5340ca-9c09-42d4-a621-8348dfec9894] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.762751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.769711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.772861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.777125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.779780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.783106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.800534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.801632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.845148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] HTTP exception thrown: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Request method failure captured: Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 HTTP/1.1 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJpoG_Z4PL7nICeAyaoO1-NlFWdKF9lZeMMKj3p74cI3nLexq38MiYfiW-0LOe0pH4YcBY1wlOeQbbD72i--mZnFNFRCbw0HdTpJBZposcW4fZr96DwlzdhPrlKcLta476s8D__ZwY270SdPQlRITTw1jQUl5gPCmHkQUN2RR0w99JY Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c6e860fd94e64334b3dfc2387ba40b15 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c6e860fd94e64334b3dfc2387ba40b15 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminNegativeTestJSON-2049612768-project Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e68659d5f8ac4a87995428261eee3b8f Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049612768-project Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '0b5340ca-9c09-42d4-a621-8348dfec9894'} Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:02.853246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. Oct 04 20:43:02.871042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:02.873032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.873032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.874985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Returning 404 to user: Instance 0b5340ca-9c09-42d4-a621-8348dfec9894 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:02.877711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.880077 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b365ef1d-7c34-4613-9fa7-b522f81b1c75 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894" status: 404 len: 111 microversion: 2.1 time: 0.167810 Oct 04 20:43:02.886011 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 850/1766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/0b5340ca-9c09-42d4-a621-8348dfec9894 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:02.900134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.901180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.902012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.911213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.915128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.956269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.958147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.961049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.963256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.964179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.965003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.060410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:03.199719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.254294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.264914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.285198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f5adfd4-5c84-4bf9-afab-627a2855056a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.498195 Oct 04 20:43:03.290758 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 917/1767] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:43:03.799816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.800960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.837079 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f8b1044-2078-459a-b23f-c9e15759baec tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 204 len: 0 microversion: 2.1 time: 0.941574 Oct 04 20:43:03.847198 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 851/1768] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:02 2022] DELETE /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:03.860858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.861654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.863379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.876161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.880222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.881464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.899329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.904202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.945268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.946178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.947088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.948407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.949275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.950052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.976039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.010464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dbffc980-c13b-42db-9dc2-f093f0e78c8e tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1503 microversion: 2.1 time: 1.206598 Oct 04 20:43:05.011713 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 918/1769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1503 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:05.059127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.060420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.105910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.110877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.116954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.123008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.123008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.123008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.163254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.190541 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ad2ee7c-5788-4653-9fbb-2be770931304 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1476 microversion: 2.1 time: 1.344178 Oct 04 20:43:05.191588 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 852/1770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1476 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:05.242296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '.version_select at 0x7f54f605b9d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.245800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.279840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.283339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.284292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.285660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.286563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.287410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.448870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fc360c8-42ae-4243-a124-a6d178042410 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.248821 Oct 04 20:43:05.450988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 853/1771] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c/os-instance-actions => generated 611 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:05.463457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-754037501", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d4133c60-0102-48e4-be66-6bf5189f9cc1"}], "block_device_mapping_v2": [{"uuid": "8dbdcf83-cc7f-4bc8-8f2a-1911d42ef772", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:05.637333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] validate_networks() for [('d4133c60-0102-48e4-be66-6bf5189f9cc1', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:05.677512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.702327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.707860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.749772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9a8bd55-9dce-466c-a075-8d498c728e54 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.711399 Oct 04 20:43:05.751778 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 919/1772] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:05.763404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.765012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.791151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.797345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.799138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.803534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.804467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.805286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.915020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:06.741516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0df03b81-abf4-4ac0-ab10-114709383156 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 204 len: 0 microversion: 2.1 time: 0.986988 Oct 04 20:43:06.745163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 920/1773] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:05 2022] DELETE /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:06.754640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:06.756555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:06.768617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.770146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.770980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:06.773424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.774704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.776675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:07.492153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:07.516474 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d983e8d7-6d36-48c9-adbe-01030d4c50b1 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1476 microversion: 2.1 time: 0.768208 Oct 04 20:43:07.517847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 921/1774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:06 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1476 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:07.528055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:07.530016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:07.543899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:07.545386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:07.546794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:07.548577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:07.550435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:07.551606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.240241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:08.242385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:08.243770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:08.244884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:08.246519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:08.271915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.274568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.278250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.278250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.278250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.280812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.329714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:08.330344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:08.353707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Getting quotas for user 44a42dd2dd73439bbe445de3b2eb9744 and project 2dd088c880894556b8525b41e5684eef. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:08.366761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab5ece35-57b8-4085-b18e-5165aedd4efb tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1509 microversion: 2.1 time: 0.846346 Oct 04 20:43:08.378729 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 922/1775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:07 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1509 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:08.387586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:08.389955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:08.416593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:08.422150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.422443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.423836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.425436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.427874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.429231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.604922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:08.696076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:43:08.701223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dbdcf83-cc7f-4bc8-8f2a-1911d42ef772',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:08.781791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:08.812107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:08.817080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:08.840712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2dd85e78-bda9-4c51-8595-5e646bf1554e tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.470438 Oct 04 20:43:08.843690 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 923/1776] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:08 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:08.856543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:08.862590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:08.892647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.894264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.896201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:08.899136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:08.902708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:08.903935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.400278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:09.482476 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc94b21b-e14f-4305-9c70-63bcadea7df6 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1434 microversion: 2.1 time: 0.632404 Oct 04 20:43:09.486476 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 924/1777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:08 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1434 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:09.526347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5266e87f-41f1-4e9d-9d34-fb2b569d08c9", "name": "network-vif-deleted", "tag": "f6732cd1-8009-4cee-bebd-aadfe464a055"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:09.577066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:09.588554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:09.588554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.626307 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] Creating event network-vif-deleted:f6732cd1-8009-4cee-bebd-aadfe464a055 for instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 on n-h2-851029-13 Oct 04 20:43:09.640654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4536e92e-7582-47e8-a3d0-112a54a5faff req-5973c7fb-d735-4240-8e77-0bdf842bc2bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150252 Oct 04 20:43:09.642563 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 925/1778] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:09.661555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:09.668999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:09.691875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:09.698413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:09.700614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.702706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:09.704805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:09.706864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:09.792855 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26425ca1-780b-4391-9f55-02904cb4d464 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.338436 Oct 04 20:43:09.801057 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 854/1779] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:43:09.837052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d125957-9724-422d-b738-ecceb840944e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:09.843155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d125957-9724-422d-b738-ecceb840944e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.054866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d125957-9724-422d-b738-ecceb840944e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.078523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:10.084240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d125957-9724-422d-b738-ecceb840944e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1052 microversion: 2.1 time: 0.266478 Oct 04 20:43:10.085327 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 855/1780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:09 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1052 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.112914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.114137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.136443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.144465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.145428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.146692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.147631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.157254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.606471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.644210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.651538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.669082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc233ecc-90a7-4569-ab32-a2b76635120d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.581779 Oct 04 20:43:10.671158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 856/1781] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:10.702201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.703974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.722119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.723699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.724976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.727748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.729228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.731065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.806411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.835297 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc9ed0b5-12bf-418d-8166-f60d7c0e8cf6 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1509 microversion: 2.1 time: 1.189489 Oct 04 20:43:10.837500 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 926/1782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:09 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1509 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.840920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.844007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.845313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.846481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lazy-loading 'fault' on Instance uuid 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:10.968297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e68659d5f8ac4a87995428261eee3b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6e860fd94e64334b3dfc2387ba40b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.990391 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47ea18f5-2c3b-4c2a-a6d4-c4ce6016ac60 tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 200 len: 1311 microversion: 2.1 time: 0.315697 Oct 04 20:43:11.003795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 857/1783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 1311 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:11.144689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb3d9460-1a32-4be6-b549-aae2c1d8ff88 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.146770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb3d9460-1a32-4be6-b549-aae2c1d8ff88 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:11.443042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb3d9460-1a32-4be6-b549-aae2c1d8ff88 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:11.461202 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb3d9460-1a32-4be6-b549-aae2c1d8ff88 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1052 microversion: 2.1 time: 0.333916 Oct 04 20:43:11.465108 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 927/1784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1052 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:11.729191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.730599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:11.781196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.782378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.783419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.784815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.787553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.788991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.892761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c", "name": "network-vif-deleted", "tag": "075281ec-6683-44b6-9300-c60d197d1707"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:11.963950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.967226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.982249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.104740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] Creating event network-vif-deleted:075281ec-6683-44b6-9300-c60d197d1707 for instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c on n-h1-851029-13 Oct 04 20:43:12.116609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5d90c786-5586-4163-b2ee-e14b3a70ad14 req-486b3358-e906-49fc-869e-f302a38574b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241524 Oct 04 20:43:12.119228 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 928/1785] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:43:12.155869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.157071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:12.182077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.182755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.184034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.186150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.186903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.188920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.316030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.351680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.365503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.404408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-113090b9-e089-4829-9ee3-0635448a6da3 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.682997 Oct 04 20:43:12.411201 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 858/1786] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:12.447514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.470792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] [instance: 5266e87f-41f1-4e9d-9d34-fb2b569d08c9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:12.478723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.480630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.482062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.483901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.485263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.486651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.519242 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] HTTP exception thrown: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Request method failure captured: Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 HTTP/1.1 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJpoG_Z4PL7nICeAyaoO1-NlFWdKF9lZeMMKj3p74cI3nLexq38MiYfiW-0LOe0pH4YcBY1wlOeQbbD72i--mZnFNFRCbw0HdTpJBZposcW4fZr96DwlzdhPrlKcLta476s8D__ZwY270SdPQlRITTw1jQUl5gPCmHkQUN2RR0w99JY Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c6e860fd94e64334b3dfc2387ba40b15 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c6e860fd94e64334b3dfc2387ba40b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c6e860fd94e64334b3dfc2387ba40b15 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049612768 Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminNegativeTestJSON-2049612768-project Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e68659d5f8ac4a87995428261eee3b8f Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049612768-project Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '5266e87f-41f1-4e9d-9d34-fb2b569d08c9'} Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:12.524490 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. Oct 04 20:43:12.550031 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:43:12.560607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.560922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] Returning 404 to user: Instance 5266e87f-41f1-4e9d-9d34-fb2b569d08c9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:12.560922 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-594a101b-c639-4fbb-b2d6-028eb3e451eb tempest-ServersAdminNegativeTestJSON-2049612768 tempest-ServersAdminNegativeTestJSON-2049612768-project] 10.222.0.36 "GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9" status: 404 len: 111 microversion: 2.1 time: 0.132193 Oct 04 20:43:12.560922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 859/1787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/servers/5266e87f-41f1-4e9d-9d34-fb2b569d08c9 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:12.582052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:12.583689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:12.612817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.612817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.613230 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae6f87ac-6de7-4e7a-8aed-a321612a8a93 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1467 microversion: 2.1 time: 0.488781 Oct 04 20:43:12.613472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.625991 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 929/1788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1467 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.627801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.628908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.629802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.884416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.917108 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1faf350-487b-45ac-8596-50f5f721b0f1 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1102 microversion: 2.1 time: 0.361270 Oct 04 20:43:12.918500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 860/1789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:12 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1102 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:13.468919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.471433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:13.486616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.488097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.505219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.522518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.522518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.523408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.662521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.672259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:13.730760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.732465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.737145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.739624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.745210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.746150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.761157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:13.789479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:13.798779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:13.829519 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc172407-c2c1-4a9b-b7e3-d2ac99eca9db tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.369676 Oct 04 20:43:13.831123 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 930/1790] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:13 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:43:13.876700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.879934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.881545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.882761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lazy-loading 'fault' on Instance uuid 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:13.966209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.969387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:13.996620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.999514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.004546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.008016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.009020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.014120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.085067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4598575bd2894e0086b165b08b85cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d16464ad008493dbe85c55353afbe8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:14.110587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05b369bf-4e5e-4251-9988-bc101dbfad18 tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 200 len: 1305 microversion: 2.1 time: 0.456454 Oct 04 20:43:14.116490 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 861/1791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:13 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 1305 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:14.340108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:14.372277 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-117c715c-413f-4e8e-b974-b26027cd55fb tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1150 microversion: 2.1 time: 0.417830 Oct 04 20:43:14.376745 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 931/1792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:13 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1150 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:14.899247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:14.906208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:14.941255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.945082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.948322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.953737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.962211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.964160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.173746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:15.177310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] [instance: 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:15.227176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.228177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.232839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.233907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.234534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.240376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.332157 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] HTTP exception thrown: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Request method failure captured: Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c HTTP/1.1 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJqYxs1OQqGuNCtCDvHwSvTU9h1P6AVAy52FGmeMbBySf_wlDueWQRUm25ndSzTmdGoma23EdhFXUFAZZhMbXdLl-aj_Dol7XZEvp0FLakxRHQDVpO5dRKcN-lGys3QLe_Axo571cMoI36AQgkkaJRClF8b2Dg-awcFzcplwQHyOw_k Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0d16464ad008493dbe85c55353afbe8a Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-InstanceActionsTestJSON-1609356890 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d16464ad008493dbe85c55353afbe8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d16464ad008493dbe85c55353afbe8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d16464ad008493dbe85c55353afbe8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d16464ad008493dbe85c55353afbe8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-InstanceActionsTestJSON-1609356890 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0d16464ad008493dbe85c55353afbe8a Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1609356890 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-InstanceActionsTestJSON-1609356890-project Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4598575bd2894e0086b165b08b85cd14 Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-InstanceActionsTestJSON-1609356890-project Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c'} Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:15.339361 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] Returning 404 to user: Instance 7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab72e2b1-bcfb-4b50-a34e-46629fbc681f tempest-InstanceActionsTestJSON-1609356890 tempest-InstanceActionsTestJSON-1609356890-project] 10.222.0.36 "GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c" status: 404 len: 111 microversion: 2.1 time: 0.180315 Oct 04 20:43:15.352009 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 932/1793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:15 2022] GET /compute/v2.1/servers/7b8e56ae-56c8-4a9f-b935-d6cf02b89e9c => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:43:15.460947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:15.467475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:15.489156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.490125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.490609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.492288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.493225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.494343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.631907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.673354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.677748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.699380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-036fa4d9-4f16-4839-9093-8b95469a28b4 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.805369 Oct 04 20:43:15.699380 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 862/1794] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:14 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:15.963616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:16.002396 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9f0d94b-893a-426b-b10d-664ca1d0caa4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1150 microversion: 2.1 time: 0.579463 Oct 04 20:43:16.004052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 933/1795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:15 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1150 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:16.756453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:16.759097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:16.781988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.789077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.789892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:16.790981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.800535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.801298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.048132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:17.058901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:17.086837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.089099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.093945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.098148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.103329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.108264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.023634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.064202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.068240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.075798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:18.083928 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-179fb82f-094b-4e6f-9030-d800b879a0dc tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 1.337662 Oct 04 20:43:18.088036 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 863/1796] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:16 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:18.184846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.207850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:18.238924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33e8b5b7-4bd8-4700-822a-cdc1552e5596 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1168 microversion: 2.1 time: 1.197918 Oct 04 20:43:18.457252 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 934/1797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:17 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1168 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:18.629150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:19.154397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.162948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:19.220565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.221708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.227734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.229343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.233907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.234916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.323659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1734586836", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f523fb29-a2bc-4c61-a00c-0dd5af2b4eb0"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:19.574921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] validate_networks() for [('f523fb29-a2bc-4c61-a00c-0dd5af2b4eb0', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:20.072236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:20.917714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:20.969789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:20.980268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:21.008102 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da0fe379-4b76-4016-ab6b-a7b48bc7d16a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 1.860322 Oct 04 20:43:21.009922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 935/1798] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:19 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:43:21.042263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:21.046436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:21.083233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.091808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.093503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.095864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.099129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.103879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:22.038819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:22.049660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:22.118188 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe587d6d-2efe-44d4-a022-a57a3569c53e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1168 microversion: 2.1 time: 1.098835 Oct 04 20:43:22.123150 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 936/1799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:21 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1168 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:22.164401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:22.169510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:22.208478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:22.215139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:22.218876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:22.221957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:22.225502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:22.231206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.210528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.278955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.286490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.316217 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ae3705e-b51b-4797-bad7-2ae4e396ac7a tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 1.187017 Oct 04 20:43:23.318268 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 937/1800] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:22 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:23.330091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:23.332970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:23.346821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.348335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.349491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.352554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.353889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.355112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.326281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:25.352121 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3458c4bc-4db9-4c5d-87a0-1bc35d1bbb2e tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1210 microversion: 2.1 time: 2.029685 Oct 04 20:43:25.357684 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 938/1801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:23 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1210 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:25.401068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:25.402900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:25.423116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.428567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.431924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.435132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.439104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.440579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.078988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.108483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.118233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.149718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c3cb662-1ee9-4bde-b3c6-3ea2ba436798 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1447 microversion: 2.75 time: 0.760870 Oct 04 20:43:26.163622 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 939/1802] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:25 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1447 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:26.211800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-609074313", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3fe9fa00-ea40-44c6-8d74-c6204519a84b"}], "block_device_mapping_v2": [{"uuid": "48838fe9-ab96-48dd-8177-1e3a740b1c6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:26.442291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] validate_networks() for [('3fe9fa00-ea40-44c6-8d74-c6204519a84b', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:26.509605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:26.511710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:26.513112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:26.514537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:26.517580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:26.557272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.558782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.572041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.574180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.575545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.576878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.627265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Getting quotas for project b140ef409c584577b0a50ebd93462100. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:26.670540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Getting quotas for user d712684a4e574a8bb9276c4776ba9308 and project b140ef409c584577b0a50ebd93462100. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:26.732647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Going to run 3 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:43:26.748504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:27.221792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=21a115a6-299c-4e24-863d-711f802836db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:27.568763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=c4491873-918f-4941-bdb9-4acef580877b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:28.109722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-24d097ce-4da2-4fa0-ba94-ab6d0ce089c2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.495761 Oct 04 20:43:28.131735 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 864/1803] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 9520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:43:28.144529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:28.147338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:28.171508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.175595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.179416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.191613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.194582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.196052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.384044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.417785 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca3b129a-e67c-45d9-a9b4-9d01bb684ef0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1210 microversion: 2.1 time: 2.281356 Oct 04 20:43:30.421021 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 865/1804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:28 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1210 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:30.451668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.453370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.468319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.469651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.470645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.472431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.473634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.474601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.327284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:31.366506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:31.373630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:31.404979 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb3f9a3e-0fa4-409e-b959-fd86eddd7542 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1453 microversion: 2.75 time: 0.974265 Oct 04 20:43:31.419291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 866/1805] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1453 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:31.460262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:31.470739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:31.473175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:31.532250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.533954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.535597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.537923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.539651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.542856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.870022 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2bf3a1aa-d0f2-4c77-a524-3139c78cc627 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.431855 Oct 04 20:43:31.887644 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 867/1806] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:43:31 2022] GET /compute/v2.1/servers => generated 1018 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:31.941455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:31.967189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.012826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.013720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.030991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.032495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.036309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.040968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.163489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:33.056993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:33.057769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:33.058613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:33.059413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:33.060164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:33.114351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.114351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.114351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.118907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.123315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.124252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.220676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:33.235832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Getting quotas for user 07dfa4ed8d314142a365c3e67fe5b334 and project ccb7a2196402402a880493998d67e44b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:33.489858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:33.494625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:43:33.501492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48838fe9-ab96-48dd-8177-1e3a740b1c6d',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:33.549275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-378d330e-f431-4cbb-b7c7-9d9994b7b35b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1210 microversion: 2.1 time: 1.657757 Oct 04 20:43:33.557850 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 868/1807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:31 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1210 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:33.600709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1933891c-69c8-43a8-a0f5-3fe43156d41a tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:33.612629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1933891c-69c8-43a8-a0f5-3fe43156d41a tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.042197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1933891c-69c8-43a8-a0f5-3fe43156d41a tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.090914 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1933891c-69c8-43a8-a0f5-3fe43156d41a tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1223 microversion: 2.1 time: 0.517688 Oct 04 20:43:34.095775 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 869/1808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:33 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1223 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:34.130049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:34.135197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.156786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.158261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.159847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.161938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.163226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.164797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.485701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.524176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.531525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.547414 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43509b64-a531-4082-983f-52bc5ecea5c8 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1438 microversion: 2.75 time: 0.448504 Oct 04 20:43:34.549805 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 870/1809] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:34 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1438 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:34.614979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:34.620937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.639503 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-253bc3e6-bc93-4db6-ab48-df51605595c3 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 8.473201 Oct 04 20:43:34.641314 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 940/1810] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 8477 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.652828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.689331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:35.713171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:35.752385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.759846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.760895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.761803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.762293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.762852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.130645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:36.130645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:36.130645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:36.130645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:36.130645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:36.586092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:36.617599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.647370 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc5b8589-a4d1-4654-88fc-62dfef6fdb39 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1210 microversion: 2.1 time: 2.038883 Oct 04 20:43:36.650846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 871/1811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:34 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1210 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:36.664034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.665291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.666409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.672757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.680719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.694750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.698714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.703936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.050449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.096191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.100004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.102284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a7952b2-8e4d-4dd3-89df-a4357b2b82da tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1103 microversion: 2.25 time: 0.445515 Oct 04 20:43:37.116899 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 872/1812] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1103 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:37.131342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:37.143119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.165614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.170137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.170137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.174442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.184790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.185817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.636814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:37.716028 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18c1e727-2032-4186-b861-34b9f5abd1df tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa/action" status: 202 len: 1944 microversion: 2.75 time: 3.049856 Oct 04 20:43:37.720042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 941/1813] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:43:34 2022] POST /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa/action => generated 1944 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:43:37.731256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6187bfca-683c-4123-8206-13eced3172fb", "tag": "373aca16-4551-4b3b-a9a3-90cfa2cb9f28"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:37.751870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.753083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.754131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.781124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] Creating event network-changed:373aca16-4551-4b3b-a9a3-90cfa2cb9f28 for instance 6187bfca-683c-4123-8206-13eced3172fb on n-h2-851029-13 Oct 04 20:43:37.793368 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ca1a553e-3165-4f00-94af-281320b4161e req-17d3e29a-cf42-47db-af26-d942f2af3838 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070400 Oct 04 20:43:37.804097 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 942/1814] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:37.816469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:37.818324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.833326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.835075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.836214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.838117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.844542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.845366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.558195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:38.577869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8ed8a20-ff08-4aed-9731-7f61df74dff5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1275 microversion: 2.1 time: 1.458903 Oct 04 20:43:38.593122 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 873/1815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:37 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1275 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:38.619661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:38.620952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:38.667609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.668627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.669519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.673859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.675195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.680657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.312613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:39.360864 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cc01e49-9573-4c24-8e47-67c2ed661b97 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 0.765076 Oct 04 20:43:39.363173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 874/1816] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:38 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:39.374634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:39.376534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:39.398777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.398777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.398777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.398777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.402998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.404425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.671650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.699652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0932b31e-ef28-453c-aae4-1bdc63f00146 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 1.892421 Oct 04 20:43:39.701187 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 943/1817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:37 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:39.731262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:39.735954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:39.761209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.762567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.763677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.777796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.782143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.789288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.812378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.846435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.855599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.864731 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-208d67b3-f46e-4d53-b041-be27b74c4aa7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1176 microversion: 2.25 time: 0.499110 Oct 04 20:43:39.866853 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 875/1818] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:39 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1176 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:40.171203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.229489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d66047a-6b87-48b0-b82c-a78069c24540 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1293 microversion: 2.1 time: 0.521037 Oct 04 20:43:40.231048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 944/1819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:39 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1293 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:40.423040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:40.426549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:40.452008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.455978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.457275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.460501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.464046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.469501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.768742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:40.781069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:40.828054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.829455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.830192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.831429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.841406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.842215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.092677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:41.171126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6a080ce-555a-411e-8444-a6efd20b6580 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 0.755383 Oct 04 20:43:41.182897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 876/1820] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:40 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:41.182897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.184201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:41.198787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.200121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.201200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.202926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.204767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.206874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.651596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:41.687898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:41.749081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:41.752944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:41.755360 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-efbbfc9b-579d-4d90-b84e-dbe84854b7e8 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1232 microversion: 2.25 time: 0.580762 Oct 04 20:43:41.772753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 877/1821] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1232 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:41.801672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.803851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:41.817770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.819715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.820897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.822523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.823771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.825156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.128565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.165702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c26207e2-d1bc-45d3-a181-2b7408082fea tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1281 microversion: 2.1 time: 0.390646 Oct 04 20:43:42.168186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 878/1822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:42.234490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.237799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.265254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.266070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.271138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.274762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.275634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.278835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.545402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.594458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c560306-4df8-4a6e-891c-c570a6ecd6f2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 1.843227 Oct 04 20:43:42.603329 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 945/1823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:40 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:42.810830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.813326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.832181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.834488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.836239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.838377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.839725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.844398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:43.182270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:43.256576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:43.615813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:43.717679 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50d68f8b-e18c-4a9e-a9bc-ca18015bf7c8 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 1.492382 Oct 04 20:43:43.723371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 879/1824] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:42 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:43.744567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:43.746098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:43.771648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:43.771648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:43.775227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:43.779838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:43.781122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:43.785428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.345684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.378452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.387410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.395771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-398a9f14-ea2d-466e-9541-28dddd3e5c91 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1250 microversion: 2.25 time: 1.592663 Oct 04 20:43:44.397787 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 946/1825] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:42 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1250 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:44.414491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:44.420270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:44.439225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.440648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.443631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.445812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.447133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.448281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.793327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:45.853207 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5711def4-f255-4be6-9306-4fd6fd97540f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1281 microversion: 2.1 time: 2.126697 Oct 04 20:43:45.859157 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 880/1826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:43 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1281 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:45.886635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:45.888314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:45.914087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.914999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.930129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.935490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.936475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.937346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:46.464037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:46.491068 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e88eba87-312e-467d-81fa-b232ba4d45a0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 2.090205 Oct 04 20:43:46.492898 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 947/1827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:44 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:46.501154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:46.502654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:46.513113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:46.516431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:46.517631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:46.518612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:46.520090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:46.521286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:46.522305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.070715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:47.083357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:47.183075 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ec41a62-480c-4523-a03c-b9fcd522042b tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 1.321843 Oct 04 20:43:47.189531 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 881/1828] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:45 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:47.199120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.206524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:47.221899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.223465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.225855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.228352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.229607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.230697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.623495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:48.656619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:48.660316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:48.675077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:48.683679 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a95b944-954b-40fb-b09c-99f44c91f8e9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1250 microversion: 2.25 time: 2.187556 Oct 04 20:43:48.694763 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 948/1829] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:46 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1250 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:48.710873 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a849c8ac-f663-45cc-8719-6cec3e1aa285 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1281 microversion: 2.1 time: 1.504812 Oct 04 20:43:48.712450 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 882/1830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1281 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:48.771817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:48.774637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:48.798881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.802531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.803958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.807567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.812724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.814917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.597136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:49.599902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:49.618226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:49.622112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:49.622112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.622112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:49.622112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:49.623012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.871434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:49.969699 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3f274f1-b550-4e47-b290-c0cfb6b92258 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 1.252642 Oct 04 20:43:49.992159 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 883/1831] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:48 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:50.067263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:50.068857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.097803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.103331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.105488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.110988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.113930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.116237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.501727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.564956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.587676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.599981 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6f95b1e-417e-41d4-8392-01d3e8bd4379 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1250 microversion: 2.25 time: 0.599405 Oct 04 20:43:50.601527 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 884/1832] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:49 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1250 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:50.648228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:50.650211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.703265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.705004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.710480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.716790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.718092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.724278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.804952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:51.267896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:51.299492 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d6634bb-4ec5-4eec-a7d2-85a7d1d8ce3e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1281 microversion: 2.1 time: 0.689832 Oct 04 20:43:51.323413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 885/1833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:50 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1281 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:51.355933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:51.357835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:51.372549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.375128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.376599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.376854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:51.380422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.382139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.384427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.403757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e69f4ba-6d63-4142-b841-9f7e543a6b69 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 2.715713 Oct 04 20:43:51.406107 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 949/1834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:48 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:51.657170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:51.660884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:51.695124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.699267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.701010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.708323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.710719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.712481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.735724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:51.920452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:52.152854 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0baf3b7e-f2aa-47ed-a6e1-921e3524c751 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 0.812603 Oct 04 20:43:52.154028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 886/1835] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:51 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:52.357603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.366756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:52.409498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.417959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.421118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:52.423323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.425564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.432690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.890247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:53.923791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd8b491c-10de-480f-b66a-6031af8090a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 1.573612 Oct 04 20:43:53.931908 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 887/1836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:52 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:53.952823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:53.958290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:53.966313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:53.969534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.970949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.972290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.973978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.975865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.977068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:54.925695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:54.991408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.007644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.017234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7614e939-78c6-4bc1-866f-d33d4aea6007 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1292 microversion: 2.25 time: 3.371399 Oct 04 20:43:55.022999 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 950/1837] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:51 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1292 bytes in 3379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:43:55.045860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:55.062378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:55.133879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.139681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.144823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.150741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.151903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.152713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.532374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.574623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:55.598233 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26e2c560-e885-4561-80c9-f38552d9273c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 1.656923 Oct 04 20:43:55.604205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 888/1838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:53 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:55.631477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6187bfca-683c-4123-8206-13eced3172fb", "name": "network-vif-plugged", "status": "completed", "tag": "373aca16-4551-4b3b-a9a3-90cfa2cb9f28"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:55.654478 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8be8c161-ff31-4c5a-ab09-b4895ebd6bb5 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1931 microversion: 2.75 time: 0.628876 Oct 04 20:43:55.656600 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 951/1839] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:55 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1931 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:55.694861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.694861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.697657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.704634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:55.711769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:55.760949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.761987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.771884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.773548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.774425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.775359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.781434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] Creating event network-vif-plugged:373aca16-4551-4b3b-a9a3-90cfa2cb9f28 for instance 6187bfca-683c-4123-8206-13eced3172fb on n-h2-851029-13 Oct 04 20:43:55.807716 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-55d656cf-3396-45f3-9186-e0b41dfc2070 req-e3b31667-27ae-451c-af55-be14cf25e2c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196115 Oct 04 20:43:55.812857 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 889/1840] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:56.385639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0fa03c8-939a-45e8-b8bd-1d8d674e4a11 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5f44940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1551559250", "description": "tempest-description-617160863"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:57.360306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.394164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f660f593-86b8-4ca0-a474-c04fe549bcf5 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 1.715692 Oct 04 20:43:57.400793 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 952/1841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:55 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:57.423971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:57.440657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:57.456170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.459538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.463243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.470567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.470567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.470567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.080109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.103729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0fa03c8-939a-45e8-b8bd-1d8d674e4a11 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.287684 Oct 04 20:43:59.105599 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 890/1842] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:43:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:59.140572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.140572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.141467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:59.141678 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e2a02ed-ba38-4cef-a887-aeba0cc94466 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1292 microversion: 2.25 time: 1.725168 Oct 04 20:43:59.143397 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 953/1843] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:57 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1292 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:59.152989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:59.163460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:59.164536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:59.185203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.186869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.188029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.189871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.191209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.192511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.214645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.218714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.220540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.228212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.233719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.236137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:00.876432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] Lazy-loading 'services' on Instance uuid c7d1a43c-90a6-4aa1-9bb5-236b643dafaa {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:00.964654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2f549ad-51ed-44a3-b8d5-1574ebc251a2 tempest-ServersAdmin275Test-632021976 tempest-ServersAdmin275Test-632021976-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1922 microversion: 2.75 time: 1.818857 Oct 04 20:44:00.966140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 954/1844] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:59 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1922 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:00.982216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:00.990208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:01.039371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:01.041178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:01.042472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:01.044668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:01.045982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:01.047628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:01.443727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:01.531416 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6b35767-30d7-4a2e-b426-5a74d1f899f8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1198 microversion: 2.1 time: 2.423229 Oct 04 20:44:01.542758 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 891/1845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:59 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1198 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:01.770460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] Calling method '.version_select at 0x7f54f5eb6310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:02.798229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc could not be found", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:44:02.800357 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] HTTP exception thrown: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] Request method failure captured: Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-floating-ips/4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc HTTP/1.1 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsOZzjOwFXhI7GIbLFknAiqBPc4Kg_X0YWHgr8ssa4zn7thdUCQdqT-TlTjC7za8ZE9qLYDmL8Uj4jxukncOZHBGVN2KGDMTdAJ_nQa5abLvqGr55vbBMQ6VSsONlIPMTK5X9xWLu6kfrBU9yfjkxtNa_nXk5Sl7A3BauwqgEEnuC0 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5556b024b9b14bc5b8d39b6c908af651 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-826335001 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5556b024b9b14bc5b8d39b6c908af651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5556b024b9b14bc5b8d39b6c908af651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5556b024b9b14bc5b8d39b6c908af651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5556b024b9b14bc5b8d39b6c908af651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-826335001 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5556b024b9b14bc5b8d39b6c908af651 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-826335001 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-826335001-project Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 1a9dcc4c29c4436c9535a61a7adc79c0 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-826335001-project Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: exception: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc'} Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc could not be found Oct 04 20:44:02.809352 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa24879b-e361-4064-8d6a-257463c9033e'] Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc. Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] Returning 404 to user: Floating IP not found for ID 4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:02.824244 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-49195de1-c07c-4e67-9a1f-324336f7c86a tempest-FloatingIPDetailsNegativeTestJSON-826335001 tempest-FloatingIPDetailsNegativeTestJSON-826335001-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc" status: 404 len: 111 microversion: 2.1 time: 1.271922 Oct 04 20:44:02.832458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 892/1846] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:44:01 2022] GET /compute/v2.1/os-floating-ips/4e411eea-e7f4-4cd2-ac8a-dbd7f4b914dc => generated 111 bytes in 1289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:02.840340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:02.866643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0d7b2a-9e25-47f4-8062-3aa5351874de", "tag": "8ebe85e4-58da-4107-a0fa-22e379ecbf5b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:02.876128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb817f29-2ccb-456d-9db9-262f8f9dc06f tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 1.907655 Oct 04 20:44:02.899412 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 955/1847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:00 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:02.923398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:02.924634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5828f89-288c-4bf8-a328-946601674d63 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5fbdaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1722772571", "description": "tempest-description-1788301223"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:02.925023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:02.926089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:02.997038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] Creating event network-changed:8ebe85e4-58da-4107-a0fa-22e379ecbf5b for instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de on n-h2-851029-13 Oct 04 20:44:03.023786 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e65f52ea-bdef-4cac-b842-f9697baa041b req-703d6a0b-785f-4ab7-8371-3955a70abdef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185212 Oct 04 20:44:03.036004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 893/1848] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:03.057198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:03.063089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:03.090013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:03.092166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:03.093709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:03.096458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:03.097796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:03.099685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:06.252047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:06.307606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:06.307606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:06.307606 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a73f3e4-058b-4301-b859-5024146a6106 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 3.263957 Oct 04 20:44:06.307606 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 894/1849] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:03 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 3272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:06.314091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:06.328431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:06.345969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:06.350559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:06.360323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:06.362325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:06.363532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:06.365173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:06.374621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5828f89-288c-4bf8-a328-946601674d63 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 3.485112 Oct 04 20:44:06.375801 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 956/1850] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:44:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:06.425053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:06.429861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:06.479570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:06.480595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:06.483400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:06.487948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:06.489470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:06.490355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:06.503336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.050707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27ccdf43-4faa-467b-a63c-66c317545198 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 204 len: 0 microversion: 2.75 time: 0.747518 Oct 04 20:44:07.052324 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 895/1851] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:44:06 2022] DELETE /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:44:07.074875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:07.080147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:07.117732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.120282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.121326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.122348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.123222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.123937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.084177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:10.097030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:10.151612 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d14c494-5dfc-42e2-94d3-18baa6f4527c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 3.096571 Oct 04 20:44:10.156969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45435dc9-f001-48ab-b593-6575357860f6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1381 microversion: 2.1 time: 3.777807 Oct 04 20:44:10.159310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 896/1852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:07 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 3106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:10.183640 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 957/1853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:06 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1381 bytes in 3807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:10.209223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-538867505", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6b279778-73dc-45a0-a2d0-29f7f54659a3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:10.218382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c83d26-8216-4085-9143-ad9c3f90961e", "tag": "e583e59b-6d6c-445e-90fe-8154329b026e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:10.293704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.294526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.295332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.360962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] validate_networks() for [('6b279778-73dc-45a0-a2d0-29f7f54659a3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:10.386890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] Creating event network-changed:e583e59b-6d6c-445e-90fe-8154329b026e for instance b8c83d26-8216-4085-9143-ad9c3f90961e on n-h1-851029-13 Oct 04 20:44:10.404235 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5344485a-7bce-44cb-aa7b-2a36df2726c2 req-f71df554-5d06-41ff-88cc-e3ad02e946e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242027 Oct 04 20:44:10.410867 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 897/1854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:10.436211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:10.442141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:10.471914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.472839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.474386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.476381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.477243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.478061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:12.591656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:12.619014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:12.623453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1be25515d1574f869862c54cb9f53aa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53e30efd2ef49f7af3648c2000ed570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:12.636982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40225227-4c0f-4d35-9433-5a31e1d3bbf5 tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 200 len: 1444 microversion: 2.75 time: 2.223148 Oct 04 20:44:12.639646 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 898/1855] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:10 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 1444 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:12.652134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:12.654404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:12.671084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:12.672990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:12.674365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:12.676310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:12.677875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:12.687674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:14.669743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.693849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.699749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.703556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf83a417-de79-4b4b-80fd-45a180d84830 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 2.059763 Oct 04 20:44:14.705808 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 899/1856] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:12 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:14.716750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:14.718854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:14.734006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:14.738758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:14.740141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:14.742070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:14.743824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:14.745084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.015048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a58e2438-4e6e-428d-8f59-2eef7e388287 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1534 microversion: 2.1 time: 1.306242 Oct 04 20:44:16.018283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 900/1857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:14 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1534 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:16.031412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:16.033925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:16.047791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.049171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.053189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.057969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.059534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.061020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.470157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:16.471204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:16.472698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:16.474027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:16.477292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:16.543251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.549097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.552521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.553506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.560906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.563574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.630097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Getting quotas for project e78ca76042274942a3d5592439330eaa. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:16.649518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Getting quotas for user 724b09e312294ce0a908c9ba77b6fb07 and project e78ca76042274942a3d5592439330eaa. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:16.680305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:16.687975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:16.939814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:16.972190 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2d35fbf-3404-431d-bd07-0245cd73ce17 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 0.949903 Oct 04 20:44:16.987232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 901/1858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:16 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:17.000114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a115a6-299c-4e24-863d-711f802836db", "tag": "cf13eada-86b7-4775-b1dc-e8f7103c27f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:17.030468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.032919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.032919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.050579 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30d3403a-65d1-49cc-808f-d79930920c36 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.864507 Oct 04 20:44:17.052368 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 958/1859] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 6868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:17.071828 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] Creating event network-changed:cf13eada-86b7-4775-b1dc-e8f7103c27f4 for instance 21a115a6-299c-4e24-863d-711f802836db on n-h1-851029-13 Oct 04 20:44:17.082582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f27f4768-3b4d-41d6-add4-e74a7970d851 req-cc1a6ed7-0e64-480f-8432-68ed85e5ed35 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105885 Oct 04 20:44:17.083292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:17.084229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 902/1860] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:17.084461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] [instance: c7d1a43c-90a6-4aa1-9bb5-236b643dafaa] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:17.095040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:17.097016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:17.101127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:17.112982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.114969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.115955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.116754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.118134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.119052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.119872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.120827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.131130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.135530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.138831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.139687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.199423 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] HTTP exception thrown: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Request method failure captured: Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa HTTP/1.1 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJq-srpt2Ud9_S-zu1_s4AqKXD6U-Ab_y7QV08lHCENZeG4mqYA6Xm_KxpXI5YInX0YkCwSfjDZw9TT-b-aGr7RtwBbFyqaPyJRNNNWWS54hdSDO0GGQwN0oBy0y-6w9fivNs0ICNW13yRZ3V29_H7gOBLVrvkDdN5EJoQrC6n96_gg Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c53e30efd2ef49f7af3648c2000ed570 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdmin275Test-1534476400 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c53e30efd2ef49f7af3648c2000ed570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c53e30efd2ef49f7af3648c2000ed570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c53e30efd2ef49f7af3648c2000ed570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c53e30efd2ef49f7af3648c2000ed570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdmin275Test-1534476400 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c53e30efd2ef49f7af3648c2000ed570 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdmin275Test-1534476400 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdmin275Test-1534476400-project Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 1be25515d1574f869862c54cb9f53aa9 Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdmin275Test-1534476400-project Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c7d1a43c-90a6-4aa1-9bb5-236b643dafaa'} Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:17.201461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] Returning 404 to user: Instance c7d1a43c-90a6-4aa1-9bb5-236b643dafaa could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb0364b9-4dab-47d8-bf4e-fbed6ab8dd5d tempest-ServersAdmin275Test-1534476400 tempest-ServersAdmin275Test-1534476400-project] 10.222.0.36 "GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa" status: 404 len: 111 microversion: 2.75 time: 0.154281 Oct 04 20:44:17.225118 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 959/1861] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:17 2022] GET /compute/v2.1/servers/c7d1a43c-90a6-4aa1-9bb5-236b643dafaa => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:44:17.231944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:17.233011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:17.261608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.262511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.263314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.264538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.265329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.267198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:19.174350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:19.239699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:19.253145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:19.259611 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8982f1b4-d017-4e51-b35a-57d262a5b597 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 2.172489 Oct 04 20:44:19.318852 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 903/1862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:17 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:19.360669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4e92730-fe7b-4440-af33-9c62b68a2392 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:19.364740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4e92730-fe7b-4440-af33-9c62b68a2392 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:20.264216 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-116a966e-38b5-4c1d-9968-9c25a20688f2 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1534 microversion: 2.1 time: 3.039070 Oct 04 20:44:20.265304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 960/1863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:17 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1534 bytes in 3042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:20.287511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4e92730-fe7b-4440-af33-9c62b68a2392 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:20.315764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:20.316717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:20.342603 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4e92730-fe7b-4440-af33-9c62b68a2392 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1215 microversion: 2.1 time: 1.013320 Oct 04 20:44:20.349846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 904/1864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:19 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1215 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:20.354527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.355451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.356241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.357530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.358352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.367457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.419770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4491873-918f-4941-bdb9-4acef580877b", "tag": "ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:20.433647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.434819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.435834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.476749 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] Creating event network-changed:ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165 for instance c4491873-918f-4941-bdb9-4acef580877b on n-h1-851029-13 Oct 04 20:44:20.499741 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8960055b-34ee-41b1-b971-3925050b111e req-7d6aa639-e2de-4042-8b11-0c5a1552edab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140667 Oct 04 20:44:20.501278 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 905/1865] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:20.521766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:20.537412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.539880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.541564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.545187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.546848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.549477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.654651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3de43394-45f6-4d6d-899e-995cda792b2c tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.134057 Oct 04 20:44:20.656892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 906/1866] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 20:44:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:20.671340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:20.673877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:20.689383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.691344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.694883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.699413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:20.702036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:20.703671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.711050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:23.158711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:23.171194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=59 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:23.218511 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c94353a-9fdc-4495-879c-fb8cac842fd2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1323 microversion: 2.1 time: 2.908770 Oct 04 20:44:23.223710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 961/1867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:20 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1323 bytes in 2958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:23.249488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851029-13", "block_migration": false, "disk_over_commit": false}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:23.287089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:23.315260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.321730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.324459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.329978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.334286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.335698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.669677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:23.729900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lazy-loading 'flavor' on Instance uuid 6187bfca-683c-4123-8206-13eced3172fb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:23.732121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:23.747537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:23.758647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f601a58b-04fd-4755-97b1-da557aa13c42 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 3.090479 Oct 04 20:44:23.776289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Going to try to live migrate instance to n-h1-851029-13 {{(pid=123541) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:44:23.776983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 907/1868] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:20 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:23.808203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0d7b2a-9e25-47f4-8062-3aa5351874de", "name": "network-vif-plugged", "status": "completed", "tag": "8ebe85e4-58da-4107-a0fa-22e379ecbf5b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:23.861430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.868183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.869370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.938001 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] Creating event network-vif-plugged:8ebe85e4-58da-4107-a0fa-22e379ecbf5b for instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de on n-h2-851029-13 Oct 04 20:44:23.979532 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f3daa04c-e466-4ac7-9a54-2acdb28555a5 req-a88229bb-97d0-49f8-93d4-40e212bdb10b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185454 Oct 04 20:44:23.981727 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 908/1869] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:23.993302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:23.996368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:24.009874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:24.011559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:24.012964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:24.014910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:24.016261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:24.017722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:24.510735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:24.542947 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-732b7157-3296-437b-afa3-67ac9eb31c4b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1285 microversion: 2.1 time: 0.551160 Oct 04 20:44:24.546601 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 909/1870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:23 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1285 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:25.400562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1117714213", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:25.473029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:25.705996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] validate_networks() for [('6fd249d8-c256-417a-87c4-180a9bfbe1b4', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:26.606325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:26.665768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:30.308673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:30.580588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:32.578712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:32.578712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:32.580062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:32.583780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:32.584838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:32.659426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.663493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.667108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.670905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.677499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.678871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.790368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Getting quotas for project ddf310becc0c4397bd445094a9c00b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:32.813198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Getting quotas for user 03d29b83a0a248fa9efaaa0e7bb4f4aa and project ddf310becc0c4397bd445094a9c00b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:32.888782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:32.902328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:33.421888 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb288885-c469-42ad-a184-3f6ebddd448c tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.855972 Oct 04 20:44:33.437705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 910/1871] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 8890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:33.469275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:33.470383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:33.502460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.503572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.507451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.509013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.509920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.510773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.906975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:34.161835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.202563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6320a65b-22bd-4cb9-a9b2-ab6101ed9592 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 200 len: 1516 microversion: 2.1 time: 0.761203 Oct 04 20:44:34.219043 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 911/1872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:33 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 1516 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:34.286019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:34.290170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:34.315300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.316525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.325550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.327608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.328991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.330820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.515973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:34.871834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.905076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.910367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.911317 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d1f2d7f-9f49-4f82-8227-8a1580fd0b94 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 0.665647 Oct 04 20:44:34.912642 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 912/1873] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:34 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:34.949267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:34.950408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:34.987400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.989828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.990770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.996941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.997981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.998938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.611985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:35.694833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58289256-e1a0-4829-bddf-7cdf79f1f545 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 0.753682 Oct 04 20:44:35.704267 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 913/1874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:34 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:35.739472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a115a6-299c-4e24-863d-711f802836db", "name": "network-vif-plugged", "status": "completed", "tag": "cf13eada-86b7-4775-b1dc-e8f7103c27f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:35.768963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.770101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.771029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.823115 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bbdcd39d-0bb7-4969-ac0d-c4af0146485f tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb/action" status: 202 len: 0 microversion: 2.1 time: 12.596231 Oct 04 20:44:35.825643 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 962/1875] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:44:23 2022] POST /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb/action => generated 0 bytes in 12600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:44:35.852469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] Creating event network-vif-plugged:cf13eada-86b7-4775-b1dc-e8f7103c27f4 for instance 21a115a6-299c-4e24-863d-711f802836db on n-h1-851029-13 Oct 04 20:44:35.858453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-714eede4-90ab-4f82-bd59-b6016127b2d2 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:35.869752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-714eede4-90ab-4f82-bd59-b6016127b2d2 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:35.888388 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7c19a3a4-bf98-47ff-9e6d-cea393d88ff4 req-985ce2e7-c550-48f5-ac0b-2b3df5665dc1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177945 Oct 04 20:44:35.919971 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 914/1876] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:35.951818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:35.953407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:35.987764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.995398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.999749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.999749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.004121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.006000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.461408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-714eede4-90ab-4f82-bd59-b6016127b2d2 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:36.483960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-714eede4-90ab-4f82-bd59-b6016127b2d2 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1224 microversion: 2.1 time: 0.655365 Oct 04 20:44:36.497712 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 963/1877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:35 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1224 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:36.497712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d12de0e-6985-4a69-af9c-b75cb45c37c0", "tag": "00157779-9dd6-4cb6-81ab-0387105a55a1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:36.522496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.524088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.526296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.605891 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] Creating event network-changed:00157779-9dd6-4cb6-81ab-0387105a55a1 for instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 on n-h2-851029-13 Oct 04 20:44:36.631589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8ab934c6-5a7c-4a33-9af7-d5eb82089177 req-0e9305ec-3665-4419-9cb5-291e61c11d64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139340 Oct 04 20:44:36.634045 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 964/1878] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:36.654124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:36.656409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:36.685216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.686506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.691028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.700570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.708087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.713520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.745459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:36.771894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c31cfa9-446b-4f7d-9175-2d8c34737816 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1323 microversion: 2.1 time: 0.844992 Oct 04 20:44:36.781077 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 915/1879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:35 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:36.797300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:36.815160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:36.853985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.854705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.855517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.874413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.877328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.886284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.543415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:37.568099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:37.572213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:37.574998 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0e81358-3bde-4d3c-b4ab-29a3e524d1f7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 0.796095 Oct 04 20:44:37.576261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 916/1880] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:36 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:37.586768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.588532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.603365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.604786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.606234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.608053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.611418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.612990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.685011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:37.745303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7cdce588-7ae9-4fe2-9141-104519ec5b31 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.107651 Oct 04 20:44:37.747185 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 965/1881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:36 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:37.769235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.770585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.811542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.818957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.820170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.821590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.835416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.843711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.951763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:39.006613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a0ea000-9616-4bb1-868a-77aa84df5c5a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1220 microversion: 2.1 time: 1.253587 Oct 04 20:44:39.010256 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 966/1882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:37 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1220 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:39.021667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.023501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:39.044574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.050828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.052005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.053426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.054231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.055141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.672370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:39.731588 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50c95852-a154-4b01-834b-88dd9ba59a3c tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 2.152829 Oct 04 20:44:39.739734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 917/1883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:37 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:39.755505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c83d26-8216-4085-9143-ad9c3f90961e", "name": "network-vif-plugged", "status": "completed", "tag": "e583e59b-6d6c-445e-90fe-8154329b026e"}, {"server_uuid": "c4491873-918f-4941-bdb9-4acef580877b", "name": "network-vif-plugged", "status": "completed", "tag": "ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:39.797288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.799037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.802234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.841958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Creating event network-vif-plugged:e583e59b-6d6c-445e-90fe-8154329b026e for instance b8c83d26-8216-4085-9143-ad9c3f90961e on n-h1-851029-13 Oct 04 20:44:39.843084 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] Creating event network-vif-plugged:ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165 for instance c4491873-918f-4941-bdb9-4acef580877b on n-h1-851029-13 Oct 04 20:44:39.867811 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0429a63e-27a6-481e-9be1-4acce5fd06e4 req-92a6330e-331e-4b8a-99f8-0a292434d2f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125447 Oct 04 20:44:39.869424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 918/1884] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:39.897981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.905208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:39.932995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.933905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.937728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.943177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.943177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.943177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.087666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.105913 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c11404d-c874-4956-98dc-f12d217377e0 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1323 microversion: 2.1 time: 1.092757 Oct 04 20:44:40.120763 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 967/1885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1323 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.120763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:40.120763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:40.138381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.142148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.146508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.148760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.150133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.152119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.936602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.971648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.974116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.976082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63539b90-3fe9-4ce8-a0c6-770266de23c9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 1.103686 Oct 04 20:44:40.978713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.984077 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 919/1886] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:41.034173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4ee2fcd-1c88-4e97-884b-814447b2b01b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 0.923654 Oct 04 20:44:41.037237 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 968/1887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:40 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:41.050141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.053216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.076308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.080514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.083828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.087794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.092100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.097701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.338759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:41.368458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-967bb258-0d17-449d-af00-a55cdf2428e4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1276 microversion: 2.1 time: 0.329113 Oct 04 20:44:41.396332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 969/1888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:41.420019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.422640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.435121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.436574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.437760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.439698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.440894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.443181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.521426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Action: 'create', calling method: .version_select at 0x7f54f5e063a0>, body: {"keypair": {"name": "tempest-keypair-222605186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt6cLs4E7xkO1YOX4FXTpz5am+QVsCxxYO4NOrWa0qW+ekztdopyEnERlIgfuyaIzwDpii7NEIXUDcBqBjBUuIDPDF1o9Knjs93uFMmOku57DFqZV27Eivt4tYQ9soFw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:41.565119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:41.577536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for user 9a7cb787dae04a1c9c481438fa8cb9bb and project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:41.604040 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:44:42.080571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:42.104550 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e17193fe-31fd-42a5-9e6d-67ccfd67d6ae tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 0.706235 Oct 04 20:44:42.107392 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 970/1889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:42.156524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.158224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.176884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.178551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.180371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.182075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.184771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.186058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.617552 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45264. Oct 04 20:44:42.661035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:42.706972 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96f0c9e1-ae08-4027-88aa-1f1e90b474e8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1323 microversion: 2.1 time: 0.572265 Oct 04 20:44:42.712871 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 971/1890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1323 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:42.730126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.734191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.745714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:42.763551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.773970 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-993616f3-49a9-4995-934f-34e96713ab29 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.783063 Oct 04 20:44:42.776019 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 920/1891] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:44:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:42.782559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.784327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.791147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.797241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.801210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.811343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.812925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.829452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.833875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.838004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.838004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.839143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.846447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.438437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.469384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef975ebc-74e9-42e3-a33f-83588abf3b25 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.691005 Oct 04 20:44:44.507670 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 921/1892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:44.517059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.518853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.534218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.534218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.534218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.535078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.536759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.537863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.931355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.959371 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5893e30-9944-4e65-8988-363050d3f5e8 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1282 microversion: 2.1 time: 0.446564 Oct 04 20:44:44.967462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 922/1893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1282 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:44.987175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.989462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.009579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.013212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.014256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.019302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.021583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.023667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.346629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.396276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.402185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.405834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-69f53171-81b6-4566-8f06-f8239aa6e784 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1280 microversion: 2.25 time: 2.689204 Oct 04 20:44:45.411975 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 972/1894] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1280 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:45.434100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:45.435959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.452456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.456447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.458621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.461275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.464123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.466123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.005644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:46.034447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb828623-3e44-46c0-a984-916f25c978a3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 1.065625 Oct 04 20:44:46.035887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 923/1895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:46.056050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.064686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:46.086721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.088120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.090542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.095985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.097092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.098084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.180359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:46.212746 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-118eb7ca-6aa5-4cfe-a550-11d70b05e57c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1517 microversion: 2.1 time: 0.797178 Oct 04 20:44:46.215162 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 973/1896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:45 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1517 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:46.238143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.240425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:46.262120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.263327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.264415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.266002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.267268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.268139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.477834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:47.542746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.577065 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4601e9e8-f9d3-4732-a38b-a12ef968855b tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.538101 Oct 04 20:44:47.599308 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 924/1897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:47.632773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:47.634916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:47.652929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:47.654458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:47.657286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:47.660204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:47.662718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:47.664138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:47.862087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.899679 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be81859f-7334-465d-aa1d-769749c8037f tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.680936 Oct 04 20:44:47.902186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 974/1898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:47.914982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:47.917388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:47.936591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:47.939072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:47.940658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:47.945374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:47.945374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:47.946239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.137619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.174304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5fae08ce-8f00-465d-88a5-9be3e9951fc9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 200 len: 1516 microversion: 2.1 time: 1.572329 Oct 04 20:44:49.175452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.193205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 925/1899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:47 2022] GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 1516 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:49.202856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.202856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.228949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.230436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.231685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.240914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.243484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.245174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.260764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.265510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.273864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47311d29-e7d1-44f6-87fe-272605ba304c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1477 microversion: 2.25 time: 1.368621 Oct 04 20:44:49.302284 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 975/1900] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:47 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1477 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:49.319035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.348891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.376525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.377805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.380351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.382141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.385547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.393088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.002911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:51.038271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7d6eb79-e10a-4644-80ad-9e61a804f0d2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.733390 Oct 04 20:44:51.040559 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 976/1901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:51.056866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:51.056866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:51.069497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.072135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.073231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.075351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.076747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.078055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.446918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:51.485281 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e8435f7-a470-426f-b957-a75d3325b029 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 2.304890 Oct 04 20:44:51.487510 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 926/1902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:51.537307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d12de0e-6985-4a69-af9c-b75cb45c37c0", "name": "network-vif-plugged", "status": "completed", "tag": "00157779-9dd6-4cb6-81ab-0387105a55a1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:51.596467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.597209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.598551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.630300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:51.635536 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] Creating event network-vif-plugged:00157779-9dd6-4cb6-81ab-0387105a55a1 for instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 on n-h2-851029-13 Oct 04 20:44:51.648301 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-238b3a3b-0daa-4676-9f07-13c8f094e055 req-6b2f084e-10c2-40d5-a37f-aa5b4972b96d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154342 Oct 04 20:44:51.650314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 927/1903] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:51.662758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:51.664959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:51.673702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.675343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.681353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.683529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.685043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.686568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.783357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:51.794214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:52.153047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.201785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72c1d1cc-0517-4a11-a93a-426712704af0 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.158204 Oct 04 20:44:52.204033 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 977/1904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:51 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:52.219595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:52.221378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:52.263937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.267698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.289591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.297499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.299128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.300404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.685817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eec26767-40e6-46c7-b72f-545b79bacff4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "DELETE /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 204 len: 0 microversion: 2.1 time: 1.024035 Oct 04 20:44:52.685817 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 928/1905] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:51 2022] DELETE /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:52.692644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:52.694033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:52.734774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.737049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.740881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.742830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.749522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.750719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.060223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid b8c83d26-8216-4085-9143-ad9c3f90961e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:54.080416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:54.156493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8bf797a1-2c7c-488a-910e-342e69c389cc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.472688 Oct 04 20:44:54.159030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 929/1906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:52 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:54.195567 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cca2ea82-ce0d-4edc-b525-31d2632c58c3 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1971 microversion: 2.25 time: 1.978636 Oct 04 20:44:54.203271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 978/1907] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:52 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1971 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:54.205008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.213781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:54.235632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.241174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:54.268789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.275472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.284495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.287925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.290970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.293260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.299718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.305177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.306270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.311755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.320379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.326020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.067860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.109412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-197cb583-2123-4b48-97ed-d54ebfb17836 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1315 microversion: 2.1 time: 1.943154 Oct 04 20:44:56.123769 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 930/1908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:54 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1315 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:56.151111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:56.154275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:56.170515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:56.204344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.211707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.212716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.214027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.214927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.215728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.456992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.492448 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f004386-3aa6-4026-af0c-2939beec58ff tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 200 len: 1522 microversion: 2.1 time: 2.281369 Oct 04 20:44:56.498389 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 979/1909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:54 2022] GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 1522 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:56.528303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:56.529774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:56.592671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.594075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.595357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.597382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.598821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.600626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.430056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:58.450053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid b8c83d26-8216-4085-9143-ad9c3f90961e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:58.569111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12f4029e-a46d-43cd-9e80-af6c38f59b33 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1971 microversion: 2.25 time: 2.068328 Oct 04 20:44:58.570378 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 980/1910] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:56 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1971 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:58.632610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:58.646367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:58.647810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:58.683519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31eaa11d-db58-4eb0-911f-5451217f886e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 2.546426 Oct 04 20:44:58.688269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 931/1911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:56 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:58.700100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.708442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:58.709177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.709632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:58.711023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.712872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.716846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.734055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.742886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.744206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.746018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.746536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.747912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.749147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.036329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:00.065789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:00.067562 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6007efcb-c05c-484a-93c6-59835bb8bfa2 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.487874 Oct 04 20:45:00.076781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 981/1912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:58 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:00.094482 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4574d86f-aefd-4270-a483-95f1e2fdc886 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1504 microversion: 2.1 time: 1.402685 Oct 04 20:45:00.095927 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 932/1913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:58 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1504 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:00.107530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.107530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:00.107894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a115a6-299c-4e24-863d-711f802836db", "name": "network-vif-unplugged", "status": "completed", "tag": "cf13eada-86b7-4775-b1dc-e8f7103c27f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:00.128942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.129995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.130757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.140827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.144780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.146209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.150473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.151837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.153070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.185867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] Creating event network-vif-unplugged:cf13eada-86b7-4775-b1dc-e8f7103c27f4 for instance 21a115a6-299c-4e24-863d-711f802836db on n-h1-851029-13 Oct 04 20:45:00.208901 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f07b25d4-9e51-4449-b9e6-5973a011ea8f req-10805656-ba11-4559-a8b0-1e135d4de69b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110561 Oct 04 20:45:00.215504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 933/1914] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:00.236309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd707b8-caa2-415d-b323-1afd09d75c04", "tag": "91b19d12-97e8-4688-bc78-31c028436c48"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:00.276819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.280158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.282342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.337870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] Creating event network-changed:91b19d12-97e8-4688-bc78-31c028436c48 for instance 3cd707b8-caa2-415d-b323-1afd09d75c04 on n-h2-851029-13 Oct 04 20:45:00.357784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-77194ae2-8d01-4fe4-a9ea-dc1e29e38143 req-4d8c39c3-d639-45a1-ae4c-406be6347233 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139565 Oct 04 20:45:00.359533 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 934/1915] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:00.376621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.384954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.387894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.387894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.389866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.391325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.392860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.453349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-acba82b3-60bf-4b1b-8c67-2960b443b39e tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.091174 Oct 04 20:45:00.467824 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 935/1916] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:45:00.482576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.484444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:00.497105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.498560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.499915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.501706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.503087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.504251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.388324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.421926 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdf12328-a899-4d05-b3b5-8be2a6d3a55b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 200 len: 1522 microversion: 2.1 time: 1.343232 Oct 04 20:45:01.422944 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 982/1917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 1522 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:01.436699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1551559250"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:01.437675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:01.469435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.470778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.474571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.477497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.481446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.482714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.624167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.656581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bff030ad-c02c-4052-82f0-f7814a1efb00 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.183025 Oct 04 20:45:01.661112 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 936/1918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:01.686240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851029-13", "block_migration": "auto"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:01.695783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:01.717605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.719030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.720404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.722323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.725759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.727004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.855377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'flavor' on Instance uuid b8c83d26-8216-4085-9143-ad9c3f90961e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:01.905764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Going to try to live migrate instance to n-h2-851029-13 {{(pid=123542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:45:02.026002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Adding security group bc87cbe0-1563-413c-999a-36e8411ba3fb to port 00157779-9dd6-4cb6-81ab-0387105a55a1 Oct 04 20:45:04.366960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae67d418-c814-4827-932e-a289ba40af80 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/action" status: 202 len: 0 microversion: 2.1 time: 2.942376 Oct 04 20:45:04.369889 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 983/1919] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:01 2022] POST /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/action => generated 0 bytes in 2946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:04.387720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-394258216", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "bfff8731-e136-4e95-bbb5-c51aff9eb7fd"}], "security_groups": [{"name": "tempest-securitygroup--706845669"}], "key_name": "tempest-keypair-222605186", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:04.435064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=45 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:04.838152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] validate_networks() for [('bfff8731-e136-4e95-bbb5-c51aff9eb7fd', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:06.591693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:06.595630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:06.599167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:06.602291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:06.603721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:06.624825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.629275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.629275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.629275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.630491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.631770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.682955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:06.694543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for user 9a7cb787dae04a1c9c481438fa8cb9bb and project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:06.729436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:06.742577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:07.215591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e388e19-72dc-4eec-9617-20b8b80da070 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.841445 Oct 04 20:45:07.230746 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 984/1920] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:07.269989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:07.274291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:07.307535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.307535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.315686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.319864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.323423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.326306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.333573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.400168 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d290a49b-baff-4a0d-a057-3e75e7b762ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.139524 Oct 04 20:45:08.463929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 985/1921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:07 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:08.517954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a115a6-299c-4e24-863d-711f802836db", "name": "network-vif-deleted", "tag": "cf13eada-86b7-4775-b1dc-e8f7103c27f4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:08.550255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.556006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.558283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.602351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] Creating event network-vif-deleted:cf13eada-86b7-4775-b1dc-e8f7103c27f4 for instance 21a115a6-299c-4e24-863d-711f802836db on n-h1-851029-13 Oct 04 20:45:08.613740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f7e88bea-5869-4689-bf8b-f411641976cf req-fdb6405c-3cce-4478-8090-c7d5cad8a67a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141435 Oct 04 20:45:08.620864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 986/1922] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:08.639947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:08.643022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:08.725822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.728062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.737336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.740766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.742568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.745367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.842393 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] HTTP exception thrown: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db HTTP/1.1 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '21a115a6-299c-4e24-863d-711f802836db'} Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:08.851538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 404 to user: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6869216-6ca0-4b2c-bf4f-47520576b912 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 404 len: 111 microversion: 2.1 time: 0.230182 Oct 04 20:45:08.874995 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 987/1923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:08 2022] GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:08.879220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:08.879717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:08.921816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.924850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.926287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.927665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.928534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.929252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.409553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:10.698638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55484d96-a5e3-4315-9721-d214ae864887 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e/action" status: 202 len: 0 microversion: 2.25 time: 9.033788 Oct 04 20:45:10.703419 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 937/1924] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 20:45:01 2022] POST /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e/action => generated 0 bytes in 9041 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:10.736757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1722772571"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:10.738023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:10.781645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.783232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.784525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.786783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.788821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.790068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.824050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:10.852580 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-735cfb03-8880-4d48-9281-6ec960d67f5e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.992410 Oct 04 20:45:10.862012 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 988/1925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:08 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:10.906420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.908462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:10.923572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.925940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.927138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.928625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.930006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.931109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.172971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.194976 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49234eb8-dd32-4fff-9e1b-85cae5208544 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1244 microversion: 2.1 time: 0.329045 Oct 04 20:45:11.196267 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 989/1926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1244 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:11.216794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.231415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.234152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:11.246214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.247708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.249215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.251124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.252867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.254931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.515972 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63dab644-c1e2-45fd-90e4-1482958e6ed6 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.317274 Oct 04 20:45:11.530715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 990/1927] 10.222.0.36 () {58 vars in 1230 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:11.698801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.security_group_api [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Adding security group e8b416d8-6293-4eda-be5b-f3577e8a5e30 to port 00157779-9dd6-4cb6-81ab-0387105a55a1 Oct 04 20:45:11.763888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-88062279", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "7799ac52-f6d5-4905-977d-0ebc15f0fd4a"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:11.889093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] validate_networks() for [('7799ac52-f6d5-4905-977d-0ebc15f0fd4a', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:14.319306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:14.320474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:14.326610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:14.326610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:14.326610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:14.373103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.373103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.373103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.373664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.374096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.382549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.431122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:14.455168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for user 9265d783835047bb8377fccd36c1fdb8 and project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:14.511893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:14.521294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:14.951272 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7f29e0d-237e-42f9-a37e-9484a0e611f3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427672 Oct 04 20:45:14.952291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 991/1928] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:14.973854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.979480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.015705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.016972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.020881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.023543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.027643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.029358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.871673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.896210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a296b3f5-9c60-481b-920d-d9cd2da0d7d4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 0.942027 Oct 04 20:45:15.898769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 992/1929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:15.918036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.919862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.937348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.939287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.940073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.941464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.942751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.943549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.973929 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3a67c9f-cf88-4d47-829f-e368e13a36a5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/action" status: 202 len: 0 microversion: 2.1 time: 5.268359 Oct 04 20:45:15.989095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 938/1930] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:10 2022] POST /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/action => generated 0 bytes in 5285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:16.004322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d12de0e-6985-4a69-af9c-b75cb45c37c0", "tag": "00157779-9dd6-4cb6-81ab-0387105a55a1"}, {"server_uuid": "6187bfca-683c-4123-8206-13eced3172fb", "name": "network-vif-unplugged", "status": "completed", "tag": "373aca16-4551-4b3b-a9a3-90cfa2cb9f28"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:16.040088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.041335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.042139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.077702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Creating event network-changed:00157779-9dd6-4cb6-81ab-0387105a55a1 for instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 on n-h2-851029-13 Oct 04 20:45:16.079605 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] Creating event network-vif-unplugged:373aca16-4551-4b3b-a9a3-90cfa2cb9f28 for instance 6187bfca-683c-4123-8206-13eced3172fb on n-h2-851029-13 Oct 04 20:45:16.098316 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-407ce6f0-ae88-44b5-85f4-4197791e1786 req-7e0586b9-8bd9-4e2c-be5d-dfd9d5da9795 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.105145 Oct 04 20:45:16.109051 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 939/1931] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:16.130081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52b2e5d4-3716-4c88-9b11-9d0f2e4723d8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52b2e5d4-3716-4c88-9b11-9d0f2e4723d8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:45:16.149690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:45:16.166526 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:16.178258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52b2e5d4-3716-4c88-9b11-9d0f2e4723d8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:16.183184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52b2e5d4-3716-4c88-9b11-9d0f2e4723d8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.071063 Oct 04 20:45:16.187231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 940/1932] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:16.212127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.215519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.236003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.239608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.243155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.246708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.248572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.250832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.978065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.045619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.061442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.068009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6861f81-3dcd-4ee8-b057-e6537f323f30 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.163343 Oct 04 20:45:17.070322 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 993/1933] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:17.097787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.101470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:17.147813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.151298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.152085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.153935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.155490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.156896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.190186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.215080 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-663a3852-1764-4dc0-99b7-5ec52f9c1e1d tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.015347 Oct 04 20:45:17.240151 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 941/1934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:17.288884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7dc8f2ac-2891-433b-9419-0c8114c0ed92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.301629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7dc8f2ac-2891-433b-9419-0c8114c0ed92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.297752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7dc8f2ac-2891-433b-9419-0c8114c0ed92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.341124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7dc8f2ac-2891-433b-9419-0c8114c0ed92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1206 microversion: 2.1 time: 1.084644 Oct 04 20:45:18.342886 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 942/1935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1206 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:18.379179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd707b8-caa2-415d-b323-1afd09d75c04", "name": "network-vif-plugged", "status": "completed", "tag": "91b19d12-97e8-4688-bc78-31c028436c48"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:18.415553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.420227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.432021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.473756 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] Creating event network-vif-plugged:91b19d12-97e8-4688-bc78-31c028436c48 for instance 3cd707b8-caa2-415d-b323-1afd09d75c04 on n-h2-851029-13 Oct 04 20:45:18.507539 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-26e51c79-5432-474a-9b81-50dda8c05bc2 req-c0155bea-ab4b-4f7b-84db-d65c2ae4605c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161796 Oct 04 20:45:18.509734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 943/1936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:18.526150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.528181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.563313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.564240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.565070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.566819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.567675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.573336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.601334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.620815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ed1cc3b-b680-4d41-b31f-6c41e2f77c6f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1365 microversion: 2.1 time: 2.543932 Oct 04 20:45:19.622406 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 994/1937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1365 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:19.667869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.680384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.682627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:19.696251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.697912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.699351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.701405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.702952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.704106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.761301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:45:19.844415 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-696736b3-02f2-4c7a-9918-bda5d5f6ef8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.205091 Oct 04 20:45:19.846373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 995/1938] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers => generated 683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:19.847951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55177b1b-f17f-4b7a-bb09-6473f70558af tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.331641 Oct 04 20:45:19.850080 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 944/1939] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0/os-security-groups => generated 1158 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:19.865763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.885910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.887073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.895864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.920159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.929542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.931873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.933779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.934645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.937171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.937690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.938346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.939421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.940055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.940895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.941333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.877579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.912858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bec47764-872c-498c-bca8-9009de48f951 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.062556 Oct 04 20:45:20.937288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.964460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 996/1940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:20.981675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6187bfca-683c-4123-8206-13eced3172fb", "tag": "373aca16-4551-4b3b-a9a3-90cfa2cb9f28"}, {"name": "network-changed", "server_uuid": "2d12de0e-6985-4a69-af9c-b75cb45c37c0", "tag": "00157779-9dd6-4cb6-81ab-0387105a55a1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:21.016221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.031551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.037932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.040254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.056125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.056539 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6f20999-12e6-4aab-87d4-2f1a4e6e58c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.180787 Oct 04 20:45:21.056539 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 945/1941] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:21.065354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.071349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.117003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.119453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.124391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.125713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.126577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.127311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.137477 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Creating event network-changed:373aca16-4551-4b3b-a9a3-90cfa2cb9f28 for instance 6187bfca-683c-4123-8206-13eced3172fb on n-h2-851029-13 Oct 04 20:45:21.138454 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] Creating event network-changed:00157779-9dd6-4cb6-81ab-0387105a55a1 for instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 on n-h2-851029-13 Oct 04 20:45:21.202844 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e3b07c09-7c1a-46a5-b798-ca96d1c71703 req-51679ebf-383c-404d-90a2-7adf2d2d78de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.235720 Oct 04 20:45:21.207671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 997/1942] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:21.235714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.240060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.275489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.276400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.277432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.284686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.285248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.285712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.684547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.707164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8fcf6fb3-00d5-4dc3-8fac-ffd7126827f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1258 microversion: 2.1 time: 0.497084 Oct 04 20:45:21.709684 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 998/1943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1258 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:21.721352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b36a3e-8320-4100-9567-baff91fcf2dd", "tag": "693240e3-8bfd-45b4-9395-71f911b5d81f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:21.766708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.770180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.771831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.817087 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] Creating event network-changed:693240e3-8bfd-45b4-9395-71f911b5d81f for instance 14b36a3e-8320-4100-9567-baff91fcf2dd on n-h2-851029-13 Oct 04 20:45:21.839921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c0e6a66c-5d53-4d3e-b637-332009e688a6 req-86220731-cf06-4dec-8e4c-d4e3307252f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124285 Oct 04 20:45:21.848085 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 999/1944] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:21.867368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.919327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.920432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.servers [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Removing options 'limit' from query {{(pid=123541) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:45:21.922330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:21.948706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.952375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.953854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.962086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.963600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.971628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.085596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:45:22.235864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7364b73c-af08-469a-8292-b9afcedd54fa tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.384514 Oct 04 20:45:22.239028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1000/1945] 10.222.0.36 () {58 vars in 1144 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:22.258830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f356ce41-69e6-4f96-91bf-e5601291a2a4 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5ddfc10>, body: {"security_group": {"name": " tempest-securitygroup -1941471419 ", "description": "tempest-description-253528257"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:22.794136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:22.853919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11838239-d849-4eeb-9531-6d0c31009e83 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1324 microversion: 2.1 time: 1.803129 Oct 04 20:45:22.861733 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 946/1946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1324 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:22.906199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.909560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:22.976523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.976523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.976523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.979468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.980673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.985833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.011537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:24.494250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:24.586720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.635985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b83ab13a-956c-4aa1-ab32-5ca8b0a89117 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1365 microversion: 2.1 time: 1.766592 Oct 04 20:45:24.638002 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 947/1947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:22 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1365 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:24.662172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.663715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.676432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f356ce41-69e6-4f96-91bf-e5601291a2a4 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 2.434447 Oct 04 20:45:24.678188 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1001/1948] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:45:22 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:24.709509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.712651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.726274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.734462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.739406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.747561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.748839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.752974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.772435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.776205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.776205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.793649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.798842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.801220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.915537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:26.109953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.147049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.152580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.158961 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c04215c3-1709-48d1-94e8-21c04462a785 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.478333 Oct 04 20:45:26.168628 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1002/1949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:26.171574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.186635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0068f7e7-c7bb-4ee8-baae-43e0595ed2db tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.207040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-547993a8-19fb-4aac-a3cc-bdfb3628fdab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.566469 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0068f7e7-c7bb-4ee8-baae-43e0595ed2db tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '-1' Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:45:26.208220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0068f7e7-c7bb-4ee8-baae-43e0595ed2db tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0068f7e7-c7bb-4ee8-baae-43e0595ed2db tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.043125 Oct 04 20:45:26.224575 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1003/1950] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:26.234473 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 948/1951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:26.247114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.249361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.256897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.268219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.289111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.291986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.292216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.292441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.292679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.292679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.293306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.293965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.294794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.295527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.298463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.299751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.670719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.698465 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22694df6-c670-403e-baa7-997efe4315a8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1264 microversion: 2.1 time: 0.467255 Oct 04 20:45:26.723775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1004/1952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1264 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:26.744404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bb5ebbe-1c8e-460c-831a-c63c1bb81d6d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5ddf1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.117795 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bb5ebbe-1c8e-460c-831a-c63c1bb81d6d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874" status: 200 len: 223 microversion: 2.1 time: 0.388669 Oct 04 20:45:27.132574 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1005/1953] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 => generated 223 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:27.167014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.168442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:27.197285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.203716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.210538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.213740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.219976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.221378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.306799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:29.712169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.740260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69e52179-2318-4830-9473-0efc79d01e3e tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1519 microversion: 2.1 time: 3.516620 Oct 04 20:45:29.769794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.770692 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 949/1954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1519 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:29.792930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cddcc953-3112-4245-a652-1417fd99ed65 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1365 microversion: 2.1 time: 2.656410 Oct 04 20:45:29.794315 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1006/1955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1365 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:29.813184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67836bde-cca3-413d-bea1-4919557966a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67836bde-cca3-413d-bea1-4919557966a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: action_args: {} Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:45:29.828532 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:29.850309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67836bde-cca3-413d-bea1-4919557966a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:29.864535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c6751d3-2ed3-442d-a792-41e97e381102 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f61673a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.864696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67836bde-cca3-413d-bea1-4919557966a9 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.074044 Oct 04 20:45:29.864696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 950/1956] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:29.901631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.905717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.943361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:29.948939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.953318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.954167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.960172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.960801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.967471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.191800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.235817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.245267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.248520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e16c379-2632-4adf-a286-ec9c5c9554cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.390720 Oct 04 20:45:31.250878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 951/1957] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:31.261986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.263686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.277429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.278636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.279911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.281883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.283173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.284864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.015259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:32.272941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.317748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f759673d-2cd0-44d4-8bdf-a6c8507965c8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.061315 Oct 04 20:45:32.323996 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 952/1958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.346113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.349110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.378632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.380782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.383480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.390346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.395251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.396854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.731034 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c6751d3-2ed3-442d-a792-41e97e381102 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874" status: 202 len: 0 microversion: 2.1 time: 2.910803 Oct 04 20:45:32.733172 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1007/1959] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:45:29 2022] DELETE /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 => generated 0 bytes in 2914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:32.755130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92ce7916-dd52-421b-958a-d325037cba5d tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.772908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92ce7916-dd52-421b-958a-d325037cba5d tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.774942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92ce7916-dd52-421b-958a-d325037cba5d tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:32.849009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.servers [None req-92ce7916-dd52-421b-958a-d325037cba5d tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Flavor 'non_existing_flavor' could not be found {{(pid=123541) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 20:45:32.851952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92ce7916-dd52-421b-958a-d325037cba5d tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.116081 Oct 04 20:45:32.869616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1008/1960] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:32.879994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4e6a95b-32a4-4673-bf79-33960dcce481 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1747401219", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4e6a95b-32a4-4673-bf79-33960dcce481 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 243 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1747401219", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1747401219', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6fd249d8-c256-417a-87c4-180a9bfbe1b4'}]}}} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:32.890554 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4e6a95b-32a4-4673-bf79-33960dcce481 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4e6a95b-32a4-4673-bf79-33960dcce481 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.030402 Oct 04 20:45:32.907496 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1009/1961] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:32 2022] POST /compute/v2.1/servers => generated 175 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:32.939169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.948167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.999032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.004056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.006289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.023008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.025520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.032309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.541282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.595382 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d6c18708-d571-4937-806f-e4dbe11cd8eb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.268714 Oct 04 20:45:33.610709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 953/1962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:33.620736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b36a3e-8320-4100-9567-baff91fcf2dd", "name": "network-vif-plugged", "status": "completed", "tag": "693240e3-8bfd-45b4-9395-71f911b5d81f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:33.663591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.664886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.665987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.728450 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] Creating event network-vif-plugged:693240e3-8bfd-45b4-9395-71f911b5d81f for instance 14b36a3e-8320-4100-9567-baff91fcf2dd on n-h2-851029-13 Oct 04 20:45:33.752620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2ee33dd8-278f-494b-bad1-c3f4ea6c9dfc req-cee9d5ad-7b68-404a-9538-9c014366608c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150752 Oct 04 20:45:33.758401 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 954/1963] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:33.785718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.787713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.840570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.843033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.848664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.851724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.859250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.871696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.373128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.401986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9489d6af-1a43-44bb-bde3-e365ef3cd2c3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1365 microversion: 2.1 time: 1.487808 Oct 04 20:45:34.445271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1010/1964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1365 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:34.467447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5f28280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.760792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:45:34.761909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group de7bc11c-4bae-417b-9faf-217f93a11874 not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:45:34.764600 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.764600 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 HTTP/1.1 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'de7bc11c-4bae-417b-9faf-217f93a11874'} Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:45:34.788156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-22354dc1-8c42-4883-ad83-d64d0d36ac42'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-305ca3d2-a3e5-4336-b5b5-bc49fa0952bd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874" status: 404 len: 194 microversion: 2.1 time: 0.343638 Oct 04 20:45:34.813215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1011/1965] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 => generated 194 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:34.829709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.870983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.874915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:34.903690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:34.907215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.916391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.921621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.316912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.316912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.316912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.334156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.420686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.442762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.452644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b52f878a-d5f3-4000-85b4-e2dd03a83ecd tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.688258 Oct 04 20:45:35.466712 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 955/1966] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:35.517888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.520962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: ff5e5a61-cd3d-422f-876b-1d578e31cb8c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.538798 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:45:35.540611 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 20:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers?image=non_existing_image (ip 10.222.0.36) !!! Oct 04 20:45:35.553493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abb5b370-552c-4d0c-91cd-6f5a059ff7a2 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.750103 Oct 04 20:45:35.573767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1012/1967] 10.222.0.36 () {58 vars in 1174 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:35.587508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] HTTP exception thrown: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/ff5e5a61-cd3d-422f-876b-1d578e31cb8c/metadata HTTP/1.1 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'ff5e5a61-cd3d-422f-876b-1d578e31cb8c'} Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:35.595700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:35.602148 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:35.602148 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:35.602148 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. Oct 04 20:45:35.602148 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:35.605699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 404 to user: Instance ff5e5a61-cd3d-422f-876b-1d578e31cb8c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:35.607600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c354818-799a-4e2f-9a24-53fc54abe28a tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/ff5e5a61-cd3d-422f-876b-1d578e31cb8c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.143497 Oct 04 20:45:35.621295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 956/1968] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/ff5e5a61-cd3d-422f-876b-1d578e31cb8c/metadata => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:35.644473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.644473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.644741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.644741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.655738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.656908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.658160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.659788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.664310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.665602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.765769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.769360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.781752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.786880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.793464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.801084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.828003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:36.872006 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c10b72bb-5858-41eb-a7fa-b98b11e54cc4 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.295254 Oct 04 20:45:36.880451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1013/1969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:36.923632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2d17f9e-ab47-4baa-8f65-f2906c2cc681 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5f2f160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-440776879", "description": "tempest-description-1489265448"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:36.994378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.029278 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0bddb60b-dbe7-40de-8ab7-c6fcd20aa868 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.405684 Oct 04 20:45:37.055562 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 957/1970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:37.082887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.084453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.098203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.100072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.102202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.103991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.105105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.106154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.986702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.010105 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2c7611d-01f0-4fdd-800a-c870fbbcae3d tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1554 microversion: 2.1 time: 0.952325 Oct 04 20:45:38.016433 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 958/1971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1554 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:38.029243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.048030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.050348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:38.065067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.066987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.068071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.069852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.071143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.072209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.253747 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5c48302-6c35-40c4-b0c4-9bba3760fae3 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.231296 Oct 04 20:45:38.256271 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 959/1972] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:38.276819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21784a94-089d-434f-9469-65df381b18cd tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1468383910", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21784a94-089d-434f-9469-65df381b18cd tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 499 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1468383910", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1468383910', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6fd249d8-c256-417a-87c4-180a9bfbe1b4'}]}}} Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:45:38.289410 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:38.294484 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:38.304058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21784a94-089d-434f-9469-65df381b18cd tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:38.304058 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21784a94-089d-434f-9469-65df381b18cd tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.041316 Oct 04 20:45:38.311098 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 960/1973] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:38 2022] POST /compute/v2.1/servers => generated 687 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:38.349757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.353328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:38.390629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.396346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.398149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.403619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.404959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.405767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.980964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2d17f9e-ab47-4baa-8f65-f2906c2cc681 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.097596 Oct 04 20:45:38.989764 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1014/1974] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:45:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:39.012207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.013743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.041481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.043869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.049462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.052400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.053620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.056097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.624310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.649900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.654940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.661779 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff9f1d5c-22e5-44f9-a4cf-0678be60330a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.347615 Oct 04 20:45:39.675554 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 961/1975] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:39.715153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.716446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.759364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.760560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.761466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.762918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.764240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.765234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.070082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:40.087921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-228999ac-834f-4074-8539-7ba0997709c6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1391 microversion: 2.1 time: 1.095700 Oct 04 20:45:40.100200 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1015/1976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1391 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:40.122594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:40.131699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:40.156462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.157746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.158751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.160730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.162012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.162738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.259638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16a6e00d-2096-4715-85ed-b0440c6ce267 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.581709 Oct 04 20:45:40.267278 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 962/1977] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-interface => generated 284 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:40.289803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:40.300482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:40.302583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:40.328681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.336230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.346501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.348951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.350884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.352351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.696241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:45:41.300296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:41.353783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ad38cdc-d9ae-4d71-a790-7cc934e71d95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.248129 Oct 04 20:45:41.356601 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1016/1978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:40 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:41.399706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51c39c48-6297-427b-9b69-06c71d5781ec tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633492344", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51c39c48-6297-427b-9b69-06c71d5781ec tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 500 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633492344", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1633492344', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6fd249d8-c256-417a-87c4-180a9bfbe1b4'}]}}} Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:45:41.427355 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:41.431925 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:41.438050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51c39c48-6297-427b-9b69-06c71d5781ec tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:41.442844 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51c39c48-6297-427b-9b69-06c71d5781ec tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.080165 Oct 04 20:45:41.445224 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1017/1979] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:41 2022] POST /compute/v2.1/servers => generated 689 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:41.462359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4fd6fd-bf2b-4756-aa13-0efeaeb92491", "tag": "d8fcf76b-d817-493d-9b58-bf3739f27341"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:41.523634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:41.525383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:41.528472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:41.562526 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] Creating event network-changed:d8fcf76b-d817-493d-9b58-bf3739f27341 for instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 on n-h1-851029-13 Oct 04 20:45:41.579184 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-70346e3d-37a6-4ba3-96f4-de2d68c1b768 req-2a04aae1-d67c-48bd-bb57-5a8323edb7b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125061 Oct 04 20:45:41.596747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1018/1980] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:41.634720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45aba119-0c4a-4eb1-a991-5f0c821c3da8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54fa6935e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-448037478", "description": "tempest-description-3607187"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:41.754324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:41.787780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:41.789098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:41.791958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.144133 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-556c599c-e7ef-4bf3-a800-f25f309afc12 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.873046 Oct 04 20:45:42.153318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 963/1981] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:45:40 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:42.171027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.171027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.197665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.197665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.197665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.198520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.199645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.200589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.528064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:42.544156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:42.547425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:42.550906 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-205e491f-0088-450f-b7b6-006892d0cd88 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.400378 Oct 04 20:45:42.563096 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 964/1982] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:42.582780 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45aba119-0c4a-4eb1-a991-5f0c821c3da8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.980181 Oct 04 20:45:42.593244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.598515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.601614 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1019/1983] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:45:41 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:42.611877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.613784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.614874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.616879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.618066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.619169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.622697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1af053b2-f91e-4234-835f-d84d3020cb48 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1757854246", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1af053b2-f91e-4234-835f-d84d3020cb48 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 754 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1757854246", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1757854246', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6fd249d8-c256-417a-87c4-180a9bfbe1b4'}]}}} Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:42.633263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:42.637812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:42.647606 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:42.647606 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.647606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1af053b2-f91e-4234-835f-d84d3020cb48 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:42.647606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1af053b2-f91e-4234-835f-d84d3020cb48 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.039755 Oct 04 20:45:42.647606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1020/1984] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:42 2022] POST /compute/v2.1/servers => generated 1197 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 20:45:42.660077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca6c9907-4bce-46d2-9136-b9c9439924b8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.673128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca6c9907-4bce-46d2-9136-b9c9439924b8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:42.682414 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca6c9907-4bce-46d2-9136-b9c9439924b8 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.028871 Oct 04 20:45:42.684235 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1021/1985] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:42.697236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.699276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.716181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.717970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.719092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.720383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.721109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.722382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.161516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.188527 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5507127-f639-49fc-b3fd-8617eead7d7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 0.500822 Oct 04 20:45:43.202700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1022/1986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:43.214690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00e0dcd7-ad27-4a32-b202-f363ad4d6774 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5fe3940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1796620500", "description": "tempest-description-1445974752"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:43.328910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.357913 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f13c3fe-7baa-4c01-8a55-52dd26d383ab tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1381 microversion: 2.1 time: 0.792120 Oct 04 20:45:43.364457 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 965/1987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1381 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:43.392559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:43.418422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.420319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Searching by: {'deleted': False, 'project_id': 'b140ef409c584577b0a50ebd93462100'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:45:43.430952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:43.431705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:43.432498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.433790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:43.434432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:43.435224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.507730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:45:43.716239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8143dd57-b57f-45f8-a0f1-4e71b87bb0d4 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.346281 Oct 04 20:45:43.726291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 966/1988] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:45:43 2022] GET /compute/v2.1/servers => generated 683 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:43.744904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e195da81-c4bb-4796-ba25-a5b494653cc4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-478291971", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e195da81-c4bb-4796-ba25-a5b494653cc4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 1265 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-478291971", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6fd249d8-c256-417a-87c4-180a9bfbe1b4"}]}} Oct 04 20:45:43.755087 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-478291971', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6fd249d8-c256-417a-87c4-180a9bfbe1b4'}]}}} Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.757923 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:45:43.759210 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:45:43.762973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:45:43.762973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:43.762973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e195da81-c4bb-4796-ba25-a5b494653cc4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:43.762973 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e195da81-c4bb-4796-ba25-a5b494653cc4 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.032723 Oct 04 20:45:43.770284 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 967/1989] 10.222.0.36 () {60 vars in 1148 bytes} [Tue Oct 4 20:45:43 2022] POST /compute/v2.1/servers => generated 2221 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 20:45:43.781820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-483811f6-9f02-4372-9779-3bd692ab9c08 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '.version_select at 0x7f54f5e9f430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:43.792042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-483811f6-9f02-4372-9779-3bd692ab9c08 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:43.793015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-483811f6-9f02-4372-9779-3bd692ab9c08 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:43.793814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-483811f6-9f02-4372-9779-3bd692ab9c08 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.821654 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-483811f6-9f02-4372-9779-3bd692ab9c08 tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3121 microversion: 2.1 time: 0.049106 Oct 04 20:45:43.831088 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 968/1990] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:45:43 2022] GET /compute/v2.1/os-migrations => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:43.834751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:43.837656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:43.867596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:43.868632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:43.869698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.871589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:43.872574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:43.873367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:43.935678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:44.716172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00e0dcd7-ad27-4a32-b202-f363ad4d6774 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.517946 Oct 04 20:45:44.725721 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1023/1991] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:45:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:44.769803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:44.771805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:44.791824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:44.793261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:44.794540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:44.805490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:44.805490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:44.806957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:44.861135 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] HTTP exception thrown: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db HTTP/1.1 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '21a115a6-299c-4e24-863d-711f802836db'} Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:44.864904 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:44.871645 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.875770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 404 to user: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:44.878017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6db52a3c-98ce-4da9-bbc2-9526ac81822b tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "DELETE /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 404 len: 111 microversion: 2.1 time: 0.149764 Oct 04 20:45:44.886855 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1024/1992] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:44 2022] DELETE /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:44.900059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:44.901518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 6fd4b914-e2d9-4245-967d-86cc62e8828d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:44.915166 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] HTTP exception thrown: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/6fd4b914-e2d9-4245-967d-86cc62e8828d/metadata/test2 HTTP/1.1 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': '6fd4b914-e2d9-4245-967d-86cc62e8828d', 'id': 'test2'} Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:44.919814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:44.926600 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:44.926600 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:44.926600 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. Oct 04 20:45:44.926600 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:44.929895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 404 to user: Instance 6fd4b914-e2d9-4245-967d-86cc62e8828d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:44.932131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc29dbd2-21ab-42a6-8e8c-87276ee02397 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd4b914-e2d9-4245-967d-86cc62e8828d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.042723 Oct 04 20:45:44.934125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1025/1993] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 4 20:45:44 2022] GET /compute/v2.1/servers/6fd4b914-e2d9-4245-967d-86cc62e8828d/metadata/test2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:44.948390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:44.951034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:44.973447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:44.976264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:44.979319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:44.982095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:45.007328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:45.010071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:45.118328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:45.153370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:45.163544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:45.174179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-689fe02c-bf4c-4804-854a-e2b81e6f7e2c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.347750 Oct 04 20:45:45.191355 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 969/1994] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:43 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:45.194999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:45.220021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:45.221999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:45.241465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:45.242850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:45.244160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:45.245939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:45.247516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:45.248818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:46.092199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75bdc6bf-e015-48b9-b849-ca48e17fedff tempest-LiveMigrationTest-1473863332 tempest-LiveMigrationTest-1473863332-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1534 microversion: 2.1 time: 1.154306 Oct 04 20:45:46.112912 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1026/1995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:44 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1534 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:46.172576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b36a3e-8320-4100-9567-baff91fcf2dd", "tag": "693240e3-8bfd-45b4-9395-71f911b5d81f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:46.182312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:46.248142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-902e0e80-490c-4562-8009-13836de37914 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.059344 Oct 04 20:45:46.251529 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 970/1996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:45 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:46.270027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df2d3c92-b2f6-428f-82ba-9ac72d9ecf5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5e9f940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:46.271179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:46.272437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:46.273535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:46.327652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] Creating event network-changed:693240e3-8bfd-45b4-9395-71f911b5d81f for instance 14b36a3e-8320-4100-9567-baff91fcf2dd on n-h2-851029-13 Oct 04 20:45:46.352088 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fb19d1ba-c420-48d9-bfd8-d570770dd883 req-12c0635c-8041-419c-a99b-2ead7af01e9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231464 Oct 04 20:45:46.366816 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1027/1997] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:46.401001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:46.406384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:46.430460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:46.435990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:46.443736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:46.446430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:46.454933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:46.456624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:46.559849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:47.220498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df2d3c92-b2f6-428f-82ba-9ac72d9ecf5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.964770 Oct 04 20:45:47.222447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 971/1998] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:45:46 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:47.245039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:47.261078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:47.311862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:47.313889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:47.349210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:47.351181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:47.352343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:47.353398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:47.498561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:47.583273 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4fd17a0-76c9-4ef1-b5aa-9fa18ed82c05 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 204 len: 0 microversion: 2.1 time: 1.213280 Oct 04 20:45:47.592421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1028/1999] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:46 2022] DELETE /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 0 bytes in 1220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:47.628451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:47.633285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:47.708838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:47.714976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:47.715448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:47.716228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:47.724629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:47.728107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:47.811505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:48.508860 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6753fda6-9a82-4e6f-8154-2f568af778ea tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 204 len: 0 microversion: 2.1 time: 1.283686 Oct 04 20:45:48.528312 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 972/2000] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:47 2022] DELETE /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 0 bytes in 1299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:48.567155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:48.592165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:48.610300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78da8e2c-4be9-4772-8909-3b72b1fc1163 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 204 len: 0 microversion: 2.1 time: 1.014354 Oct 04 20:45:48.613528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:48.615167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:48.616739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:48.616928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1029/2001] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:47 2022] DELETE /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:48.618955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:48.621697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:48.623338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:48.655512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1cccf93-b63c-446b-a7d0-dd8b3f886802 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa6938b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:49.080629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:49.120645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:49.136829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:49.142351 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3b1bf8c-0217-4a9c-a273-53695b2a667a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.608699 Oct 04 20:45:49.155241 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 973/2002] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:48 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:49.207865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:49.209547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:49.251020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:49.256568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:49.257674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:49.262006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:49.268891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:49.271388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:49.574922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1cccf93-b63c-446b-a7d0-dd8b3f886802 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb" status: 202 len: 0 microversion: 2.1 time: 0.954981 Oct 04 20:45:49.582887 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1030/2003] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:45:48 2022] DELETE /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:49.592666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:49.594407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:49.608737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:49.609763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:49.610595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:49.614736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:49.614736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:49.615383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:49.698324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:49.827008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:50.157276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:50.191629 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0b6a993-9936-4405-85ce-2ea9577c5cd7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.033813 Oct 04 20:45:50.193445 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 974/2004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:49 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:50.214859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c83d26-8216-4085-9143-ad9c3f90961e", "name": "network-vif-unplugged", "status": "completed", "tag": "e583e59b-6d6c-445e-90fe-8154329b026e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:50.259007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:50.260025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:50.260839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:50.288469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] Creating event network-vif-unplugged:e583e59b-6d6c-445e-90fe-8154329b026e for instance b8c83d26-8216-4085-9143-ad9c3f90961e on n-h1-851029-13 Oct 04 20:45:50.301916 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9fe69a84-6a4e-45ee-900e-7e700a4ffc44 req-0014fdb8-114a-4dbe-8eae-d5fa8dff95eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105603 Oct 04 20:45:50.303749 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 975/2005] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:50.315461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:50.317260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:50.334362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:50.335293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:50.336103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:50.337544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:50.338508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:50.339474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:50.670219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2bc8d349-4095-40c9-890d-338b3b8cd408 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 204 len: 0 microversion: 2.1 time: 1.084670 Oct 04 20:45:50.671390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1031/2006] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:49 2022] DELETE /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:50.702705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:50.705467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:50.740424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:50.742347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:50.744576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:50.747117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:50.751025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:50.756388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:51.589566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:51.651653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-468f7340-2083-4999-aa8c-0efbeba09c23 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1525 microversion: 2.1 time: 1.345006 Oct 04 20:45:51.654846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 976/2007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:50 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1525 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:51.668273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5e49af0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:51.765781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:51.906017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:45:51.907255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group eadb7790-0c29-4ea1-8a62-535f5277ebeb not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:45:51.909169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.909169 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb HTTP/1.1 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'eadb7790-0c29-4ea1-8a62-535f5277ebeb'} Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:45:51.919494 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] Oct 04 20:45:51.932555 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:51.944050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:45:51.944050 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-3b41cd63-8181-40de-b759-8013aef36cc4'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:51.944050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c49caca-7fc1-4ce9-9c31-93012ef7dc3e tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb" status: 404 len: 194 microversion: 2.1 time: 0.280603 Oct 04 20:45:51.949936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 977/2008] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:45:51 2022] GET /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb => generated 194 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:51.975106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:51.976702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:52.006460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.007368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.008273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.017644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.018925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.020023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.434605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:52.483207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d692a61-6c48-40ed-ab22-9294af2682c7 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1387 microversion: 2.1 time: 1.803678 Oct 04 20:45:52.485064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1032/2009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:50 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1387 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:52.510476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:52.512085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 21a115a6-299c-4e24-863d-711f802836db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:52.547132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.552226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.554892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.565801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.568848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.575748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.657239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] HTTP exception thrown: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db HTTP/1.1 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '21a115a6-299c-4e24-863d-711f802836db'} Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:52.667155 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 404 to user: Instance 21a115a6-299c-4e24-863d-711f802836db could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:52.682095 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16645ea8-b091-4348-862a-fdadf4408d8e tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db" status: 404 len: 111 microversion: 2.1 time: 0.182604 Oct 04 20:45:52.686186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1033/2010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:52 2022] GET /compute/v2.1/servers/21a115a6-299c-4e24-863d-711f802836db => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:52.709692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4fd6fd-bf2b-4756-aa13-0efeaeb92491", "name": "network-vif-plugged", "status": "completed", "tag": "d8fcf76b-d817-493d-9b58-bf3739f27341"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:52.801119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:52.807449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.810305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.816910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.841196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:52.873887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:52.883633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad10ca85-e7b4-477c-9e82-0366eb9771fe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.926920 Oct 04 20:45:52.891649 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] Creating event network-vif-plugged:d8fcf76b-d817-493d-9b58-bf3739f27341 for instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 on n-h1-851029-13 Oct 04 20:45:52.899878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 978/2011] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:51 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:52.929126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:52.935128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:52.957840 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-286c91dc-8a5b-4677-a0a4-b364fb7745fd req-964cc996-f570-401c-bc70-979e5ef15be3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268955 Oct 04 20:45:52.963143 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1034/2012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:52.978435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.988515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:52.989759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:52.994486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:52.995043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8734e6c-37a6-4528-a240-e04b59591399 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa51bd30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:53.014522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:53.017499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:53.447520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:53.773665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:53.807165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a94c52f-8c58-4b6b-94be-119220075c8f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 0.904686 Oct 04 20:45:53.811371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 979/2013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:52 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:53.833837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6187bfca-683c-4123-8206-13eced3172fb", "name": "network-vif-deleted", "tag": "373aca16-4551-4b3b-a9a3-90cfa2cb9f28"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:53.872800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:53.881770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:53.883562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:53.926000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] Creating event network-vif-deleted:373aca16-4551-4b3b-a9a3-90cfa2cb9f28 for instance 6187bfca-683c-4123-8206-13eced3172fb on n-h1-851029-13 Oct 04 20:45:53.940314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-22762bfe-5e56-4c1b-baee-80ce9a0fe641 req-a38158ee-3f60-4d75-88d9-fa82402e5bb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126229 Oct 04 20:45:53.943584 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 980/2014] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:53.967203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c83d26-8216-4085-9143-ad9c3f90961e", "tag": "e583e59b-6d6c-445e-90fe-8154329b026e"}, {"server_uuid": "3cd707b8-caa2-415d-b323-1afd09d75c04", "name": "network-vif-deleted", "tag": "91b19d12-97e8-4688-bc78-31c028436c48"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:54.024127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.025588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.027118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.069050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Creating event network-changed:e583e59b-6d6c-445e-90fe-8154329b026e for instance b8c83d26-8216-4085-9143-ad9c3f90961e on n-h1-851029-13 Oct 04 20:45:54.070793 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] Creating event network-vif-deleted:91b19d12-97e8-4688-bc78-31c028436c48 for instance 3cd707b8-caa2-415d-b323-1afd09d75c04 on n-h2-851029-13 Oct 04 20:45:54.110958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-51e2ecba-d995-4f03-bdd8-56ad9dcadaef req-267457d5-063d-478d-b345-08fa34690da1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.164727 Oct 04 20:45:54.113510 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 981/2015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:54.135499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:54.137896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:54.173621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.176950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.181164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.185298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.191847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.193935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.359542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8734e6c-37a6-4528-a240-e04b59591399 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa" status: 202 len: 0 microversion: 2.1 time: 1.391074 Oct 04 20:45:54.366959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1035/2016] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:45:52 2022] DELETE /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa => generated 0 bytes in 1401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:54.376634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.378416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.379438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.380433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lazy-loading 'fault' on Instance uuid c4491873-918f-4941-bdb9-4acef580877b {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:54.384820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:54.389044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:54.432653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.434718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.436469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.441592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.443081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.444394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.493316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:54.516114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b17c4505-cae3-4d8c-aecb-d7e4a5a38362 tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1313 microversion: 2.1 time: 0.388838 Oct 04 20:45:54.519044 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 982/2017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:54.528886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:54.530323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:54.552174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.554284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.554963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.555943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.556688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.557485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lazy-loading 'fault' on Instance uuid 3cd707b8-caa2-415d-b323-1afd09d75c04 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:54.558533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.563800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.566334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.567522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.754237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d29b83a0a248fa9efaaa0e7bb4f4aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf310becc0c4397bd445094a9c00b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:54.791745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-483a36b9-859a-4e2d-8a78-68628e971f97 tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 200 len: 1314 microversion: 2.1 time: 0.422409 Oct 04 20:45:54.795491 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1036/2018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:54.817161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:54.818937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:54.840054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:54.856645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.857920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.859064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.864870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:54.867811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:54.875355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7031f5f-96bd-4cff-9c67-63423cda88dc tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.353716 Oct 04 20:45:54.876586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:54.883268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 983/2019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:54.949842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f6082940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:55.376140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:45:55.385766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:45:55.392081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.392081 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa HTTP/1.1 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1fcb06bb-ff41-4b90-80ec-680b86571dfa'} Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:45:55.409700 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] Oct 04 20:45:55.417883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:55.430488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:45:55.430488 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-fdf8e603-2e75-4fc8-967f-19fd16fbae3b'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:55.434012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3bf7dbf4-deab-41a8-b66a-eae7b912c469 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa" status: 404 len: 194 microversion: 2.1 time: 0.547817 Oct 04 20:45:55.440706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 984/2020] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa => generated 194 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:55.472261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:55.474856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:55.506212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:55.510084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:55.515856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:55.533858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:55.536174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:55.537513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:55.732683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:55.775988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:55.781206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:55.790364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7c19c92-8095-44bf-ad1c-0821be923485 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.988858 Oct 04 20:45:55.806993 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1037/2021] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:54 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:55.853737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99589ca6-47fe-4734-a6b9-628e06f56e5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa51b280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.515661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:56.542570 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-777aa2ee-d518-4b00-af03-bf572996e9a6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1306 microversion: 2.1 time: 1.095786 Oct 04 20:45:56.545080 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 985/2022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:55 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1306 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:56.585601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.600973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:56.619570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.622634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.623696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.625264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.626393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.627425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.707644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.708906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.709897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.710814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lazy-loading 'fault' on Instance uuid c4491873-918f-4941-bdb9-4acef580877b {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:56.870241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd712684a4e574a8bb9276c4776ba9308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b140ef409c584577b0a50ebd93462100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:56.923983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1e329df-bfca-4be0-9c65-43f997f8a1ef tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 200 len: 1313 microversion: 2.1 time: 0.375625 Oct 04 20:45:56.929369 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 986/2023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:56.964999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.969769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] [instance: 3cd707b8-caa2-415d-b323-1afd09d75c04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.012065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.013919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.015517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.017259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.020560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.023390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.059355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] HTTP exception thrown: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Request method failure captured: Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 HTTP/1.1 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJskD-y6QVAz-vsmfhKO84YWC1WuvjGag8Loowt7YnNNjoRC3gXrFmK-ZfR4A1Gp3tPZGUh9H2F0DYZ7EdCzNlmyZybJmK-NF2Pt6Bhq5layK4983kK6bCHsgjryy7KU8rcwSg3BnvWWcZj5uFsr6uThqgtP9p4jdoELWeWQai9xKQQ Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ddf310becc0c4397bd445094a9c00b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ddf310becc0c4397bd445094a9c00b85 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1743424793 Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 03d29b83a0a248fa9efaaa0e7bb4f4aa Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1743424793-project Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '3cd707b8-caa2-415d-b323-1afd09d75c04'} Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.067795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. Oct 04 20:45:57.077205 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.081440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] Returning 404 to user: Instance 3cd707b8-caa2-415d-b323-1afd09d75c04 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:57.083558 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68056bf0-cfbc-4404-a2b8-049d3468d9af tempest-ServerMetadataNegativeTestJSON-1743424793 tempest-ServerMetadataNegativeTestJSON-1743424793-project] 10.222.0.36 "GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04" status: 404 len: 111 microversion: 2.1 time: 0.148332 Oct 04 20:45:57.085477 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 987/2024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/servers/3cd707b8-caa2-415d-b323-1afd09d75c04 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:57.098343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.101314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.117656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.121549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.124445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.126360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.129467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.131648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.336118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:57.363839 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e325980-c37c-4e44-85e2-672e28aa5676 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.275560 Oct 04 20:45:57.370500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 988/2025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:57.386999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4491873-918f-4941-bdb9-4acef580877b", "name": "network-vif-deleted", "tag": "ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:57.422817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.426528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.428227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.460133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:57.470843 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] Creating event network-vif-deleted:ac5cf585-d8f7-4fe8-9cb0-948fbcd0b165 for instance c4491873-918f-4941-bdb9-4acef580877b on n-h1-851029-13 Oct 04 20:45:57.486086 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-03cd4bd7-4da2-46d9-9470-d03d961a977f req-08595028-a3f7-46fd-bef2-6c3bb88a7b7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111476 Oct 04 20:45:57.487385 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 989/2026] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:57.508224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0d7b2a-9e25-47f4-8062-3aa5351874de", "name": "network-vif-deleted", "tag": "8ebe85e4-58da-4107-a0fa-22e379ecbf5b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:57.531273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.532328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.533008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.554152 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99589ca6-47fe-4734-a6b9-628e06f56e5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a" status: 202 len: 0 microversion: 2.1 time: 1.743957 Oct 04 20:45:57.556779 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1038/2027] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:45:55 2022] DELETE /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a => generated 0 bytes in 1749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:57.588836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] Creating event network-vif-deleted:8ebe85e4-58da-4107-a0fa-22e379ecbf5b for instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de on n-h2-851029-13 Oct 04 20:45:57.610476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.611408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-20d1629d-5401-4b61-9daf-af2fa115f217 req-18ea0842-29cb-48b0-9266-69503429a676 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110357 Oct 04 20:45:57.612809 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 990/2028] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:57.614731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.630178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5f44940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.635474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.639928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.639928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.641773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.643933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.645361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.746954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:45:57.754721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group c418c7c7-b9df-43ba-867a-823fc7f9318a not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:45:57.757010 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.757010 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a HTTP/1.1 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c418c7c7-b9df-43ba-867a-823fc7f9318a'} Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:45:57.774556 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-07210f63-4aa9-4f1a-928d-f74cd69c0289'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8bfeb9d6-2274-4ea4-8b1b-2e57759ee9dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a" status: 404 len: 194 microversion: 2.1 time: 0.165120 Oct 04 20:45:57.790236 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 991/2029] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:57.817880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.819345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.867341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.870520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.880844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.882277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.883385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.884190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.188753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.216436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.221577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.224189 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e01727e3-068e-4f3e-872f-670ba40772bc tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.657161 Oct 04 20:45:58.226414 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1039/2030] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:58.235778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e770a1e7-53c2-421e-928a-8f81d197a3bf tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa6a5b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.392130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.417414 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1aa28d69-5ab6-426b-9a4c-40b542ae7691 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1486 microversion: 2.1 time: 0.633057 Oct 04 20:45:58.430712 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 992/2031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1486 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.434597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.441849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: c4491873-918f-4941-bdb9-4acef580877b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.462808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.493088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] HTTP exception thrown: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b HTTP/1.1 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c4491873-918f-4941-bdb9-4acef580877b'} Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:58.496617 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 404 to user: Instance c4491873-918f-4941-bdb9-4acef580877b could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02a6d0a2-3b46-4cc4-812c-1bdeb5e2bdcb tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b" status: 404 len: 111 microversion: 2.1 time: 0.077922 Oct 04 20:45:58.504237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 993/2032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/servers/c4491873-918f-4941-bdb9-4acef580877b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:58.510986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.512360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.537459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.539977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.541169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.542883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.545949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.547395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.797550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.826564 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e06fd318-933c-42b8-9eea-b9ad7d7be188 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.323612 Oct 04 20:45:58.833435 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 994/2033] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.853880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:58.861749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.885679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.886966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.887975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.889442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.890639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.891705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.042048 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e770a1e7-53c2-421e-928a-8f81d197a3bf tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.813267 Oct 04 20:45:59.044049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1040/2034] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.060544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.065663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] [instance: 2a0d7b2a-9e25-47f4-8062-3aa5351874de] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.086837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.088889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.090020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.091627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.092858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.093972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.139062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] HTTP exception thrown: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Request method failure captured: Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de HTTP/1.1 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJrldlVVkCaB_2UPkwkoIIS4agZV6ZzFYM9N9UY8b7O0JQtAI8GAEh-o3wMZ7_Mn7zKCOqe9ztOAkSfmtGgr-9j31UG4lWS69Wg3F-xLQNd242HPOM27zq_OgC869np_Fqw0i0i7mMfIssSoO2LfQ_Qd86N7X38MQmvV26hMtSjWIfo Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b140ef409c584577b0a50ebd93462100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b140ef409c584577b0a50ebd93462100"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b140ef409c584577b0a50ebd93462100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b140ef409c584577b0a50ebd93462100 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1362283309 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d712684a4e574a8bb9276c4776ba9308 Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServersNegativeTestJSON-1362283309-project Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2a0d7b2a-9e25-47f4-8062-3aa5351874de'} Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:59.144611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. Oct 04 20:45:59.152252 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:45:59.156793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] Returning 404 to user: Instance 2a0d7b2a-9e25-47f4-8062-3aa5351874de could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:59.159600 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1cdc0d88-7ac7-4ec5-bf09-141b59d94f1c tempest-ListServersNegativeTestJSON-1362283309 tempest-ListServersNegativeTestJSON-1362283309-project] 10.222.0.36 "GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de" status: 404 len: 111 microversion: 2.1 time: 0.112482 Oct 04 20:45:59.181675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1041/2035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/servers/2a0d7b2a-9e25-47f4-8062-3aa5351874de => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:59.210111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83088db8-6991-4cb7-a77e-052002fbd71a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54f5f28280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359342469", "description": "tempest-description-451171467"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:59.551573 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-221f1675-e1f6-43c4-901c-7691483c01e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491/action" status: 202 len: 0 microversion: 2.1 time: 0.708836 Oct 04 20:45:59.555495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 995/2036] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:58 2022] POST /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:59.577748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.585186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.608346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.612080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.613468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.617824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.619823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.621145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.230138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:00.254440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:00.281819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:00.287833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac96625d-dc5d-4faf-a956-427c1036f746 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.725731 Oct 04 20:46:00.290069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 996/2037] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:00.319092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:00.327976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:00.365162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.366484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.367285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.368525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.369255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.378939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.460813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83088db8-6991-4cb7-a77e-052002fbd71a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.273106 Oct 04 20:46:00.471505 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1042/2038] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:45:59 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:00.489582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:00.496201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:00.544840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.545682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.546795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.548402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.549895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.551182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.969585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:01.010326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a4852a48-c621-4609-b1c7-e33f6483d522 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.529222 Oct 04 20:46:01.014140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1043/2039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:00 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:01.036527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b1e6e8d-1c45-4465-b293-1c7762fbc0dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54fa58b790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1952943793", "description": "tempest-description-763021806"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:01.262792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:01.291952 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be5b2369-a8c1-41ae-bfd9-77ea8e1f08af tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1491 microversion: 2.1 time: 0.992649 Oct 04 20:46:01.299846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 997/2040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:00 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1491 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:01.345462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:01.347270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:01.374016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:01.384742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.386694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.387490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.391611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.395003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.395886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.211169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.242038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.250735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.257634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11081f8c-b238-4289-8a98-95d327d55f40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.922137 Oct 04 20:46:03.263672 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 998/2041] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:01 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:03.277568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:03.280378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:03.304906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.309492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.310774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.315837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.320444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.321627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.548129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9c54b1d-f728-44fe-9a43-5ac5d3b74901 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.331844 Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 999/2042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:03 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.732358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.932197 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b1e6e8d-1c45-4465-b293-1c7762fbc0dc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.915834 Oct 04 20:46:03.934393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1044/2043] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:46:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:04.199503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:04.232426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-919bf242-b8e4-44a0-b18c-26a2ef54dbf8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 200 len: 1471 microversion: 2.1 time: 0.625986 Oct 04 20:46:04.259261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1000/2044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:03 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 1471 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:04.297077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-529369160"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:04.307177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:04.327689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:04.329527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:04.341955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:04.342981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:04.343861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:04.346308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:04.354359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:04.355272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:04.356617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:04.357836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:04.360371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:04.366025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:04.367484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:04.368519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:05.617266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:05.665150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:05.688853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:05.695656 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85eb58ed-f3d5-4c07-8d21-9aa98aa808ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.378948 Oct 04 20:46:05.725696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1001/2045] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:04 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:05.771558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-64513362", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6b279778-73dc-45a0-a2d0-29f7f54659a3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:05.851554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61404ec5-5c61-45d4-879d-7e981a30374f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491/action" status: 202 len: 0 microversion: 2.1 time: 1.555824 Oct 04 20:46:05.883221 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1045/2046] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:04 2022] POST /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491/action => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:46:05.931769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:05.933203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:05.936958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:05.974990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:05.976341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:05.977457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:05.979202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:05.991973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:05.993196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:06.071252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] validate_networks() for [('6b279778-73dc-45a0-a2d0-29f7f54659a3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:06.304741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:06.343492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db91cfc1-1b19-4823-aa86-968fdbecc27f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1183 microversion: 2.1 time: 0.447858 Oct 04 20:46:06.379298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1046/2047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:05 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1183 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:06.403609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-866d0925-3e38-4c3d-a3e3-f51ea8c71534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5e0caf0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:06.676882 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-866d0925-3e38-4c3d-a3e3-f51ea8c71534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.295087 Oct 04 20:46:06.688805 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1047/2048] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:06 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:06.758116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:06.758116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:06.768372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:06.769627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:06.770545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:06.772042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:06.773060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:06.773975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:08.398589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:08.434169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:08.437023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:08.439109 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66d7531a-6f08-4a09-8517-de6df4120586 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.692175 Oct 04 20:46:08.444971 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1048/2049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:06 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:08.466950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:08.468167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:08.509658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:08.510001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:08.518431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:08.520160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:08.521070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:08.521876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:08.794557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:08.795793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:08.796773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:08.799611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lazy-loading 'fault' on Instance uuid 6187bfca-683c-4123-8206-13eced3172fb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:09.114458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:09.141418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11765b5e-2ba3-4055-b40f-d3065bb4021a tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 200 len: 1142 microversion: 2.1 time: 0.694266 Oct 04 20:46:09.172138 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1049/2050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:08 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 1142 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:09.184405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0af25ca4-c9ca-4c92-a193-b51a20f7b451 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa693430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:09.368561 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0af25ca4-c9ca-4c92-a193-b51a20f7b451 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.193020 Oct 04 20:46:09.392183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1050/2051] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:09 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:09.514112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:09.515150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:09.540155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:09.543505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:09.544168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:09.546450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:09.553714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:09.554414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:09.952131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:09.955778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:09.956507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:09.957519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:09.962079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:10.003459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:10.009033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:10.009033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:10.009033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:10.009033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:10.009033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:10.054429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Getting quotas for project e78ca76042274942a3d5592439330eaa. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:10.066942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Getting quotas for user 724b09e312294ce0a908c9ba77b6fb07 and project e78ca76042274942a3d5592439330eaa. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:10.097466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:10.104696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:10.410904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e448ffc-47e6-44ff-8c3d-4aa7fce42e7d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.682735 Oct 04 20:46:10.419550 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1002/2052] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:46:10.450813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:10.458579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 6187bfca-683c-4123-8206-13eced3172fb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:10.537995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:10.548017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:10.550264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:10.600212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:10.606610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:10.609273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:10.702425 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] HTTP exception thrown: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Request method failure captured: Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb HTTP/1.1 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhsQF_pZFbiHKAwaTKG6Sqx5LAUmIp--DqAT2SyE-dSA4w34n3J58oPV-iWH-UEWY8LOFgUeUlGpU_rsdQgqPcw9cHXMm8mBaxUi1NMgdPeO6r1iVdES6WvJvHD82TDaW6beVYWYx-Ksbf7gZ7ia4m0oueUu6I6DEqxmA0TtkS6RCc Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2dd088c880894556b8525b41e5684eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2dd088c880894556b8525b41e5684eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveMigrationTest-187330508 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveMigrationTest-187330508-project Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 44a42dd2dd73439bbe445de3b2eb9744 Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveMigrationTest-187330508-project Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6187bfca-683c-4123-8206-13eced3172fb'} Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:10.706004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. Oct 04 20:46:10.713070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:46:10.723445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Returning 404 to user: Instance 6187bfca-683c-4123-8206-13eced3172fb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:10.725338 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9794149-c33e-4aed-9c21-0924f0d47f26 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb" status: 404 len: 111 microversion: 2.1 time: 0.303507 Oct 04 20:46:10.726385 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1003/2053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:10 2022] GET /compute/v2.1/servers/6187bfca-683c-4123-8206-13eced3172fb => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:10.743395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-280db52c-6dd5-4429-a437-fcbc964889c9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fcff70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:10.901992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:10.930705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-280db52c-6dd5-4429-a437-fcbc964889c9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.196808 Oct 04 20:46:10.933476 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1004/2054] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:10 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:10.946430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6965b44e-9d69-49c2-8273-5992de434e44 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:10.951958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:10.964433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6965b44e-9d69-49c2-8273-5992de434e44 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:10.965530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:10.971747 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e96c0f2-7199-4b67-95a7-6e4f1d6a91ae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.462605 Oct 04 20:46:10.975042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1051/2055] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:09 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:11.417171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6965b44e-9d69-49c2-8273-5992de434e44 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:11.444277 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6965b44e-9d69-49c2-8273-5992de434e44 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1214 microversion: 2.1 time: 0.505831 Oct 04 20:46:11.445457 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1005/2056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:10 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1214 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:11.961016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0add2903-00c6-44a2-8cf0-3251e6f0bba1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa567d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.034286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.055937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.074971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.076371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.077555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.080294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.081637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.083859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.110463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0add2903-00c6-44a2-8cf0-3251e6f0bba1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.157075 Oct 04 20:46:12.120525 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1052/2057] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:11 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:12.509998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb3c57d3-1d23-43df-9301-3bcf89d28126 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.515888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb3c57d3-1d23-43df-9301-3bcf89d28126 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.826080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.845419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb3c57d3-1d23-43df-9301-3bcf89d28126 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.852571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.856821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.860735 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50d19402-dfa0-4b3b-b7ad-04c632d21eec tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.833969 Oct 04 20:46:12.863636 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1006/2058] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:12.878077 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb3c57d3-1d23-43df-9301-3bcf89d28126 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1214 microversion: 2.1 time: 0.378006 Oct 04 20:46:12.921735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1053/2059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1214 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:13.149780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-885f385a-9a0d-465a-bbc6-9d16553c5b0e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6082d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.377053 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-885f385a-9a0d-465a-bbc6-9d16553c5b0e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.234421 Oct 04 20:46:13.382065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1007/2060] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:13.916766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.923501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.940743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.942020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.984126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.006083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.008588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.016709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.028094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.029127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.030325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.031293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.031983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.039202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.052631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.052631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.033939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:15.079653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edb40e07-277b-45df-9b4f-4ff3c5ce6700 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1218 microversion: 2.1 time: 1.135803 Oct 04 20:46:15.087851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1008/2061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1218 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:15.106040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5979b29b-8c23-474f-b288-d891e97d48e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5e49d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:15.644158 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5979b29b-8c23-474f-b288-d891e97d48e7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.556159 Oct 04 20:46:15.652137 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1009/2062] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:15 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:16.039954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.110625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.228714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.228714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7fb4df7-075b-4aff-ad5a-ee33aa05b270 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 2.216369 Oct 04 20:46:16.232733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.233698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1054/2063] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.233845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.680218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97f38f6d-d523-4469-ae32-d9b098a481f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa544820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.686344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.726919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69074468-9a3c-471e-b4a6-7db514a1bfdc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1266 microversion: 2.1 time: 0.604395 Oct 04 20:46:16.729680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1010/2064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1266 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:17.185756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:17.191936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:17.227234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.234374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.238530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.241395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.247819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.247819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:18.919985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:19.037022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:19.077176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:19.090284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8bab82bc-aa34-44a5-996b-03c929527a34 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.904973 Oct 04 20:46:19.102742 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1011/2065] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:17 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:19.158719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4fd6fd-bf2b-4756-aa13-0efeaeb92491", "name": "network-vif-plugged", "status": "completed", "tag": "d8fcf76b-d817-493d-9b58-bf3739f27341"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:19.307274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:19.315147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:19.320180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:19.490309 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] Creating event network-vif-plugged:d8fcf76b-d817-493d-9b58-bf3739f27341 for instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 on n-h1-851029-13 Oct 04 20:46:19.603346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f0e7d967-5e90-43b7-afcd-c8ee56094b9a req-44c94f7f-70d0-4b98-acaa-116a776466f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.495151 Oct 04 20:46:19.614119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1012/2066] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:19.649365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:19.660833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:19.686941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:19.704906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:19.707291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:19.713219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:19.716294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:19.727896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.032490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:20.224928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:20.242859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:20.297571 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-45f8e583-a8f6-4cce-8b6f-dc7e3a546171 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1272 microversion: 2.1 time: 0.679630 Oct 04 20:46:20.319516 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1013/2067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:19 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1272 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.363254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.379457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:20.444284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.450710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.456442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.469009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.476631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.481146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.167005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.217214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.229377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.231711 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-884a90de-7704-4c98-bd11-96519534ee59 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.906453 Oct 04 20:46:21.238816 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1014/2068] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:21.373930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.383297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:21.448283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:21.464688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.468427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.474085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.483841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.491448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.500047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.080631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:22.116284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d98cedb2-3058-415f-bf58-97d8cb48fce3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1272 microversion: 2.1 time: 0.752995 Oct 04 20:46:22.117403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1015/2069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1272 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:22.297363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:22.299134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:22.342062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.342887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.363216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.364456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.365513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.366231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.872245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:22.987671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:23.066594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:23.106439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:23.115677 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6b9f765-90f5-43f2-884f-567e638f1f2b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 0.829618 Oct 04 20:46:23.128580 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1016/2070] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:22 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:23.180196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:23.191074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:23.275895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:23.307735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:23.324245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:23.353811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:23.354736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:23.372148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:23.831352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:23.869339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e963c4f-9ae6-48bf-950b-7c6a16e27c89 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1272 microversion: 2.1 time: 0.709073 Oct 04 20:46:23.883378 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1017/2071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:23 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1272 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:23.982964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:24.177361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:24.198168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:24.248864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.249594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.250185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.263926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.264877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.265705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.292847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.373232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.420174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.439707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6a3d1f60-62dc-4cc1-9b4f-b61aa3f26a70 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1487 microversion: 2.25 time: 1.270627 Oct 04 20:46:25.454030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1018/2072] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:24 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1487 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:25.543665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8abb32f5-3dd8-4209-9d37-237def55e538"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:25.566266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:25.636908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.646577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.658622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.660282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.660830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.661596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.115192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:28.187769 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81e3b254-81c9-47e4-9914-003be00f8bfd tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "POST /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.724293 Oct 04 20:46:28.223104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1019/2073] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 20:46:25 2022] POST /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments => generated 194 bytes in 2768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:28.251096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:28.268270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:28.320025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.326020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.333269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.339223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.346521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.351690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.659351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.753325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67df349a-a688-4864-b0f0-a9974fd74071 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 2.520387 Oct 04 20:46:30.757614 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1020/2074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:28 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:30.778817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:30.780957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:30.793916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.794885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.796259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.801208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.802187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.803028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:32.249045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.289326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.315846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.326651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b86a60a-85ce-4511-ac18-d82012601dcb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1477 microversion: 2.25 time: 1.566785 Oct 04 20:46:32.345900 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1021/2075] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:30 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1477 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:32.371105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:32.379511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:32.418039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:32.422379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:32.431357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:32.432817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:32.434964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:32.436506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:32.437763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.612599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.640800 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5da88206-14c7-439c-8ffd-57a26786a6d5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 1.291665 Oct 04 20:46:33.642869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1022/2076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:32 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:33.654603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec548e73-6eee-4fb5-97f1-92b09b8bacc8 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '.version_select at 0x7f54f605b280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.680611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec548e73-6eee-4fb5-97f1-92b09b8bacc8 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.685961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec548e73-6eee-4fb5-97f1-92b09b8bacc8 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.687258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec548e73-6eee-4fb5-97f1-92b09b8bacc8 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.771468 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec548e73-6eee-4fb5-97f1-92b09b8bacc8 tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3232 microversion: 2.25 time: 0.126115 Oct 04 20:46:33.774497 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1023/2077] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/os-migrations => generated 3232 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:33.815530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.817712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.846032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.853115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.854708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.856563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.860080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.862403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.460196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] Lazy-loading 'services' on Instance uuid b8c83d26-8216-4085-9143-ad9c3f90961e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:34.570879 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca4252bc-ad25-4f33-affd-7b1d09d8a72c tempest-LiveAutoBlockMigrationV225Test-987351324 tempest-LiveAutoBlockMigrationV225Test-987351324-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1971 microversion: 2.25 time: 0.729422 Oct 04 20:46:34.630565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1024/2078] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1971 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:34.666093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:34.718930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.720968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.722192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.769065 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] Creating event network-changed:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:46:34.793604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2abbd44e-bbf5-42e4-a122-1442cd7d6abb req-a5bcc775-da6f-49a7-b48d-00706a1c618f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158055 Oct 04 20:46:34.795753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1025/2079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:34.815460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.835022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.846803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.851923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.853233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.859244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.860822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.862565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.991997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:36.342627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c69dc7f-e8ac-42fa-91e6-a78601e06497 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 204 len: 0 microversion: 2.25 time: 1.543922 Oct 04 20:46:36.344875 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1026/2080] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:46:34 2022] DELETE /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 0 bytes in 1548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:46:36.369761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.376788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.417046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.418508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.420449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.425690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.427217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.434274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.585371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.634502 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e140715c-34f5-4e51-9aa8-ae45894c0739 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 1.280324 Oct 04 20:46:37.635799 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1027/2081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.652661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.653510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.715052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.715391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.719497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.721275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.722193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.726364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.800706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:37.875943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:38.774151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-792ad910-35e0-4f0e-a1b3-b0c22b1b98aa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 204 len: 0 microversion: 2.1 time: 1.135733 Oct 04 20:46:38.775706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1028/2082] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:37 2022] DELETE /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:38.796287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.799774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.826176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.827546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.828402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.832489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.833444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.834185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.896479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:39.956484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:39.967644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:39.970807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f8756f6-0490-44d3-b538-0c4d2b39b451 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1483 microversion: 2.25 time: 1.192063 Oct 04 20:46:40.007493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1029/2083] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1483 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:40.040195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.046465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.089142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.097767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.099245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.101055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.102344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.103496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.964813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97f38f6d-d523-4469-ae32-d9b098a481f8 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 25.293622 Oct 04 20:46:41.967160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1055/2084] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 25297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.984615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.002919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:42.031517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.036098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.039941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.041418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.042315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.043176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.416909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.451546 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9520386f-cd49-4a4b-bb29-f6c02f900ac5 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 2.440342 Oct 04 20:46:42.457594 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1030/2085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:42.480999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.491089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:42.513117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.514106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.515216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.516859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.517970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.518806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.053112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.102570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.111983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.129849 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6946b61e-65cf-4885-8a6d-2a1060031de5 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1441 microversion: 2.25 time: 0.660386 Oct 04 20:46:43.131756 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1031/2086] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:42 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1441 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:43.980875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-968a6a76-9924-44ce-bc80-26d73bb14545 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Action: 'create', calling method: .version_select at 0x7f54f5f7aaf0>, body: {"keypair": {"name": "tempest-keypair-1102780507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVPz5iFuIozH5AKlSjDyzWVZZbVQxa7bG1sbk28Vqfso4nJCt+rnCSLIyEjLLUSRT/t71dpKs3PKv2KWeu20a4s02rjFt12L9zHjHYNVxULjdcgC8ytEChlXCPUiv7ajA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.024779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-968a6a76-9924-44ce-bc80-26d73bb14545 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Getting quotas for project 585040147d924bc781b6ff3b75c70714. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:44.053250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-968a6a76-9924-44ce-bc80-26d73bb14545 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Getting quotas for user 22537f1c2f9f44febcd351c5a1c065f4 and project 585040147d924bc781b6ff3b75c70714. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:44.061744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.095899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fc06201-4b6c-4943-a70b-a572e5057708 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1666 microversion: 2.1 time: 2.125046 Oct 04 20:46:44.122815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1056/2087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1666 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:44.260051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-968a6a76-9924-44ce-bc80-26d73bb14545 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.125936 Oct 04 20:46:44.269823 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1032/2088] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:46:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:44.303142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-552e3d8b-d630-4e71-88f2-19c129febb06 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61c69d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.367231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c83d26-8216-4085-9143-ad9c3f90961e", "name": "network-vif-deleted", "tag": "e583e59b-6d6c-445e-90fe-8154329b026e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.396518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.397662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.398738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.427059 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] Creating event network-vif-deleted:e583e59b-6d6c-445e-90fe-8154329b026e for instance b8c83d26-8216-4085-9143-ad9c3f90961e on n-h2-851029-13 Oct 04 20:46:44.440180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-809d632f-6fda-48f7-a260-88f196f68089 req-07c3f804-3c19-4d78-afff-f196c4c66d89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.325975 Oct 04 20:46:44.442778 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1057/2089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:44.455618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.457289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.476837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.478129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.479315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.480904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.481992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.497189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.581673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-552e3d8b-d630-4e71-88f2-19c129febb06 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.299902 Oct 04 20:46:44.586049 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1033/2090] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:44.614842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.627677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.675839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.676749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.680092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.681637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.682389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.686474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:45.668189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.708246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.712027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:45.727218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47b66ecf-73e8-4315-a82c-4d61e481cc61 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 1.136249 Oct 04 20:46:45.734227 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1034/2091] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:45.747612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:45.763763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:45.788403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:45.789317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:45.790398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:45.792008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:45.792891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:45.793663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:46.556322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:46.601582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5830618-32a4-4f67-89b4-d02918f47ea7 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 2.155698 Oct 04 20:46:46.622568 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1058/2092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:46.673756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a491c49c-6d81-43b0-beab-76eba0c1dbad tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa58b790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:46.731347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:46.754546 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-399dc076-0a91-4b5a-8799-84561b62fac6 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1666 microversion: 2.1 time: 1.018122 Oct 04 20:46:46.757262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1035/2093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:45 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1666 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:46.796742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:46.797658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:46.811086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:46.811086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:46.811086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:46.811086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:46.812068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:46.812873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:46.847969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a491c49c-6d81-43b0-beab-76eba0c1dbad tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.195779 Oct 04 20:46:46.853305 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1059/2094] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:46 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:46.987138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.025396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.041430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:47.044847 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e869e00-4943-4cdf-898e-ee10a943d94f tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 0.263719 Oct 04 20:46:47.060560 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1036/2095] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:46 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:47.670318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:47.676343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:47.715437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.716787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.725089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:47.726915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.735989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.737527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:47.806238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:47.807766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:47.863503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.863503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.863503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:47.863503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:47.864113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:47.864484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:48.333805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:48.366418 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23ee2331-0590-4c2d-8754-4ef4719be7b8 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1599 microversion: 2.1 time: 0.568557 Oct 04 20:46:48.374157 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1037/2096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:47 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1599 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:48.399136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0ef7070-ce6c-46db-9364-7c406533e1b5 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61ac160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:48.638632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0ef7070-ce6c-46db-9364-7c406533e1b5 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.260825 Oct 04 20:46:48.656760 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1038/2097] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:48 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:48.670193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:48.674436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:48.696756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:48.699762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:48.701877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:48.705402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:48.708352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:48.709950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.302888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.323764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.328024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.331304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-051c82df-0b33-4d9d-8c66-02f5c4ce5c40 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 0.669240 Oct 04 20:46:49.332950 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1039/2098] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:48 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:49.343608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "name": "network-vif-plugged", "status": "completed", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:49.366694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.367931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.368783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.406911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] Creating event network-vif-plugged:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:46:49.442051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6eb454b0-19f4-40fa-b209-d94365289a13 req-5b114014-fa44-4a6d-a363-1ebdd7fd1829 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092167 Oct 04 20:46:49.443425 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1040/2099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:49.470527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:49.476712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:49.500221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.501413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.502225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.504719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:49.505720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:49.506913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:49.824517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:49.850872 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b56c58ae-9cfd-4b3a-8879-8bfdf471155f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 2.188498 Oct 04 20:46:49.875213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1060/2100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:47 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:49.894367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9cb8d1e4-6988-4286-919e-85a8bc845153 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa544b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:50.026985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:50.042274 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9cb8d1e4-6988-4286-919e-85a8bc845153 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.161133 Oct 04 20:46:50.057022 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1061/2101] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:49 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:50.062477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f007d418-049b-4d76-bbea-6575c7149b38 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1599 microversion: 2.1 time: 0.614327 Oct 04 20:46:50.064284 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1041/2102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:49 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1599 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:50.389361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:50.390469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:50.435932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:50.436861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:50.437724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:50.439207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:50.439977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:50.440798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:50.599291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091134c5-522b-43bf-969e-84f525b93ee0", "name": "network-vif-deleted", "tag": "a054491d-0a85-4a23-8840-f32382ad2d67"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:50.627339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:50.628876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:50.629592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:50.671765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] Creating event network-vif-deleted:a054491d-0a85-4a23-8840-f32382ad2d67 for instance 091134c5-522b-43bf-969e-84f525b93ee0 on n-h2-851029-13 Oct 04 20:46:50.703005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-699a3b90-51d7-4efb-8452-e742dea11749 req-1599923c-d04f-42a7-8362-f1e64afcbebc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412097 Oct 04 20:46:50.708074 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1062/2103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:50.904019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:50.912061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:50.942431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:50.948553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:50.951307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:50.954895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:50.960349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:50.961618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:51.043945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:51.092673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:51.114512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:51.117315 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63106b4a-6977-428f-bc31-2c9954af6ffe tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 0.734421 Oct 04 20:46:51.127339 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1042/2104] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:50 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:51.149451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07c68003-7e45-4bbc-a198-44b02f74834a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61ac310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:51.307752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-07c68003-7e45-4bbc-a198-44b02f74834a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.176844 Oct 04 20:46:51.334709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1043/2105] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:51 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:51.337803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:51.339040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:51.372512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:51.373530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:51.374531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:51.378439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:51.379570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:51.380660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:51.468889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:51.470873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:51.471787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:51.475825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lazy-loading 'fault' on Instance uuid 091134c5-522b-43bf-969e-84f525b93ee0 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:52.131181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.147651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.156062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5859b9bb-bc89-4bbd-be7c-294f484aac78 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1314 microversion: 2.1 time: 1.266538 Oct 04 20:46:52.168935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1063/2106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:50 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:52.186653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:52.188939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:52.215250 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53306751-962e-40e8-9344-2bb0e74af01f tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 200 len: 1324 microversion: 2.1 time: 0.890350 Oct 04 20:46:52.228781 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1044/2107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:51 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 1324 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:52.238775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:52.240473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:52.244706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:52.246596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:52.257065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:52.258271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:52.365752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfc84254-29d6-4065-a7ad-20af74553420 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f3d550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:52.612082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfc84254-29d6-4065-a7ad-20af74553420 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.266905 Oct 04 20:46:52.613852 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1045/2108] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:52 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:52.711979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.748201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.754382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:52.768543 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8835be44-b099-45e9-9cbe-571ab537bc03 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 0.593911 Oct 04 20:46:52.773437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1064/2109] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:52 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:53.227608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.232375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.273891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.276347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 091134c5-522b-43bf-969e-84f525b93ee0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.314205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.315505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.318625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.326469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.327558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.328425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.337164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.339293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.340081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.344553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.351588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.352800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.411525 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] HTTP exception thrown: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Request method failure captured: Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 HTTP/1.1 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJhsQF_pZFbiHKAwaTKG6Sqx5LAUmIp--DqAT2SyE-dSA4w34n3J58oPV-iWH-UEWY8LOFgUeUlGpU_rsdQgqPcw9cHXMm8mBaxUi1NMgdPeO6r1iVdES6WvJvHD82TDaW6beVYWYx-Ksbf7gZ7ia4m0oueUu6I6DEqxmA0TtkS6RCc Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2dd088c880894556b8525b41e5684eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2dd088c880894556b8525b41e5684eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveMigrationTest-187330508 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveMigrationTest-187330508-project Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 44a42dd2dd73439bbe445de3b2eb9744 Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveMigrationTest-187330508-project Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '091134c5-522b-43bf-969e-84f525b93ee0'} Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:53.430526 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Returning 404 to user: Instance 091134c5-522b-43bf-969e-84f525b93ee0 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:53.437783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4747dbe-8e1a-491a-b8ba-1f5f43695b7d tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0" status: 404 len: 111 microversion: 2.1 time: 0.173270 Oct 04 20:46:53.449847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1065/2110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/091134c5-522b-43bf-969e-84f525b93ee0 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:53.481559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e3c5724-8cab-4acc-aab8-3eac35e80420 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '.version_select at 0x7f54fa693430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.680487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e3c5724-8cab-4acc-aab8-3eac35e80420 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041462478" status: 202 len: 0 microversion: 2.1 time: 0.221975 Oct 04 20:46:53.680487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1066/2111] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:46:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041462478 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:46:53.702524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e073d35-fb34-4ec8-bf59-94e6131b578a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa6b5ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.970349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e073d35-fb34-4ec8-bf59-94e6131b578a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.250220 Oct 04 20:46:53.970349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1067/2112] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:53.970349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.970349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.013260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.015864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.016207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.024091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.027138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.028148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.092860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:54.520875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.575302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.590171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.592544 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc1f674f-109c-4394-a878-2326c861b6f9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 200 len: 1265 microversion: 2.25 time: 0.654522 Oct 04 20:46:54.594973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.609461 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1068/2113] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 1265 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:54.668328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15f5f5b9-f63f-41aa-a74e-e4158cb8d5ef tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1502 microversion: 2.1 time: 1.454262 Oct 04 20:46:54.698065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1046/2114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1502 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:54.727349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359342469"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:54.728362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.754855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.755768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.756699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.758050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.759012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.759810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.965163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2eb4a17a-8d4c-4dd7-8a0a-3689f3d25ac3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f60013a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.195198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2eb4a17a-8d4c-4dd7-8a0a-3689f3d25ac3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.237132 Oct 04 20:46:55.197960 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1047/2115] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.436134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-274385938", "imageRef": "3a60ca3e-2ae7-46cb-b4ec-28c997b227af", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "214ef424-e736-4036-8fad-5ff1ee7b8b68"}], "security_groups": [{"name": "tempest-securitygroup--967882966"}], "key_name": "tempest-keypair-1102780507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:56.471902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] validate_networks() for [('214ef424-e736-4036-8fad-5ff1ee7b8b68', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:57.547884 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Adding security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 to port d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac Oct 04 20:46:59.950879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e22279a-faba-4ad6-8f91-af340ebb4e39 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action" status: 202 len: 0 microversion: 2.1 time: 5.232629 Oct 04 20:46:59.952527 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1069/2116] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:54 2022] POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action => generated 0 bytes in 5236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:46:59.973436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.976698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: b8c83d26-8216-4085-9143-ad9c3f90961e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.007058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.008665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.011339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.021146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.022481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.028179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.088245 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] HTTP exception thrown: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Request method failure captured: Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e HTTP/1.1 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJidX9uqiVLIWmYC1CqmQ3XN1XZTd-oO93oRQyKGuUxBPwpe0iFTMNqfcYa9tJJ5m1mUVfpEipP_2ZeU0emUZ_nJAkxLUrtxJP7g0bzLdB2eWBTlWmgTZPea3gaX6s5cRyMWX4KtSH10iQ5H9RNVdRe7o5tSD9BJ38ToQsQX1CkWYKs Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ccb7a2196402402a880493998d67e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ccb7a2196402402a880493998d67e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 07dfa4ed8d314142a365c3e67fe5b334 Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b8c83d26-8216-4085-9143-ad9c3f90961e'} Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. Oct 04 20:47:00.092280 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. Oct 04 20:47:00.100395 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:00.103002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Returning 404 to user: Instance b8c83d26-8216-4085-9143-ad9c3f90961e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:00.107112 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb072fe4-c36f-420f-a386-a42f65e3328b tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e" status: 404 len: 111 microversion: 2.25 time: 0.152569 Oct 04 20:47:00.115853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1070/2117] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/b8c83d26-8216-4085-9143-ad9c3f90961e => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:00.133251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50dba6dd-94f8-44c4-b97d-285dd467c7a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa6a0820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.244296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:00.246150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:00.257409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:00.259130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:00.261924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:00.314327 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50dba6dd-94f8-44c4-b97d-285dd467c7a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.196208 Oct 04 20:47:00.323268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.323582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1071/2118] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:00.331052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.331052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.332200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.333234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.335479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.339742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.346182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.381012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.383300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.387629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.392481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.393668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.396365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.407826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Getting quotas for project 585040147d924bc781b6ff3b75c70714. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:00.431999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Getting quotas for user 22537f1c2f9f44febcd351c5a1c065f4 and project 585040147d924bc781b6ff3b75c70714. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:00.477377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:00.483311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a60ca3e-2ae7-46cb-b4ec-28c997b227af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:00.538266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:00.868749 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43751f40-79e5-4c40-b6bf-7e33610a84b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.442136 Oct 04 20:47:00.876282 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1048/2119] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 5451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:47:00.894153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f6016ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.395824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99a3fecf-5966-4b49-b3b6-396101d422ca tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 204 len: 0 microversion: 2.1 time: 1.069614 Oct 04 20:47:01.402028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1072/2120] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:00 2022] DELETE /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:01.429564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:01.473147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use.", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:47:01.475026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.475026 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80 HTTP/1.1 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: exception: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '38e6b3f4-3dfa-41db-b6c1-38ae96043b80'} Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:47:01.480043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 400 to user: Security Group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 in use. Oct 04 20:47:01.489751 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7ae23469-44d7-48e3-8e7f-cbd066430c9a'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:01.500582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5773267c-c3e8-4566-935f-d4f59bb1a902 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80" status: 400 len: 185 microversion: 2.1 time: 0.616413 Oct 04 20:47:01.515570 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1049/2121] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:47:00 2022] DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80 => generated 185 bytes in 638 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:01.520553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.526623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.527439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.536928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d92e4389-abff-4367-8a2c-ef21bb387b7d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.544343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d92e4389-abff-4367-8a2c-ef21bb387b7d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.584858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] Creating event network-changed:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:47:01.606535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3f803f69-663f-49df-9fe9-cd819ddd0460 req-be20a68e-5983-44b1-887d-a01d2d0f6f64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198092 Oct 04 20:47:01.612409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1073/2122] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:01.648340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f13aa9b3-bb7c-4b37-8d51-24efcee7a21b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa51bc10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.831966 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f13aa9b3-bb7c-4b37-8d51-24efcee7a21b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.215972 Oct 04 20:47:01.839184 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1074/2123] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:01.856806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.858201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.890365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.892156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.893337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.895327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.896479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.897481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.938810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d92e4389-abff-4367-8a2c-ef21bb387b7d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.991134 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d92e4389-abff-4367-8a2c-ef21bb387b7d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1245 microversion: 2.1 time: 0.459491 Oct 04 20:47:01.991134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1050/2124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1245 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:02.001813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:02.046606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.095832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.097136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.101817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.103615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.109281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.110500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.346124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:02.668124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-045ab799-7d4c-4af4-aa27-aa0463162ca2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action" status: 202 len: 0 microversion: 2.1 time: 0.663044 Oct 04 20:47:02.670058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1051/2125] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:01 2022] POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:02.722748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.730716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.772204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.778602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.785343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.792234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.794009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.798190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.983649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.014328 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76cdb615-850e-4d50-a8b4-dc49c5a63eea tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1485 microversion: 2.1 time: 1.172913 Oct 04 20:47:03.026394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1075/2126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1485 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:03.058825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e0059b8-bfe1-4de5-8281-32f5ef93b92e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa54e4c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.197163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e0059b8-bfe1-4de5-8281-32f5ef93b92e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.169854 Oct 04 20:47:03.198985 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1076/2127] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:03.209482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84e1d9bc-f299-4429-a83f-99e76ea2b22f tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.211809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84e1d9bc-f299-4429-a83f-99e76ea2b22f tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.523100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84e1d9bc-f299-4429-a83f-99e76ea2b22f tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.601038 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84e1d9bc-f299-4429-a83f-99e76ea2b22f tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1245 microversion: 2.1 time: 0.397503 Oct 04 20:47:03.624104 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1077/2128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1245 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.087083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.097241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.103698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.147088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a036f076-2ad1-43f1-882f-185c341c30fc tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1572 microversion: 2.1 time: 1.436516 Oct 04 20:47:04.153971 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1052/2129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1572 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:04.198989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.202034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.207148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.217581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.232228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10080905-eb51-4a93-a4da-d552ad5ac911 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61d18b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.236210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.237648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.465711 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10080905-eb51-4a93-a4da-d552ad5ac911 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.242250 Oct 04 20:47:04.471614 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1053/2130] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.663995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5803c8e5-c8d4-4ea7-87a6-7442a38e67a1 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.667290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5803c8e5-c8d4-4ea7-87a6-7442a38e67a1 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.723733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:05.148129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5803c8e5-c8d4-4ea7-87a6-7442a38e67a1 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.181756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.186542 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5803c8e5-c8d4-4ea7-87a6-7442a38e67a1 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1245 microversion: 2.1 time: 0.521942 Oct 04 20:47:05.200114 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1054/2131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1245 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:05.219279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c12a9eb5-9272-4b4d-9337-89c22fca439c tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1485 microversion: 2.1 time: 1.132110 Oct 04 20:47:05.228093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.229574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.237472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1078/2132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1485 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:05.248757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.251863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.253334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.255309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.256692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.258046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.499074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bee55f6-e62b-4f38-97b6-e9c9a741279f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa5448b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.713924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bee55f6-e62b-4f38-97b6-e9c9a741279f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1413 microversion: 2.1 time: 0.221648 Oct 04 20:47:05.719223 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1079/2133] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1413 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:06.241020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.244278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.292414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:06.302139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.304007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.307386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.314312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.315983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.318275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.760456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.826004 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb019ae9-23e8-4815-9cb7-f06c5856ce34 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1249 microversion: 2.1 time: 0.598428 Oct 04 20:47:06.830778 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1080/2134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1249 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:06.853378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.861918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.919322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.920799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.921503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.924699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.926013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.927147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.960218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:07.760383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.778012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.796057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f4e7013-f5fa-4584-b02b-6fbaeeef4a94 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1572 microversion: 2.1 time: 2.588869 Oct 04 20:47:07.798258 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1055/2135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1572 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:07.823960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79daa417-b87d-494b-a12d-4b8b7cb89cf0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f609f3a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.839628 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a0be6a7-f237-4295-8438-1fb774f14efa tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1443 microversion: 2.1 time: 0.997506 Oct 04 20:47:07.848555 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1081/2136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1443 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:07.873357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875089be-27da-4346-9b00-9dbf9e0c29db", "name": "network-vif-deleted", "tag": "16698709-0ed6-4fc5-b6f6-032962863637"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:07.957164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.964244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.966154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.020784 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] Creating event network-vif-deleted:16698709-0ed6-4fc5-b6f6-032962863637 for instance 875089be-27da-4346-9b00-9dbf9e0c29db on n-h1-851029-13 Oct 04 20:47:08.035016 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79daa417-b87d-494b-a12d-4b8b7cb89cf0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1422 microversion: 2.1 time: 0.231090 Oct 04 20:47:08.057988 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-22670c36-403e-45b8-a8a3-c62beacb201d req-d2028cf6-07ce-4bd2-818f-0ce9dedfc447 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204626 Oct 04 20:47:08.068655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1082/2137] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:08.069285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1056/2138] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1422 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:08.083105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4eca517b-0efb-4154-8213-6985d2ee82db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6016dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.105793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.107188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:08.144886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.146732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.151860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.160724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.167867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.172214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.328806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4eca517b-0efb-4154-8213-6985d2ee82db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 200 len: 1422 microversion: 2.1 time: 0.257267 Oct 04 20:47:08.333738 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1057/2139] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 1422 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:08.408685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6de5bab1-e866-4aee-abd8-0c128eb9235e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5dc5a60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.695870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:08.741834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c20b593-80d9-4211-9733-a2304e6b503e tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1297 microversion: 2.1 time: 0.662040 Oct 04 20:47:08.779826 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1083/2140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1297 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:08.854097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.861183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:08.900610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.913898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.926046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.926046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.931694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.940842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.387355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:10.864914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.885073 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-232299f9-9239-4bc8-bcd5-72942050aba8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1572 microversion: 2.1 time: 2.041156 Oct 04 20:47:10.887021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1084/2141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1572 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:10.902501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:10.905163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:10.928972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.939037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.940502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.944536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.947003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.949903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.214040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.216550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.218047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.219275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lazy-loading 'fault' on Instance uuid 875089be-27da-4346-9b00-9dbf9e0c29db {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:11.640965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a42dd2dd73439bbe445de3b2eb9744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd088c880894556b8525b41e5684eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.690364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fa4f2b8-aa29-408b-9211-4bfbfa6bec79 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 200 len: 1301 microversion: 2.1 time: 0.791950 Oct 04 20:47:11.691899 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1085/2142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:10 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 1301 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:12.105674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1615872872", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:12.618548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6de5bab1-e866-4aee-abd8-0c128eb9235e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 204 len: 0 microversion: 2.1 time: 4.259868 Oct 04 20:47:12.619887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1058/2143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:08 2022] DELETE /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 0 bytes in 4264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:12.646538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:12.647916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:12.661492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:12.662506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:12.663808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:12.665497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:12.666697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:12.667759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:12.706810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] validate_networks() for [('f49455e2-ee7b-48b0-8c4c-b8a053c5b4f8', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:12.944837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:12.989697 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f69cbd4-3a18-4ce7-8d70-acba4a8fd501 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1303 microversion: 2.1 time: 0.367268 Oct 04 20:47:12.994502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1059/2144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:12 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1303 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:13.030501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:13.032598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:13.060930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:13.066906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:13.079186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:13.081745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:13.083175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:13.084431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:13.548785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:14.375741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:14.435588 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-010a501b-2db1-441a-bbb8-5e40c6e3f8de tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1570 microversion: 2.1 time: 1.437577 Oct 04 20:47:14.450702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1060/2145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:12 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1570 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:15.162847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0029e3b3-51cd-4a42-865a-d6e8a4b7938c"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:15.167913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.195155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:15.198583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.204453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.209909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.211841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.218089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.219461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.606865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] HTTP exception thrown: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Request method failure captured: Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments/8abb32f5-3dd8-4209-9d37-237def55e538 HTTP/1.1 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 74 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJs3KWCKV4-yHCCjLhmn_GArXwSveevDOFIphgf-HnBWUGfK5F_HXf3hn7_P3pkxC0YYEkTIIOe210i9DMkuiWK6M9mZzQdcc89MqfYpJztpuKaQImrozY7m4zkqj7TuAu2Xf4s5iq5m81rt1iX2wZkwN_Rhze0PSsdcUhXPdJNMPBU Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 6db960046c1c449fb3cc9c24cae5f76d Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 6db960046c1c449fb3cc9c24cae5f76d Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesAdminNegativeTest-1527676164-project-admin Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0cdab3f9a61547908e5e3d8499e5b916 Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesAdminNegativeTest-1527676164-project-admin Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: {"volumeAttachment": {"volumeId": "0029e3b3-51cd-4a42-865a-d6e8a4b7938c"}} Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': '14b36a3e-8320-4100-9567-baff91fcf2dd', 'id': '8abb32f5-3dd8-4209-9d37-237def55e538', 'body': {'volumeAttachment': {'volumeId': '0029e3b3-51cd-4a42-865a-d6e8a4b7938c'}}} Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. (HTTP 404) (Request-ID: req-e3d3448b-5cf4-4363-93f5-658546411dfc) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:47:15.647300 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. Oct 04 20:47:15.654020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:15.662874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Returning 400 to user: Volume 0029e3b3-51cd-4a42-865a-d6e8a4b7938c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:15.663304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4b5213a3-ce89-47d8-82d4-268f6fc3be4c tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments/8abb32f5-3dd8-4209-9d37-237def55e538" status: 400 len: 107 microversion: 2.1 time: 1.221582 Oct 04 20:47:15.665241 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1061/2146] 10.222.0.36 () {60 vars in 1433 bytes} [Tue Oct 4 20:47:14 2022] PUT /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments/8abb32f5-3dd8-4209-9d37-237def55e538 => generated 107 bytes in 1226 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:15.700793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:15.707390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.775505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.776793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.778107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.780511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.783569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.787965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.009916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:16.632738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-095c3121-00f8-4358-95fd-894bcebadf2b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 204 len: 0 microversion: 2.1 time: 0.964788 Oct 04 20:47:16.633922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1062/2147] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:15 2022] DELETE /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:16.675810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.693862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 875089be-27da-4346-9b00-9dbf9e0c29db] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:16.803590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.804631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.805478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.806904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.807794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.826933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.967686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] HTTP exception thrown: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Request method failure captured: Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db HTTP/1.1 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhsQF_pZFbiHKAwaTKG6Sqx5LAUmIp--DqAT2SyE-dSA4w34n3J58oPV-iWH-UEWY8LOFgUeUlGpU_rsdQgqPcw9cHXMm8mBaxUi1NMgdPeO6r1iVdES6WvJvHD82TDaW6beVYWYx-Ksbf7gZ7ia4m0oueUu6I6DEqxmA0TtkS6RCc Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2dd088c880894556b8525b41e5684eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2dd088c880894556b8525b41e5684eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveMigrationTest-187330508 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveMigrationTest-187330508-project Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 44a42dd2dd73439bbe445de3b2eb9744 Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveMigrationTest-187330508-project Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '875089be-27da-4346-9b00-9dbf9e0c29db'} Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:16.973695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. Oct 04 20:47:16.980882 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:16.988259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Returning 404 to user: Instance 875089be-27da-4346-9b00-9dbf9e0c29db could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:16.989896 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c169a03-f680-4717-a720-0f6740d81013 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db" status: 404 len: 111 microversion: 2.1 time: 0.353375 Oct 04 20:47:17.001574 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1063/2148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:16 2022] GET /compute/v2.1/servers/875089be-27da-4346-9b00-9dbf9e0c29db => generated 111 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:17.233464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-895814112", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:17.452110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] validate_networks() for [('3f71e3c8-2f24-4002-ad98-706d0dd02af4', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:18.382051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:18.384513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:18.385759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:18.387134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:18.390199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:18.459360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.460794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.461719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.474410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.475457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.488426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.678066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Getting quotas for project 291b7a745e214dbda2af246e45c5eb6a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:18.774607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Getting quotas for user 42d0482443d2472b80ab46311c0a6815 and project 291b7a745e214dbda2af246e45c5eb6a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:18.936722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:18.968905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:19.441363 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c28f9b0-926d-4b6e-a2c2-483a0052fb28 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.702384 Oct 04 20:47:19.455542 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1086/2149] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 7724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:19.856040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4fd6fd-bf2b-4756-aa13-0efeaeb92491", "name": "network-vif-unplugged", "status": "completed", "tag": "d8fcf76b-d817-493d-9b58-bf3739f27341"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:19.885730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.890393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.896948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.925942 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] Creating event network-vif-unplugged:d8fcf76b-d817-493d-9b58-bf3739f27341 for instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 on n-h1-851029-13 Oct 04 20:47:19.944080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-20838002-62ed-4a75-b1e9-af0d0f3ed164 req-3b3ef395-d08c-4dc3-a3c0-8417fb57eef1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.484597 Oct 04 20:47:19.947015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1087/2150] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:19.962121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.964612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:19.990997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.995673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.001190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.006130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.010984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.013584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.481239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:21.482373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:21.482929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:21.483731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:21.484618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:21.537288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.538361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.539226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.540747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.541646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.542457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.659664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Getting quotas for project 35f87b9aeb584936b843faaae144921d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:21.689808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Getting quotas for user 9dad81a0d0e7483faca4215294efb6bb and project 35f87b9aeb584936b843faaae144921d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:21.801828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:21.809000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:21.892399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.971048 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-574fac16-8228-4d76-b248-2d573ce74e19 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 1.996332 Oct 04 20:47:21.975231 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1088/2151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:22.004654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1952943793"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:22.005694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:22.073837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.074814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.083372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.089110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.090480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.093425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.220938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8780c25b-19d1-405b-993b-8ce28c2cc4ff tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.221462 Oct 04 20:47:22.235997 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1064/2152] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:22.251554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:22.255333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:22.339073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.353456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.355108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.364157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.371811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.376913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.768746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lazy-loading 'services' on Instance uuid 14b36a3e-8320-4100-9567-baff91fcf2dd {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:23.358808 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6aedaf25-a10e-4e6d-9391-a9caacd598b2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "DELETE /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments/8abb32f5-3dd8-4209-9d37-237def55e538" status: 202 len: 0 microversion: 2.1 time: 1.119730 Oct 04 20:47:23.362451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1065/2153] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 20:47:22 2022] DELETE /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments/8abb32f5-3dd8-4209-9d37-237def55e538 => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:23.374789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.376587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.396677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.399317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.401430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.403684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.405043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.409233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.530107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:23.684318 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Adding security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 to port d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac Oct 04 20:47:24.283268 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b5a93f2-1d04-474c-bc1b-a3ecb6938145 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "DELETE /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 204 len: 0 microversion: 2.1 time: 0.917434 Oct 04 20:47:24.290285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1066/2154] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:23 2022] DELETE /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 0 bytes in 927 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:24.313923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1280237945", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "7799ac52-f6d5-4905-977d-0ebc15f0fd4a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.853707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] validate_networks() for [('7799ac52-f6d5-4905-977d-0ebc15f0fd4a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:28.580090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:28.831823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:31.609071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:31.748936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:32.044197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:32.220803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=41 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:33.539062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb27061a-9727-4d68-a298-8c11355370fd tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action" status: 202 len: 0 microversion: 2.1 time: 11.504522 Oct 04 20:47:33.539062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1089/2155] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:21 2022] POST /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679/action => generated 0 bytes in 11508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:33.539062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.539062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.563232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.566262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.574507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.577213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.583611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.586575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.909564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:34.454482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:37.006785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.030105 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-edada95e-f64b-45f2-bccc-a0283bbe82a9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1314 microversion: 2.1 time: 3.543758 Oct 04 20:47:37.034172 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1090/2156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1314 bytes in 3548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:37.066217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.069520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.112112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.113039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.113873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.115369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.117089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.122088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.230050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:37.387685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:37.388721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:37.403154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:37.404112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:37.404861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:37.465469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.469670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.474612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.477477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.481542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.491206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.617916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:37.617916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for user 9265d783835047bb8377fccd36c1fdb8 and project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:37.617916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:37.617916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:38.389284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b419fab7-35ee-43a4-a7ac-93833d7e16ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.095656 Oct 04 20:47:38.390532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1067/2157] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 14099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:38.405485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:38.412231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:38.426650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.428071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.430300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.432252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.433844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.435215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.776457 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f3ffdc4-6de7-46af-b73b-401a84608e45 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 204 len: 0 microversion: 2.25 time: 1.738873 Oct 04 20:47:38.777992 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1091/2158] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:37 2022] DELETE /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 0 bytes in 1743 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:38.792569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:38.795590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:38.806726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.810388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.811776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.813485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.815454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.817159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.818540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.854429 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8585450e-51e1-45c5-a337-bb565483ffbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1316 microversion: 2.1 time: 0.459932 Oct 04 20:47:38.859958 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1068/2159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:38 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:38.918133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:38.923565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:38.938507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.941253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.942691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.944873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.946106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.948561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.056631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5c13c37-a7b0-4950-9a63-41ebfe452a58 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166739 Oct 04 20:47:39.057985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1069/2160] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:38 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:39.080546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.080546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] [instance: 75f4f61e-3c5d-4f41-8179-571555cc0d2f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:39.108332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.110075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.114527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.120421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.121598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.123895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.257449 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] HTTP exception thrown: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Request method failure captured: Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f HTTP/1.1 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJhsQF_pZFbiHKAwaTKG6Sqx5LAUmIp--DqAT2SyE-dSA4w34n3J58oPV-iWH-UEWY8LOFgUeUlGpU_rsdQgqPcw9cHXMm8mBaxUi1NMgdPeO6r1iVdES6WvJvHD82TDaW6beVYWYx-Ksbf7gZ7ia4m0oueUu6I6DEqxmA0TtkS6RCc Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2dd088c880894556b8525b41e5684eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2dd088c880894556b8525b41e5684eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2dd088c880894556b8525b41e5684eef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveMigrationTest-187330508 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2dd088c880894556b8525b41e5684eef Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveMigrationTest-187330508 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveMigrationTest-187330508-project Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 44a42dd2dd73439bbe445de3b2eb9744 Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveMigrationTest-187330508-project Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '75f4f61e-3c5d-4f41-8179-571555cc0d2f'} Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:39.273269 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:39.286763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] Returning 404 to user: Instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:39.299410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4dd4a1de-ad8d-43a2-bbdf-96f309e96ca0 tempest-LiveMigrationTest-187330508 tempest-LiveMigrationTest-187330508-project] 10.222.0.36 "GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f" status: 404 len: 111 microversion: 2.1 time: 0.230470 Oct 04 20:47:39.299410 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1070/2161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:39 2022] GET /compute/v2.1/servers/75f4f61e-3c5d-4f41-8179-571555cc0d2f => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:39.324556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4fd6fd-bf2b-4756-aa13-0efeaeb92491", "name": "network-vif-deleted", "tag": "d8fcf76b-d817-493d-9b58-bf3739f27341"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:39.367565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.370999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.371880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.450165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] Creating event network-vif-deleted:d8fcf76b-d817-493d-9b58-bf3739f27341 for instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 on n-h1-851029-13 Oct 04 20:47:39.494442 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-cdfa6404-6305-4634-87c3-7b4859ba9310 req-38ee6d69-c20b-4559-88a2-174596d8436b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183441 Oct 04 20:47:39.501384 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1071/2162] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:39.552551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f60a0b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.731064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:39.768892 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7179e1a-ea58-4f38-a777-710d32b1587c tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 0.987410 Oct 04 20:47:39.792451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1092/2163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:38 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:39.842517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.846108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:39.864312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.865794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.867110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.872162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.873754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.875541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.603094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use.", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:47:40.604518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.604518 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 HTTP/1.1 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: exception: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33'} Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:47:40.609804 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] Oct 04 20:47:40.617834 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:40.624228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 400 to user: Security Group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 in use. Oct 04 20:47:40.624228 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b5e8e66e-6745-478d-82da-2b34b6008b34'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:40.629745 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f648121c-ec73-47dd-9048-83e5b25defa0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33" status: 400 len: 185 microversion: 2.1 time: 1.121381 Oct 04 20:47:40.629745 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1072/2164] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:47:39 2022] DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 => generated 185 bytes in 1124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:40.639150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.640578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.653050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.653974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.654855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.656631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.657465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.658494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.887712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.904883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a3404366-0a8a-4458-a120-dd47937630fe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1212 microversion: 2.1 time: 0.275854 Oct 04 20:47:40.906493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1073/2165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1212 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.917633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e55e2b2-7b1f-475c-b067-173a27509901", "tag": "c71a618f-39cd-4566-ba71-fe2adbaf510e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:40.927890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.952055 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0cced575-42a8-479d-a5f9-735e00ef5adb tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1314 microversion: 2.1 time: 1.157114 Oct 04 20:47:40.954193 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1093/2166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:39 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1314 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.966559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.966559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.966559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.990859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.992196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:41.004139 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] Creating event network-changed:c71a618f-39cd-4566-ba71-fe2adbaf510e for instance 9e55e2b2-7b1f-475c-b067-173a27509901 on n-h2-851029-13 Oct 04 20:47:41.006115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.007633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.008468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.009830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.010749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.011548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.016552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6cb98b3b-5e25-4e1f-b41a-4ca8eede7011 req-9c45ddc4-bc44-411c-961c-50b94b0ba4c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107426 Oct 04 20:47:41.018833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1074/2167] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:41.034315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:41.036832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:41.057395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.059272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.061443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.064554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.065946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.068821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.581615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.603068 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54ae7e2a-b087-4474-a2b5-78408d1f31ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1316 microversion: 2.1 time: 1.581552 Oct 04 20:47:42.605068 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1075/2168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:41 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1316 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:42.613574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.615796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.621248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.636054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.637191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.637997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.638318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.640893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.641769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.643114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.645001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.649420 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2158fa48-286a-4511-bb46-44e9e43469c7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1730 microversion: 2.25 time: 1.678926 Oct 04 20:47:42.651431 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1094/2169] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1730 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:42.666465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.669811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.695141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.697129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.698524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.701335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.703418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.704612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.717646 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c29490a-6798-4603-82c0-4c5f554bbf75 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110062 Oct 04 20:47:42.720616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1076/2170] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:47:42.750558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.754163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.788729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:42.791540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.793018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.795730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.801083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.803341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.808377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.344555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b83dc746-f355-4405-b679-fcb375bc848b tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 204 len: 0 microversion: 2.1 time: 0.685908 Oct 04 20:47:43.345881 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1095/2171] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:42 2022] DELETE /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:43.356579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}, {"server_uuid": "75f4f61e-3c5d-4f41-8179-571555cc0d2f", "name": "network-vif-deleted", "tag": "b2e62de5-f735-4fd1-be70-5969ebc19e55"}, {"name": "network-changed", "server_uuid": "e18e87eb-0ab1-48b1-86d6-51209424af84", "tag": "fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:43.378774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.379653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.380470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.411882 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Creating event network-changed:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:47:43.412884 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Creating event network-vif-deleted:b2e62de5-f735-4fd1-be70-5969ebc19e55 for instance 75f4f61e-3c5d-4f41-8179-571555cc0d2f on n-h1-851029-13 Oct 04 20:47:43.413822 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] Creating event network-changed:fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5 for instance e18e87eb-0ab1-48b1-86d6-51209424af84 on n-h1-851029-13 Oct 04 20:47:43.433508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-83d8e4f6-ea85-4b21-8019-3393232802a3 req-2d87ed5f-bfa2-4283-b96b-4809af0ca465 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.084860 Oct 04 20:47:43.434736 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1096/2172] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:43.441545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.445103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.446592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.458952 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a38c61ef-d2b0-4c13-970a-8b3a9c3e9816 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 0.735765 Oct 04 20:47:43.459521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.460102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1077/2173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:43.471114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.471114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.471114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.471114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.471114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.484913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.490074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.506196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.507543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.509807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.513110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.514630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.518887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.729832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.750619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bedfd51-3d60-4e1e-b742-9360882df6df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1268 microversion: 2.1 time: 0.313026 Oct 04 20:47:43.753312 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1097/2174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1268 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:43.761197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:43.780852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.781753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.782543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.806762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] Creating event network-changed:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:47:43.817086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-df7dcba0-e4f3-4235-8ea1-87fdbcc40c8c req-6476b115-48e2-41db-9385-68192b38a763 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063028 Oct 04 20:47:43.818239 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1098/2175] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:43.829212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-334099457", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "bfff8731-e136-4e95-bbb5-c51aff9eb7fd"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:43.951718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] validate_networks() for [('bfff8731-e136-4e95-bbb5-c51aff9eb7fd', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:44.207880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.223504 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e63f6c8-951c-4f61-8093-d403e97bbf12 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1314 microversion: 2.1 time: 0.749198 Oct 04 20:47:44.242843 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1078/2176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:44.253395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.254640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.274195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.275030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.275853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.277213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.278297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.279140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.753543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:45.779413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7cfa1fd2-8875-4d55-831f-9fe0b4cad9d8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1645 microversion: 2.1 time: 1.533905 Oct 04 20:47:45.785090 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1079/2177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:44 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1645 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:45.804950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:45.806731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:45.824679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.826072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.826899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.828343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.829193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.830267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.540373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:47.598945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:47.701524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.728583 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-442890b4-75a0-476b-9668-3f2069aebd25 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1316 microversion: 2.1 time: 1.937722 Oct 04 20:47:47.732011 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1080/2178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:45 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1316 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:47.799495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.809845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.851368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.853322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.856599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.860841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.863182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.867162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.281243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:48.282409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:48.283488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:48.284283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:48.285094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:48.325795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.327465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.330519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.333600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.335596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.336726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.388752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:48.402392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Getting quotas for user 9a7cb787dae04a1c9c481438fa8cb9bb and project 0ee50401fe4d4e6a857b1b85bd462a13. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:48.426314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.445633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:48.452032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:48.456227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.470180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.473102 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ce4a69b-f1ee-4dbb-b278-ee6729f4e537 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 200 len: 1663 microversion: 2.25 time: 0.736953 Oct 04 20:47:48.479870 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1081/2179] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 1663 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:48.496341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.501823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.525206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.535276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.536391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.538235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.539209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.540276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.742994 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8fc23563-4c1b-495a-8f0b-5fefe002181a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.922399 Oct 04 20:47:48.744926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1099/2180] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:48.756580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.758190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.774990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.776357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.777675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.779492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.780683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.782098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.301062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.326267 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbf7180b-7643-4378-afba-57774c4bf20f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1266 microversion: 2.1 time: 0.578291 Oct 04 20:47:49.328343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1100/2181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1266 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:49.341779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:49.343499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:49.359855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.360333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.360904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.361744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.362290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.362864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.117451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:50.134924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c82b5b6-1868-40b5-b5d2-968d5889e927 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 1.652472 Oct 04 20:47:50.154700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1082/2182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:50.166039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.167671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.177310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.178074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.178684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.179658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.180372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.181350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.258080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:50.279135 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61e09e7d-f094-4b8b-b858-af65d9f7e91b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1314 microversion: 2.1 time: 0.948212 Oct 04 20:47:50.299185 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1101/2183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:49 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:50.319450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7abbef5-41aa-40aa-81f8-07b2c73c27be", "name": "network-vif-deleted", "tag": "a2f76701-168a-4ea6-8953-1d5ebd4646d9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:50.335506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.336606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.337381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.356362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] Creating event network-vif-deleted:a2f76701-168a-4ea6-8953-1d5ebd4646d9 for instance a7abbef5-41aa-40aa-81f8-07b2c73c27be on n-h1-851029-13 Oct 04 20:47:50.371261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-96064f8f-aebd-40dd-99e0-e47d77d19756 req-d82eee99-b3f5-4253-91ee-3ea3759baf88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068189 Oct 04 20:47:50.373288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1102/2184] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:50.384919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e55e2b2-7b1f-475c-b067-173a27509901", "name": "network-vif-plugged", "status": "completed", "tag": "c71a618f-39cd-4566-ba71-fe2adbaf510e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:50.412890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.414311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.415148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.443760 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] Creating event network-vif-plugged:c71a618f-39cd-4566-ba71-fe2adbaf510e for instance 9e55e2b2-7b1f-475c-b067-173a27509901 on n-h2-851029-13 Oct 04 20:47:50.456707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-159d483c-6e01-4fc5-aaf5-91c3d9329352 req-6ed685b9-a35c-4cc6-84f1-3c0036082bad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079269 Oct 04 20:47:50.459217 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1103/2185] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:50.475559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.477069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.501444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.506081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.512332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.514413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.516530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.519235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.824557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:50.853215 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a17e96ef-3a1c-4356-bb96-f10c57ccf3ab tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1221 microversion: 2.1 time: 0.390310 Oct 04 20:47:50.854811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1104/2186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1221 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:50.869527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.871143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.888313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.889820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.903513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.904923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.907748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.908910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.041425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.078798 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae33fc2f-083e-4600-bec7-5e4a98d35d5f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1645 microversion: 2.1 time: 0.919810 Oct 04 20:47:51.080886 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1083/2187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1645 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:51.091424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:51.092855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: a7abbef5-41aa-40aa-81f8-07b2c73c27be] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:51.109106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.109106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.110271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.112180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.113468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.114564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.152325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] HTTP exception thrown: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Request method failure captured: Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be HTTP/1.1 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJidX9uqiVLIWmYC1CqmQ3XN1XZTd-oO93oRQyKGuUxBPwpe0iFTMNqfcYa9tJJ5m1mUVfpEipP_2ZeU0emUZ_nJAkxLUrtxJP7g0bzLdB2eWBTlWmgTZPea3gaX6s5cRyMWX4KtSH10iQ5H9RNVdRe7o5tSD9BJ38ToQsQX1CkWYKs Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ccb7a2196402402a880493998d67e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ccb7a2196402402a880493998d67e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 07dfa4ed8d314142a365c3e67fe5b334 Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a7abbef5-41aa-40aa-81f8-07b2c73c27be'} Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. Oct 04 20:47:51.156734 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Returning 404 to user: Instance a7abbef5-41aa-40aa-81f8-07b2c73c27be could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:51.168635 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a7fedbb-0f8d-45e7-ba66-c883b7ca46d9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be" status: 404 len: 111 microversion: 2.25 time: 0.084017 Oct 04 20:47:51.171361 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1084/2188] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:51 2022] GET /compute/v2.1/servers/a7abbef5-41aa-40aa-81f8-07b2c73c27be => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:51.183968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:51.185282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:51.209775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.210597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.212112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.213543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.215194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.216124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.338334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:52.367468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:52.379180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bca6c124-b086-4e5a-b725-003eef0aa0d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 1.206659 Oct 04 20:47:52.384834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1085/2189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:51 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:52.400935 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a63e9fcc-5caa-4e59-af3a-08fd808419eb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1316 microversion: 2.1 time: 1.543284 Oct 04 20:47:52.407417 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1105/2190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1316 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:52.415776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0298ac8-b00e-482c-9d0f-e9fd06c2adae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '.version_select at 0x7f54f641c4c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.424456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.426268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.441529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.443910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.445236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.446985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.448926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.450301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.521474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:52.568752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0298ac8-b00e-482c-9d0f-e9fd06c2adae tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944346279" status: 204 len: 0 microversion: 2.25 time: 0.175329 Oct 04 20:47:52.579188 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1086/2191] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 20:47:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944346279 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:52.597057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.603443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.636510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.637821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.642946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.644384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.645072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.645692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.409996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.429179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c88d9698-06e2-431f-85ff-782bd143c0d9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1500 microversion: 2.1 time: 0.847361 Oct 04 20:47:53.430858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1087/2192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1500 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.481412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:53.493747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:53.497093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.499491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.500908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.502478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.503653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.504682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.832228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.838796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:53.849443 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ebfe13c-c312-4e64-9b58-42a1c63333f9 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1275 microversion: 2.1 time: 0.403680 Oct 04 20:47:53.850544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1088/2193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1275 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.859337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.860226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:53.860952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:53.873137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.874038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.875173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.876738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.877932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.883307 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d7f41a3-84ef-43b8-854d-b3859cfb40b7 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 1.473052 Oct 04 20:47:53.899957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.901650 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1106/2194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.918437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "name": "network-vif-deleted", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:53.954832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.956440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.958095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.001411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] Creating event network-vif-deleted:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:47:54.045847 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cd67b5b5-f42d-417f-b150-a643996d8112 req-f08f6f78-de30-4b7e-939d-246bcfc62a0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134977 Oct 04 20:47:54.047931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.048423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1107/2195] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:54.049271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.050175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.051068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lazy-loading 'fault' on Instance uuid 4d4da4f3-2342-4df3-be75-cd9fac9b5679 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:54.064043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4da4f3-2342-4df3-be75-cd9fac9b5679", "name": "network-vif-unplugged", "status": "completed", "tag": "d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac"}, {"server_uuid": "e18e87eb-0ab1-48b1-86d6-51209424af84", "name": "network-vif-plugged", "status": "completed", "tag": "fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5"}, {"server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:54.113979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.120822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.128400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.169438 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Creating event network-vif-unplugged:d9477152-ebf1-40b8-8a4b-b2b9bb17f7ac for instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 on n-h2-851029-13 Oct 04 20:47:54.171757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Creating event network-vif-plugged:fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5 for instance e18e87eb-0ab1-48b1-86d6-51209424af84 on n-h1-851029-13 Oct 04 20:47:54.173138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] Creating event network-vif-plugged:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:47:54.198191 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-da679048-0da0-4792-8a8d-6b440500688f req-927940f9-0875-4942-9fe4-8718eba5f959 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.146006 Oct 04 20:47:54.202239 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1108/2196] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:54.229247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.242351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.282406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.284052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.285225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.287212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.291848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.293255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.406032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:54.435093 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-097ef1e9-f6a3-44b4-8f1b-16b8bb6bdd0d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 200 len: 1304 microversion: 2.1 time: 0.580467 Oct 04 20:47:54.449863 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1089/2197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 1304 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:54.466869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.474607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.493533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.494912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.495758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.497184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.498049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.498963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.425921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.449010 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5006f1dc-4220-4765-8d4e-8fbc32107d2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 1.240572 Oct 04 20:47:55.454715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1109/2198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.466719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:55.472835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.489911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.490793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.491446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.493090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.494391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.495595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.496936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.524933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d858e0f1-d16c-4e6b-b36a-b0a3e10fa2ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1316 microversion: 2.1 time: 1.072150 Oct 04 20:47:55.538704 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1090/2199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.544185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.546363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.565019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.565947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.566883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.568636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.569541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.570414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.579409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lazy-loading 'flavor' on Instance uuid 9e55e2b2-7b1f-475c-b067-173a27509901 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:55.709261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.725664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-839de0ff-1aef-411b-a90e-8e0d6a3c872b tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1275 microversion: 2.1 time: 0.197024 Oct 04 20:47:55.745735 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1091/2200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.753657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.755438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.770023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.771848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.773154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.774959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.776268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.777447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.074015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f9431f5-496d-426c-ad70-a2e7331819e0 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "POST /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901/action" status: 200 len: 32 microversion: 2.1 time: 0.620282 Oct 04 20:47:56.075131 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1110/2201] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:55 2022] POST /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901/action => generated 32 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:47:56.086175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.088197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.101391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.102858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.104429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.106044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.107124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.108364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.152322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 HTTP/1.1 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4d4da4f3-2342-4df3-be75-cd9fac9b5679'} Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:56.156008 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:47:56.162997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:47:56.166529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:56.168216 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24ab2273-819b-4ec2-bd5e-c15e8fb40db2 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 404 len: 111 microversion: 2.1 time: 0.090870 Oct 04 20:47:56.169838 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1111/2202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:56.181053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.182776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.196481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.197955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.199167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.200797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.201928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.203452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.946564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:56.965102 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb56e59d-e549-4534-9df9-f27dd21bc5d8 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1370 microversion: 2.1 time: 1.219672 Oct 04 20:47:56.967047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1092/2203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1370 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:56.978231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-172f6baa-88ea-4ba6-9c31-9ed3e6e2e50a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f64503a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:57.192840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:57.212053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e6f6eb7-6274-41c7-afbe-7fdfd4cd0849 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 1.039227 Oct 04 20:47:57.213636 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1112/2204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:57.223067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:57.224748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:57.238339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.240011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.241214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:57.243126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.244452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.245332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.285660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.302103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce289a75-ceb3-43d3-9761-b7c96adc0927 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 1.086084 Oct 04 20:47:58.319798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1113/2205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:57 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:58.343665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.345578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:58.360604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.361895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.362746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.364112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.365357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.366515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.367939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:58.420481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:58.682142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-172f6baa-88ea-4ba6-9c31-9ed3e6e2e50a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80" status: 202 len: 0 microversion: 2.1 time: 1.712098 Oct 04 20:47:58.685500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1093/2206] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:47:56 2022] DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80 => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:58.698331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.699431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:58.724519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.726059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.727270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.730494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.730494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.731587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.795350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:59.345988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db7ced1b-40f6-49bb-a18c-19f97f4786cb tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 204 len: 0 microversion: 2.25 time: 0.652104 Oct 04 20:47:59.348113 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1094/2207] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:58 2022] DELETE /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:59.364078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:59.366834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:59.379158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.380785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.381921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.383382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.385685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.387017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.565255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:59.589584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-537b636a-2104-4119-a4d4-c26345d7999c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.267330 Oct 04 20:47:59.601216 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1114/2208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:58 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:59.628250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:59.636122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:59.655006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.656765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.687601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.687601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.687601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.687601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.332752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.356152 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ff5498f-78fa-4e76-b7c4-55b90090c1eb tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 1.004974 Oct 04 20:48:00.357478 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1095/2209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:59 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:00.371835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:00.374840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:00.388382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.389675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.392919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.397127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.398316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.399357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.761356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.778491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e098ed0-1981-45c3-a2f6-45edf57fdb3a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1556 microversion: 2.1 time: 1.174749 Oct 04 20:48:00.779500 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1115/2210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:59 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1556 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:00.788854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4564d918-b93f-4ae3-b899-0d33f505dfc5", "tag": "53feefa5-a9a0-4df0-8fce-9d796ceaf289"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:00.808673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.809818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.810357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.832889 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] Creating event network-changed:53feefa5-a9a0-4df0-8fce-9d796ceaf289 for instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 on n-h1-851029-13 Oct 04 20:48:00.842141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-62e3dcbf-6071-41b2-94a2-35f6ffcf4f88 req-244eef70-04bf-4459-9e9f-f359bbe5d9c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060136 Oct 04 20:48:00.844759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1116/2211] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:00.855254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de025f90-6f96-4ee0-9fc6-d60be14f7a76 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa6b5a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.251789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:01.270373 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5278173f-6b5f-44cb-9ba8-c5ebade1e7cd tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 0.910569 Oct 04 20:48:01.272928 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1096/2212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:00 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:01.284374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.286158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:01.301861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.303518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.304837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.306723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.308019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.309159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.301777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:02.341312 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c5e5de2-9326-479f-8ded-17b9a3e519bd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 1.063847 Oct 04 20:48:02.372666 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1097/2213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:01 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:02.404642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:02.411889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:02.447075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.447997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.448814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.450169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.451041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.452207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.517218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de025f90-6f96-4ee0-9fc6-d60be14f7a76 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33" status: 202 len: 0 microversion: 2.1 time: 1.669125 Oct 04 20:48:02.518534 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1117/2214] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:00 2022] DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 => generated 0 bytes in 1673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:02.542844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-548615893", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:02.568501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:02.686202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] validate_networks() for [('3f71e3c8-2f24-4002-ad98-706d0dd02af4', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:03.303576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:03.332086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:03.335624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:03.338147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96671a51-4c8c-4091-97e4-5fb84180ea3a tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 200 len: 1549 microversion: 2.25 time: 0.960124 Oct 04 20:48:03.340419 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1098/2215] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:02 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 1549 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:03.350486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:03.352102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.381483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:03.651561 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c111ab4-6b1d-4ca6-a617-78ef20a23bbc tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.307958 Oct 04 20:48:03.665401 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1099/2216] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:48:03 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:03.673042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:03.674252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:03.693445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.695738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.697451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:03.701047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.702561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.704577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:05.442003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:05.504185 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ea6885fa-c00b-49e8-a86c-bc51e5759921 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 1.836295 Oct 04 20:48:05.512757 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1100/2217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:03 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:05.566448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:05.571105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:05.605000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:05.612402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:05.613978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:05.622902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:05.627310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:05.629245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:05.632138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.069146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:06.069960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:06.070504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:06.070992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:06.071717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:06.109661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.110630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.111479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.113283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.114184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.115025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.154210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Getting quotas for project 35f87b9aeb584936b843faaae144921d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:06.164575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Getting quotas for user 9dad81a0d0e7483faca4215294efb6bb and project 35f87b9aeb584936b843faaae144921d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:06.192833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:06.197849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:06.411770 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2ca5658b-79c5-4853-9e13-42601fc87653 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.891046 Oct 04 20:48:06.425155 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1118/2218] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:06.425155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f8c4222-b136-496a-9fb9-8b0c6a25bdd8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'create', calling method: .version_select at 0x7f54fa58b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2078212706", "description": "tempest-description-1097903249"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:06.575455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:06.619073 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40b4c460-91e6-468f-92ad-0a649a76b969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 1.099880 Oct 04 20:48:06.626367 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1101/2219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:05 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:06.647269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa63f75-12f0-4581-9b6c-2171310b08a8", "name": "network-vif-deleted", "tag": "29c815c5-af1c-48d7-92d9-63b22043240d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:06.703585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.703585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.703585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.766318 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] Creating event network-vif-deleted:29c815c5-af1c-48d7-92d9-63b22043240d for instance faa63f75-12f0-4581-9b6c-2171310b08a8 on n-h1-851029-13 Oct 04 20:48:06.791924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-38a8fa01-9309-49fa-9695-9c129a0e81ef req-c4fecee9-c790-4767-a434-4613f1f879a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159724 Oct 04 20:48:06.795014 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1102/2220] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:06.818743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:06.820166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:06.847179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.848638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.848638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.850130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.850906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.851692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:07.816381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:07.834267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16c5d824-5302-4f36-8b9b-a6586b4f9f76 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 1.033633 Oct 04 20:48:07.837584 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1103/2221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:06 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:07.851133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:07.852306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: faa63f75-12f0-4581-9b6c-2171310b08a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:07.866051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:07.866529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:07.867676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:07.869700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:07.870746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:07.872193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:07.903187 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] HTTP exception thrown: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Request method failure captured: Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 HTTP/1.1 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJidX9uqiVLIWmYC1CqmQ3XN1XZTd-oO93oRQyKGuUxBPwpe0iFTMNqfcYa9tJJ5m1mUVfpEipP_2ZeU0emUZ_nJAkxLUrtxJP7g0bzLdB2eWBTlWmgTZPea3gaX6s5cRyMWX4KtSH10iQ5H9RNVdRe7o5tSD9BJ38ToQsQX1CkWYKs Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ccb7a2196402402a880493998d67e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ccb7a2196402402a880493998d67e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 07dfa4ed8d314142a365c3e67fe5b334 Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'faa63f75-12f0-4581-9b6c-2171310b08a8'} Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. Oct 04 20:48:07.907968 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Returning 404 to user: Instance faa63f75-12f0-4581-9b6c-2171310b08a8 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ef44fbc-6ba4-4e91-a7d7-ce1d44f7b3a7 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8" status: 404 len: 111 microversion: 2.25 time: 0.073098 Oct 04 20:48:07.917764 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1104/2222] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:07 2022] GET /compute/v2.1/servers/faa63f75-12f0-4581-9b6c-2171310b08a8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:07.924894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-febb5a52-2d8b-47fe-b3b7-7ac6b5e8ae44 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:07.926052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-febb5a52-2d8b-47fe-b3b7-7ac6b5e8ae44 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:08.156705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-febb5a52-2d8b-47fe-b3b7-7ac6b5e8ae44 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:08.188288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-febb5a52-2d8b-47fe-b3b7-7ac6b5e8ae44 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1216 microversion: 2.1 time: 0.272002 Oct 04 20:48:08.193430 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1105/2223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:07 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1216 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:08.207153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:08.210947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:08.229148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.230094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.231240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.232671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.234257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.235122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.314150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f8c4222-b136-496a-9fb9-8b0c6a25bdd8 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.897705 Oct 04 20:48:08.315147 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1119/2224] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:08.325081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4564d918-b93f-4ae3-b899-0d33f505dfc5", "name": "network-vif-plugged", "status": "completed", "tag": "53feefa5-a9a0-4df0-8fce-9d796ceaf289"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:08.664320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.665289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.666194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.700011 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] Creating event network-vif-plugged:53feefa5-a9a0-4df0-8fce-9d796ceaf289 for instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 on n-h1-851029-13 Oct 04 20:48:08.712469 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5b8cd4fb-1ab2-4b43-8d72-60f71810fea8 req-b5e761e0-41c8-4e67-9a62-f605d80953d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394976 Oct 04 20:48:08.715524 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1120/2225] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:08.737365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:08.743469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:08.752045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.753314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.754147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.769772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.769772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.769772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.832136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:08.859484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b8c61c92-80da-4bd4-8574-9615914d99dc tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 0.662117 Oct 04 20:48:08.860879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1106/2226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:08 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:08.881456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:08.881456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:08.884192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.885667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.886823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.888565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:08.890434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:08.892018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:08.901958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:08.964005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:09.207972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:09.224788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8cbb105-56f6-42ca-9df9-c7a99ca09daa tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 0.506704 Oct 04 20:48:09.225901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1121/2227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:08 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:09.238075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f951ad7-9c15-4269-9b34-61a312d940e3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Action: 'update', calling method: .version_select at 0x7f54fa4ed280>, body: {"security_group": {"name": "tempest-sg-hth-41519666", "description": "tempest-description-hth-617913951"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:09.570939 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-463811bf-dd7a-45ce-8fa5-82b4b179f84e tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 204 len: 0 microversion: 2.25 time: 0.703764 Oct 04 20:48:09.570939 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1107/2228] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:48:08 2022] DELETE /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:48:09.597795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:09.599170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:09.635143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.636181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.640324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:09.641928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.647145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.650711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:09.958149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f951ad7-9c15-4269-9b34-61a312d940e3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a" status: 200 len: 215 microversion: 2.1 time: 0.730390 Oct 04 20:48:09.960821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1122/2229] 10.222.0.36 () {60 vars in 1290 bytes} [Tue Oct 4 20:48:09 2022] PUT /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a => generated 215 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:09.974482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81f0438-5f9b-40a0-8f05-ab1c7223dc9f", "tag": "d395cda4-e902-4be2-adb5-c87fd2cf29be"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:09.976248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:09.998690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.000170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.001328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.022625 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ccec751-1d78-4368-9916-ccc0b1a82159 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 0.445688 Oct 04 20:48:10.031006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1108/2230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:09 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:10.042367 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] Creating event network-changed:d395cda4-e902-4be2-adb5-c87fd2cf29be for instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f on n-h1-851029-13 Oct 04 20:48:10.044870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:10.046201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.057356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-15473327-02a3-4bdf-976f-aa5a3c2639ab req-79a42520-62c6-43a7-b0ff-62feab75ed48 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092687 Oct 04 20:48:10.059141 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1123/2231] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:10.060995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.070867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.070867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.070867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.070867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.070867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.075277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:10.076813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.090734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.091590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.092328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.094404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.095278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.096127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.229689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.266482 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-36fcbc22-ec24-48f1-b23c-10bf19beba9d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1268 microversion: 2.1 time: 0.240701 Oct 04 20:48:10.269221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1109/2232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:10.291073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:10.292677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.332493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.333589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.338367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.341310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.348759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.356723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.456299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.493329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.520144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.520144 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1dbc54b-965d-4e52-af31-601da4878a25 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1564 microversion: 2.25 time: 0.446614 Oct 04 20:48:10.520144 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1124/2233] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1564 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:10.563470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35c5d8f7-55ae-4790-86f7-fef61492a4e0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa655f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:11.869234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35c5d8f7-55ae-4790-86f7-fef61492a4e0 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a" status: 200 len: 215 microversion: 2.1 time: 1.350185 Oct 04 20:48:11.871657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1125/2234] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a => generated 215 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:11.881450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:11.883249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:11.898364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:11.899908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:11.901058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:11.902803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:11.903969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:11.904990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:12.337480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:12.357790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b7ee8ef-32ab-4b56-83ed-6c29be30c71a tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 2.086123 Oct 04 20:48:12.359960 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1110/2235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:12.370047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:12.371392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:12.385394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:12.386587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:12.387564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:12.389644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:12.390474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:12.391406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:12.958024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:12.976489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56d8aec6-5dc7-4b5e-b11e-f1231214526d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 1.102229 Oct 04 20:48:12.978462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1126/2236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:11 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:12.988640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:12.990282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:13.005838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.007560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.008619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.010297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.011192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.012001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.225834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.233012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.253378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e24c619-db7f-4984-8c04-1525071acde5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1274 microversion: 2.1 time: 0.272083 Oct 04 20:48:13.255325 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1127/2237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:12 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:13.260797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-090ff613-5c7f-486a-a245-e92b1aea68b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1308 microversion: 2.1 time: 0.898801 Oct 04 20:48:13.272351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:13.274624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:13.287252 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1111/2238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:12 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:13.293013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.294592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.296423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.299702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.302008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.304220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.317592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55cf4399-7447-4bfc-bbf7-f8915f8b6d1d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f5f9a1f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:14.386601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:14.406611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:14.410101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:14.412576 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0c17eb5-1953-486c-8b49-0707ee7d1eb9 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1564 microversion: 2.25 time: 1.153948 Oct 04 20:48:14.414345 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1128/2239] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:13 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1564 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:14.423861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18e87eb-0ab1-48b1-86d6-51209424af84", "tag": "fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:14.445168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:14.453001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:14.453001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:14.471334 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] Creating event network-changed:fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5 for instance e18e87eb-0ab1-48b1-86d6-51209424af84 on n-h1-851029-13 Oct 04 20:48:14.480644 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6a2952a1-def0-4a01-a159-a2e3e352651e req-e89531cb-cd6a-48db-9827-d6d610106e0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063694 Oct 04 20:48:14.481760 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1129/2240] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:14.491943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:14.493077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:14.505933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:14.506521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:14.507379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:14.509044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:14.509937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:14.510762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:14.548490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:15.462179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55cf4399-7447-4bfc-bbf7-f8915f8b6d1d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a" status: 202 len: 0 microversion: 2.1 time: 2.172251 Oct 04 20:48:15.465326 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1112/2241] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:13 2022] DELETE /compute/v2.1/os-security-groups/c3802ae1-94cd-4062-bf60-06148c10af4a => generated 0 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:15.478089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81f0438-5f9b-40a0-8f05-ab1c7223dc9f", "name": "network-vif-plugged", "status": "completed", "tag": "d395cda4-e902-4be2-adb5-c87fd2cf29be"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:15.499627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.500937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.501712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.526444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] Creating event network-vif-plugged:d395cda4-e902-4be2-adb5-c87fd2cf29be for instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f on n-h1-851029-13 Oct 04 20:48:15.544837 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f5706357-c6dd-4f6a-959d-be75838292c7 req-a7b1d662-eeed-4e0d-a7bc-fa221df3d551 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075604 Oct 04 20:48:15.546385 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1113/2242] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:15.560779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:15.593657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-638936e0-19e4-4fd8-afc9-0374b6d732fe tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 1.108528 Oct 04 20:48:15.596668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1130/2243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:14 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:15.628892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:15.630646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:15.650793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.653019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.654393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.658199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.663277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.665881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.961923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8151d258-c1b7-4b25-89aa-c9f0dead22d1 tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] Calling method '.version_select at 0x7f54f62df820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:16.134157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:16.180289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:16.610560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:16.630094 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2738f20a-d70f-4fc2-b33c-356681c3967d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 1.031584 Oct 04 20:48:16.631441 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1131/2244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:15 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:16.642569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:16.646130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:16.668077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.668795 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8151d258-c1b7-4b25-89aa-c9f0dead22d1 tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 8788 microversion: 2.1 time: 1.117204 Oct 04 20:48:16.669876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1114/2245] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:48:15 2022] GET /compute/v2.1/os-networks => generated 8788 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:16.671413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.672954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.674638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.675540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.679337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.696377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:16.697762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:16.718398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.724525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.728827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.731005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.732229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.733899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.269114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.285316 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8fc62d3d-f325-4f32-8735-ff276c9d4e5d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.651611 Oct 04 20:48:17.299149 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1132/2246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:16 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:17.299149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.299149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:17.310107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.311011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.312469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.313921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.314850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.315674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.378982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.379277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.380058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.380761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.381687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lazy-loading 'fault' on Instance uuid 28a91c95-59fa-498f-9811-a3e5d072ed89 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:17.396025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f11cd245-1e58-4952-8366-132cc13ed375 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1489 microversion: 2.1 time: 0.714736 Oct 04 20:48:17.397347 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1115/2247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:16 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1489 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:17.407707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.409266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:17.422054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.423191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.424132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.426426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.428060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.429434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.463224 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 HTTP/1.1 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4d4da4f3-2342-4df3-be75-cd9fac9b5679'} Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:17.466891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85ccb706-ac0f-46f7-ac03-d063f57676ab tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 404 len: 111 microversion: 2.1 time: 0.070854 Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1116/2248] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:17 2022] DELETE /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:17.487240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a91c95-59fa-498f-9811-a3e5d072ed89", "name": "network-vif-deleted", "tag": "566d8a68-cd52-485f-aea0-d2499f8e2741"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:17.501339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.502349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.503181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.526948 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] Creating event network-vif-deleted:566d8a68-cd52-485f-aea0-d2499f8e2741 for instance 28a91c95-59fa-498f-9811-a3e5d072ed89 on n-h1-851029-13 Oct 04 20:48:17.537486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8dc8e3aa-a388-4036-9a35-04eb12de1375 req-8a634f05-99ff-4b91-b863-7fc620d0b92a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063395 Oct 04 20:48:17.538623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1117/2249] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:17.550328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.552199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:17.565182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.566898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.567963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.578220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.578220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.578220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.611034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.629188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.632583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07dfa4ed8d314142a365c3e67fe5b334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb7a2196402402a880493998d67e44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.635013 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d71b436-ba35-4ea4-b5d7-a67905865b1c tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 200 len: 1352 microversion: 2.25 time: 0.346796 Oct 04 20:48:17.636548 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1133/2250] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 1352 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:17.649928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96da7344-21e7-4c8e-a2ad-263fc1d9b470 tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] Calling method '.version_select at 0x7f54fa4d5ca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:18.179928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:18.828527 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96da7344-21e7-4c8e-a2ad-263fc1d9b470 tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks/225389d0-e589-4bcf-8210-aff3365ff792" status: 200 len: 652 microversion: 2.1 time: 1.189249 Oct 04 20:48:18.829667 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1134/2251] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/os-networks/225389d0-e589-4bcf-8210-aff3365ff792 => generated 652 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:18.839534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:18.852534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.853954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.854640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.896256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:18.915491 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb5827e3-cd3e-489a-8201-9225629222ea tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1317 microversion: 2.1 time: 1.374023 Oct 04 20:48:18.917303 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1118/2252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1317 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:18.928430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:18.929783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 4d4da4f3-2342-4df3-be75-cd9fac9b5679] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:18.943360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.944755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.946130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.947957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.949964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.951258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.984328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 HTTP/1.1 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4d4da4f3-2342-4df3-be75-cd9fac9b5679'} Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:18.989238 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Instance 4d4da4f3-2342-4df3-be75-cd9fac9b5679 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:18.995710 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9b1833e-303d-464d-a525-948d333e12bb tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679" status: 404 len: 111 microversion: 2.1 time: 0.075414 Oct 04 20:48:19.003670 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1119/2253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:18 2022] GET /compute/v2.1/servers/4d4da4f3-2342-4df3-be75-cd9fac9b5679 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:19.007385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.008971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:19.009361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:48:19.022955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.023882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.024842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.026899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.027694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.028418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.290068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:19.316707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99a03a42-8579-4df2-a05e-61b679dd806d tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 0.318027 Oct 04 20:48:19.318362 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1120/2254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:18 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:19.328449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.330653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:19.344072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.345263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.346311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.348132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.349533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.351037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.374833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e27ca9f7-82b5-4f61-9237-4f55d1355766 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5/action" status: 202 len: 0 microversion: 2.1 time: 0.538826 Oct 04 20:48:19.374833 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1135/2255] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:18 2022] POST /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:19.398580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.400843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] [instance: 28a91c95-59fa-498f-9811-a3e5d072ed89] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:19.413936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.415402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.416588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.418004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.418956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.419783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.449001 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] HTTP exception thrown: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Request method failure captured: Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 HTTP/1.1 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJidX9uqiVLIWmYC1CqmQ3XN1XZTd-oO93oRQyKGuUxBPwpe0iFTMNqfcYa9tJJ5m1mUVfpEipP_2ZeU0emUZ_nJAkxLUrtxJP7g0bzLdB2eWBTlWmgTZPea3gaX6s5cRyMWX4KtSH10iQ5H9RNVdRe7o5tSD9BJ38ToQsQX1CkWYKs Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ccb7a2196402402a880493998d67e44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ccb7a2196402402a880493998d67e44b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ccb7a2196402402a880493998d67e44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ccb7a2196402402a880493998d67e44b Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-870242861 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 07dfa4ed8d314142a365c3e67fe5b334 Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-870242861-project Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '28a91c95-59fa-498f-9811-a3e5d072ed89'} Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. Oct 04 20:48:19.451014 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] Returning 404 to user: Instance 28a91c95-59fa-498f-9811-a3e5d072ed89 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-225a7e65-c874-46cc-9204-3455475cd863 tempest-LiveAutoBlockMigrationV225Test-870242861 tempest-LiveAutoBlockMigrationV225Test-870242861-project] 10.222.0.36 "GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89" status: 404 len: 111 microversion: 2.25 time: 0.079682 Oct 04 20:48:19.458350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1136/2256] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/servers/28a91c95-59fa-498f-9811-a3e5d072ed89 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:19.473966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-813f1d17-3bbc-4656-aeeb-2587a6edd57f tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] Calling method '.version_select at 0x7f54fa6b5f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.913147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:19.930364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-813f1d17-3bbc-4656-aeeb-2587a6edd57f tempest-NetworksTest-1893423289 tempest-NetworksTest-1893423289-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 8788 microversion: 2.1 time: 0.472737 Oct 04 20:48:19.933609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1137/2257] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/os-networks => generated 8788 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:19.957286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa655b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.958290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27dd0f90-fe47-4bcf-8bbe-fa2ca5ae651f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.631161 Oct 04 20:48:19.962865 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1121/2258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:19.984201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.990954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:20.004612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.005762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.006788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.008966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.010308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.017066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.047089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:20.049116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:20.050241 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.050241 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 HTTP/1.1 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33'} Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:20.054964 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] Oct 04 20:48:20.063950 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.073158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group 4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 does not exist Oct 04 20:48:20.073158 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-afc68eb7-815f-46ea-b990-35ac9270aa4a'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:20.074975 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96b99a07-6b96-485c-b866-a0bfcfcc633a tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33" status: 404 len: 194 microversion: 2.1 time: 0.138572 Oct 04 20:48:20.077678 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1138/2259] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:19 2022] DELETE /compute/v2.1/os-security-groups/4a5c85fb-55c7-4f2e-9d03-9cbc5458cf33 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:20.093131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.095303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:20.113118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.114395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.115433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.116963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.118096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.119203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.505168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.525116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a79528d3-1e73-4299-9dcd-eb61c9c8dbd6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.558994 Oct 04 20:48:20.562759 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1122/2260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:20.562759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f67e3550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.629657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.653496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f5053273-8a80-4ef2-ac17-80e4d48608d3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1506 microversion: 2.1 time: 0.571800 Oct 04 20:48:20.654630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:20.655680 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1139/2261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:20 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:20.656509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:20.657564 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.657564 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80 HTTP/1.1 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '38e6b3f4-3dfa-41db-b6c1-38ae96043b80'} Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:20.661935 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] Oct 04 20:48:20.668904 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.688443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group 38e6b3f4-3dfa-41db-b6c1-38ae96043b80 does not exist Oct 04 20:48:20.688443 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-263a3b56-9be2-46f5-a3b0-bebbb17fdbf4'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:20.688443 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65e4351c-41c0-4701-b6c3-86530b4dfa51 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80" status: 404 len: 194 microversion: 2.1 time: 0.145409 Oct 04 20:48:20.688443 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1123/2262] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:20 2022] DELETE /compute/v2.1/os-security-groups/38e6b3f4-3dfa-41db-b6c1-38ae96043b80 => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:20.692413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.694039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:20.701323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499", "tag": "d302df17-5e97-417e-80da-60f9a7b72038"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:20.729565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.732024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.732912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.734981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.736829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.738152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.750898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.752406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.753491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.792633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] Creating event network-changed:d302df17-5e97-417e-80da-60f9a7b72038 for instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 on n-h2-851029-13 Oct 04 20:48:20.812965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-42fd6270-2590-49eb-89cd-ade8d3b8886a req-2a8b00cf-0224-443d-a432-fbee4608b6cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127934 Oct 04 20:48:20.813981 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1124/2263] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:20.837839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f6263b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.972322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:20.974123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group c418c7c7-b9df-43ba-867a-823fc7f9318a not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:20.977253 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.977253 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a HTTP/1.1 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c418c7c7-b9df-43ba-867a-823fc7f9318a'} Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:20.985013 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] Oct 04 20:48:20.998251 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.016021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group c418c7c7-b9df-43ba-867a-823fc7f9318a does not exist Oct 04 20:48:21.016021 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-b0c1a3c5-31b6-40ef-9644-bc3358788e61'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:21.016021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2f3268f-52dd-4839-a638-181f90a9b54f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a" status: 404 len: 194 microversion: 2.1 time: 0.189485 Oct 04 20:48:21.016021 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1125/2264] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:20 2022] DELETE /compute/v2.1/os-security-groups/c418c7c7-b9df-43ba-867a-823fc7f9318a => generated 194 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:21.037308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.039552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:21.077628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.079234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.081735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.086823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.089911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.096504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.275092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:21.297517 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e0d1943-15a9-4d07-a708-1045a44f10b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 0.637936 Oct 04 20:48:21.300081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1140/2265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:20 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:21.339747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa64bc10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.452482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:21.453921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:21.458960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.458960 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa HTTP/1.1 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1fcb06bb-ff41-4b90-80ec-680b86571dfa'} Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:21.464525 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] Oct 04 20:48:21.472005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.477221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group 1fcb06bb-ff41-4b90-80ec-680b86571dfa does not exist Oct 04 20:48:21.477221 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-a3ebbfa6-b767-497a-a25f-83d2f6a9e66b'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:21.478644 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d3a9e9b-978b-4f41-bb9a-43d062312388 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa" status: 404 len: 194 microversion: 2.1 time: 0.175323 Oct 04 20:48:21.485586 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1141/2266] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:21 2022] DELETE /compute/v2.1/os-security-groups/1fcb06bb-ff41-4b90-80ec-680b86571dfa => generated 194 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:21.492726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa4ed040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.628042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:21.629140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group eadb7790-0c29-4ea1-8a62-535f5277ebeb not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:21.630529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.630529 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb HTTP/1.1 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'eadb7790-0c29-4ea1-8a62-535f5277ebeb'} Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:21.636474 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group eadb7790-0c29-4ea1-8a62-535f5277ebeb does not exist Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3c3a39e1-fff2-4260-9238-da140726a03c'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d1d59f6-c5d6-4ca9-af52-eb918e772900 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb" status: 404 len: 194 microversion: 2.1 time: 0.152247 Oct 04 20:48:21.643671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1142/2267] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:21 2022] DELETE /compute/v2.1/os-security-groups/eadb7790-0c29-4ea1-8a62-535f5277ebeb => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:21.651369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.653139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:21.666205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.667120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.668200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.669601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.670470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.673012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.792843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:21.842997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3741516-6d8c-4734-a6e1-4dbde5636d7a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.832734 Oct 04 20:48:21.861296 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1126/2268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:21 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:21.885707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f628b280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.971141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:21.972211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Neutron security group de7bc11c-4bae-417b-9faf-217f93a11874 not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:21.973176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.973176 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 HTTP/1.1 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'de7bc11c-4bae-417b-9faf-217f93a11874'} Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:21.977100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Security group de7bc11c-4bae-417b-9faf-217f93a11874 does not exist Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-8dd11488-d9b5-4363-9c31-d8765bb07c6c'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4037667e-af8c-4580-81d9-92214508cfce tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874" status: 404 len: 194 microversion: 2.1 time: 0.114678 Oct 04 20:48:21.993683 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1127/2269] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:21 2022] DELETE /compute/v2.1/os-security-groups/de7bc11c-4bae-417b-9faf-217f93a11874 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:22.005154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.005154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.011795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.011795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.012559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.013660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.014518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.015362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.074419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:22.273621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.307783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca7bd74c-874d-48a2-bfd1-d238bceb8cb9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.665061 Oct 04 20:48:22.320082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:22.327201 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1143/2270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:21 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:22.347328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.348572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.361051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.362423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.363287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.364691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.365579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.366644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.716263 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6390ca6-18da-4429-9383-b01194ea680f tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 204 len: 0 microversion: 2.1 time: 0.726666 Oct 04 20:48:22.717325 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1128/2271] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:21 2022] DELETE /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:22.745769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.749554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.759692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.769359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.770438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.772082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.774101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.775511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.776529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.783443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-545ea86d-e4c1-4187-938a-5eb5a3338efe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 0.443085 Oct 04 20:48:22.785285 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1144/2272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:22 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:22.909129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.911191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.926394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.929295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.930859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.934064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.935491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.936661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:23.377836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:23.401117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-382026b8-5357-41d5-a52a-782dd217ea79 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1648 microversion: 2.1 time: 0.672492 Oct 04 20:48:23.404093 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1129/2273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:22 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1648 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:23.441058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:23.448242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:23.472460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:23.479944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:23.481872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:23.485508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:23.487682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:23.488759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:23.492143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:23.520652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5bec5b5-40e6-4ed5-99ed-e7cc1a0c80cd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.620941 Oct 04 20:48:23.523543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1145/2274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:22 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:23.838685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:23.840676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:23.856300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:23.857602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:23.858830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:23.860692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:23.866306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:23.871894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:23.885097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:23.978305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f54452a-38cc-46ea-a79f-696b2c7c4d24 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.566886 Oct 04 20:48:23.982163 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1130/2275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:23 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:24.455582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:24.458339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.474454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.476172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.477542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.479596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.480888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.482049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.799032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:24.827925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d09855c-f446-47d5-acdc-a43db784ce05 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1506 microversion: 2.1 time: 1.001619 Oct 04 20:48:24.830082 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1146/2276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:23 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1506 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:24.841262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:24.844352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.858884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.861851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.863677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.865213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.866166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.867153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.444995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.470431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4b80da1-23ef-487a-ae33-e00e9741df0d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.637784 Oct 04 20:48:25.476205 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1147/2277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:24 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:25.492768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:25.493984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.522031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.526896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.528446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.537174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.538528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.540920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.732528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.766784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ea080ed3-abe3-4eab-a5ab-026fdcf9b677 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1648 microversion: 2.1 time: 1.319663 Oct 04 20:48:25.770902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1131/2278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:24 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1648 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:25.788726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9c9eff1e-0bb2-4e39-b1dd-682ba5a19d4a"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:25.799657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.816306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.817427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.818361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.820125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.821603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.822625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.950924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] HTTP exception thrown: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Request method failure captured: Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f/os-volume_attachments/600a9a23-71ad-458c-82ff-8dc3f8e1f883 HTTP/1.1 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 74 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJs3KWCKV4-yHCCjLhmn_GArXwSveevDOFIphgf-HnBWUGfK5F_HXf3hn7_P3pkxC0YYEkTIIOe210i9DMkuiWK6M9mZzQdcc89MqfYpJztpuKaQImrozY7m4zkqj7TuAu2Xf4s5iq5m81rt1iX2wZkwN_Rhze0PSsdcUhXPdJNMPBU Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 6db960046c1c449fb3cc9c24cae5f76d Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6db960046c1c449fb3cc9c24cae5f76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 6db960046c1c449fb3cc9c24cae5f76d Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1527676164 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesAdminNegativeTest-1527676164-project-admin Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0cdab3f9a61547908e5e3d8499e5b916 Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesAdminNegativeTest-1527676164-project-admin Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: {"volumeAttachment": {"volumeId": "9c9eff1e-0bb2-4e39-b1dd-682ba5a19d4a"}} Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'b81f0438-5f9b-40a0-8f05-ab1c7223dc9f', 'id': '600a9a23-71ad-458c-82ff-8dc3f8e1f883', 'body': {'volumeAttachment': {'volumeId': '9c9eff1e-0bb2-4e39-b1dd-682ba5a19d4a'}}} Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. (HTTP 404) (Request-ID: req-fd92a5a4-0e8b-4252-82c0-2224caa642b9) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:48:25.962164 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] Returning 404 to user: Volume 600a9a23-71ad-458c-82ff-8dc3f8e1f883 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fffbef1d-21ad-4a56-9907-5fa7581d87a1 tempest-VolumesAdminNegativeTest-1527676164 tempest-VolumesAdminNegativeTest-1527676164-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f/os-volume_attachments/600a9a23-71ad-458c-82ff-8dc3f8e1f883" status: 404 len: 109 microversion: 2.1 time: 0.196638 Oct 04 20:48:25.984796 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1132/2279] 10.222.0.36 () {60 vars in 1433 bytes} [Tue Oct 4 20:48:25 2022] PUT /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f/os-volume_attachments/600a9a23-71ad-458c-82ff-8dc3f8e1f883 => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:26.007430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.008317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.042140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.047288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.058758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.060698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.063547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.065403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.341045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:26.386726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48b90f7e-e904-439f-9ed7-391dd2227bfa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.908439 Oct 04 20:48:26.394888 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1148/2280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:25 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:26.529195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.532253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.551595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.552751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.553716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.555488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.556517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.557442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.067072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.098295 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a555eea4-48df-4584-83c7-179b235a14d4 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1486 microversion: 2.1 time: 1.103003 Oct 04 20:48:27.111370 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1133/2281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:25 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1486 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.129988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d12de0e-6985-4a69-af9c-b75cb45c37c0", "name": "network-vif-deleted", "tag": "00157779-9dd6-4cb6-81ab-0387105a55a1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:27.181280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.197388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.198431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.275038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.289616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] Creating event network-vif-deleted:00157779-9dd6-4cb6-81ab-0387105a55a1 for instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 on n-h2-851029-13 Oct 04 20:48:27.320802 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4b83032-2d2f-400a-b144-67e74aef342b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.777468 Oct 04 20:48:27.327303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b831995d-cd05-4128-a764-cea6136a9664 req-884c210e-22bc-43bc-baf8-369c9fe4bd28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212359 Oct 04 20:48:27.328048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1149/2282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.338076 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1134/2283] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:27.342744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.352294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.386178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.387160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.394137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.399067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.400674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.401642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.440442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.446189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.462755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.464285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.465481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.478753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.480477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.481679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.746201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.782714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-372c318d-9763-40c0-a26e-b2c5191984d3 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1468 microversion: 2.1 time: 0.443438 Oct 04 20:48:27.784775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1150/2284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.819877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1377834030", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:28.124869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] validate_networks() for [('f49455e2-ee7b-48b0-8c4c-b8a053c5b4f8', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:28.282183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:28.308299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00646f69-cb99-4304-9f10-a3948364ed2f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.876929 Oct 04 20:48:28.321981 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1135/2285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:28.385238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.387265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.402811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.403726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.416761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.419014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.420734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.421926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.415964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:29.486971 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd548313-2d62-4a9f-aa19-ec7b4eb3dd3a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 1.105212 Oct 04 20:48:29.515108 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1136/2286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:28 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:29.541992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.543844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.573512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.574375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.577380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.578921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.584440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.590607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.749162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.750049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.753502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.756964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lazy-loading 'fault' on Instance uuid 2d12de0e-6985-4a69-af9c-b75cb45c37c0 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:29.791008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:29.792759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:29.807708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:29.809300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:29.810463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:29.847579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.851108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.852276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.855905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.859327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.866634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.953085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724b09e312294ce0a908c9ba77b6fb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78ca76042274942a3d5592439330eaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:29.978160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4a0988a-68c2-4f6a-b1fa-251bd401b71d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 200 len: 1305 microversion: 2.1 time: 0.456383 Oct 04 20:48:29.984949 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1137/2287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 1305 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:30.003960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.008917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.015904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Getting quotas for project 291b7a745e214dbda2af246e45c5eb6a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:30.045238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Getting quotas for user 42d0482443d2472b80ab46311c0a6815 and project 291b7a745e214dbda2af246e45c5eb6a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:30.052840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.064667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.066118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.072055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.077200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.078608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.105845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:30.115427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:30.434501 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb18849e-b580-4039-a0ea-ad68701edd15 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.646072 Oct 04 20:48:30.447190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1151/2288] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:30.459199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4255193-7159-4b61-a87b-07af328fec90 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.460637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4255193-7159-4b61-a87b-07af328fec90 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.645943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4255193-7159-4b61-a87b-07af328fec90 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:30.673016 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4255193-7159-4b61-a87b-07af328fec90 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1214 microversion: 2.1 time: 0.223581 Oct 04 20:48:30.678647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1152/2289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:30 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:30.699460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.703871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.734003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.735643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.739934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.744415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.746877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.749308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.865563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:31.200148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:31.245637 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b070ee07-57e6-45d9-a0ad-dbec664ae1ab tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 1.255530 Oct 04 20:48:31.264479 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1138/2290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:31.292809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:31.318811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] [instance: 2d12de0e-6985-4a69-af9c-b75cb45c37c0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:31.360926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.383237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.400507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.400507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.400507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.400507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.501768 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] HTTP exception thrown: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Request method failure captured: Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 HTTP/1.1 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsLhD0VDr7oWGPnfpgkA-riqjtW84OICzs43pIH115D5-Vk9Kp5yZEUJk3XF3QHKusSys2ZxF9WZDDTBOxyqwDmnnHBdZMe9dM9XuiR_lEHbN798m0xpNqFP7Cl9j7MHU0YzDcdpqH6jXbnOVSi9A9fg_MD9Aj3nWTJgYKXDGyuSsY Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e78ca76042274942a3d5592439330eaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e78ca76042274942a3d5592439330eaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e78ca76042274942a3d5592439330eaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e78ca76042274942a3d5592439330eaa Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-539949534 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 724b09e312294ce0a908c9ba77b6fb07 Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsTestJSON-539949534-project Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2d12de0e-6985-4a69-af9c-b75cb45c37c0'} Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:31.522481 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. Oct 04 20:48:31.532473 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.536271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Returning 404 to user: Instance 2d12de0e-6985-4a69-af9c-b75cb45c37c0 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:31.538570 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8081cf9c-4af5-4f77-a5fb-60e418c23695 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0" status: 404 len: 111 microversion: 2.1 time: 0.271646 Oct 04 20:48:31.551845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1139/2291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:31 2022] GET /compute/v2.1/servers/2d12de0e-6985-4a69-af9c-b75cb45c37c0 => generated 111 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:31.571213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b2bdb58-0b11-416e-9eeb-9469d03fcf5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54f62c8c10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:31.824863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:31.944451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0a02b3e-5324-4788-9e69-4c565d7039a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 1.263218 Oct 04 20:48:31.983783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1153/2292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:30 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:32.028008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63119874-22eb-453c-8275-b98ee5be30bc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:32.042283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63119874-22eb-453c-8275-b98ee5be30bc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:32.443579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63119874-22eb-453c-8275-b98ee5be30bc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:32.471714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63119874-22eb-453c-8275-b98ee5be30bc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1214 microversion: 2.1 time: 0.484144 Oct 04 20:48:32.479637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1154/2293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:31 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1214 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:32.515780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:32.519903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:32.549666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.567897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.583808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:32.587751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.590336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.593851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.488294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:33.505177 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ba93330-8aee-4e2c-a596-a7dc88493e69 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 1.023325 Oct 04 20:48:33.521101 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1155/2294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:32 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.521101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.521101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.530935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:33.534371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.535748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.536815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.538700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.539841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.540830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.774550 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4b2bdb58-0b11-416e-9eeb-9469d03fcf5d tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e8b416d8-6293-4eda-be5b-f3577e8a5e30" status: 202 len: 0 microversion: 2.1 time: 2.213740 Oct 04 20:48:33.778110 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1140/2295] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:31 2022] DELETE /compute/v2.1/os-security-groups/e8b416d8-6293-4eda-be5b-f3577e8a5e30 => generated 0 bytes in 2225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:33.799841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.801126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.844134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.845066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.846290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.849780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.854377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.860510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.178604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:34.207178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5dde1b41-e808-49ff-8152-69ad01003a1b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1218 microversion: 2.1 time: 0.422701 Oct 04 20:48:34.208446 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1141/2296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:34.227890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:34.228834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:34.252760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.266814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.268127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.269903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.273776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.276673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.404897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:34.405519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:34.442353 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a734cf00-46e5-49e3-8f4c-c10fd323de40 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.933664 Oct 04 20:48:34.455262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1156/2297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:34.491554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f987ebe5-fe16-481d-92a8-00251ac3faf4 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] Calling method '.version_select at 0x7f54fa64b820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:35.077250 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b09b03c5-f84d-4a08-8e3f-8fc231c02408 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 204 len: 0 microversion: 2.1 time: 0.856755 Oct 04 20:48:35.084978 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1142/2298] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:34 2022] DELETE /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:35.343091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f987ebe5-fe16-481d-92a8-00251ac3faf4 tempest-SecurityGroupsTestJSON-539949534 tempest-SecurityGroupsTestJSON-539949534-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/bc87cbe0-1563-413c-999a-36e8411ba3fb" status: 202 len: 0 microversion: 2.1 time: 0.870080 Oct 04 20:48:35.344443 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1157/2299] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:34 2022] DELETE /compute/v2.1/os-security-groups/bc87cbe0-1563-413c-999a-36e8411ba3fb => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:35.364565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:35.366293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:35.390562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:35.391786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:35.393035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:35.394730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:35.402612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:35.409952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:35.505362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1161692150", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:35.738655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:35.887874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:35.926119 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf10cc03-4680-4a83-9d2c-c51273bc709b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.578947 Oct 04 20:48:35.943386 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1158/2300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:35 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:35.974825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:35.976773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:36.006473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.007901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.009233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.011262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.012160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.012980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.049444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:37.050253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:37.051183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:37.052000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:37.052779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:37.069545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:37.100796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.102242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.104224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.106710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.112132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.112132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.167486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Getting quotas for project aa4db8d7079f4f39a6309e0bf01e8a78. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:37.184133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Getting quotas for user 76712dbdd37a476188bea626f27959ac and project aa4db8d7079f4f39a6309e0bf01e8a78. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:37.195101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:37.212458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:37.217793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:37.222481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-333d3a60-639a-4acc-93b3-e7760dd78e8f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1512 microversion: 2.1 time: 1.277236 Oct 04 20:48:37.223436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1159/2301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:35 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1512 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:37.233638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:37.235488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:37.247792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.249901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.251143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.252836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.253781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.261004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.440078 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8781dbc-fb19-428b-89c4-109311770366 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.352091 Oct 04 20:48:37.452933 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1143/2302] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:37.452933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:37.452933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:37.465197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.466116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.467033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.468410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.469266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.470074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.500615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:37.539941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-254ba331-7fdb-4292-ad1d-fede0bc073ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1266 microversion: 2.1 time: 0.307206 Oct 04 20:48:37.541462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1160/2303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:37 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:37.554720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499", "name": "network-vif-plugged", "status": "completed", "tag": "d302df17-5e97-417e-80da-60f9a7b72038"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:37.601433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.603715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.609598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.639611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] Creating event network-vif-plugged:d302df17-5e97-417e-80da-60f9a7b72038 for instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 on n-h2-851029-13 Oct 04 20:48:37.651979 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-942d8289-2013-4d0f-a354-ab19fe28a268 req-73be2361-8549-4ebc-a126-43d39faa8608 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108519 Oct 04 20:48:37.655448 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1161/2304] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:37.690233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:37.695184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:37.725470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.731837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.733714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.737860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.745006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.746353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.246317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.274883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-916ee3b6-3b99-477b-bce7-f778c2f50fb4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.827842 Oct 04 20:48:38.277788 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1144/2305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:37 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.290409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a90f727-d96a-4e76-a678-6125b914bbe5 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.292474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a90f727-d96a-4e76-a678-6125b914bbe5 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.493089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a90f727-d96a-4e76-a678-6125b914bbe5 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.515488 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a90f727-d96a-4e76-a678-6125b914bbe5 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1214 microversion: 2.1 time: 0.234849 Oct 04 20:48:38.528741 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1145/2306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.528741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.529167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.548775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.551333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.552509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.554019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.556171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.556960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.782597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.805886 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-596bbb4d-489a-49e2-8292-5d34158b2f82 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 1.145602 Oct 04 20:48:38.807437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1162/2307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:37 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.818643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.827288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.835573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.837423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.838620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.840663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.841764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.843550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.070769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.091850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7f794bc-9ba5-4aa5-b071-f8450537e73a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1272 microversion: 2.1 time: 0.281522 Oct 04 20:48:39.093823 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1163/2308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:39.198732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.222484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebd93dd9-05d8-49c8-a64e-43b5f1f4241f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1512 microversion: 2.1 time: 0.703638 Oct 04 20:48:39.223652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1146/2309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1512 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:39.338634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.339791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.377062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.377948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.378804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.381591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.384616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.386066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.425341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81f0438-5f9b-40a0-8f05-ab1c7223dc9f", "name": "network-vif-deleted", "tag": "d395cda4-e902-4be2-adb5-c87fd2cf29be"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:39.457777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.458709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.463177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.491107 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] Creating event network-vif-deleted:d395cda4-e902-4be2-adb5-c87fd2cf29be for instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f on n-h1-851029-13 Oct 04 20:48:39.501674 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d2a47dc2-6cf5-4d58-8db0-79c3121516c0 req-e7d72220-93db-4f74-8e1c-a32cf4ad225e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084131 Oct 04 20:48:39.512802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1147/2310] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:39.569462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e94736b5-2c8d-4e99-b71f-1d8a9457b3ea tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.571949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e94736b5-2c8d-4e99-b71f-1d8a9457b3ea tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.948012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e94736b5-2c8d-4e99-b71f-1d8a9457b3ea tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.949978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:39.980993 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e94736b5-2c8d-4e99-b71f-1d8a9457b3ea tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1214 microversion: 2.1 time: 0.424212 Oct 04 20:48:39.985785 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1148/2311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1214 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.006127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.010155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.045417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.046467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.048187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.049868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.050758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.056184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.110342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:40.280612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.312406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bbce0368-f9c2-4c15-a2da-cf960bb2d13d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1316 microversion: 2.1 time: 0.984570 Oct 04 20:48:40.316018 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1164/2312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.351389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.351803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.367759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.368999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.370145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.371921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.373062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.374974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.571726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.593264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.597008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5e45423-23f8-40d1-a1ca-9dac2b0ad69b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1272 microversion: 2.1 time: 0.265006 Oct 04 20:48:40.597918 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1165/2313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.627632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2ad0bfb-91c8-4f7a-bc3b-608d6eb2e02f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.623141 Oct 04 20:48:40.628856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.629086 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1149/2314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.634194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.650879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.652484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.654102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.657578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.662338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.663862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.792358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.793616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.794824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.796522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lazy-loading 'fault' on Instance uuid b81f0438-5f9b-40a0-8f05-ab1c7223dc9f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:40.916727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.963375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e255189c-0bc1-4371-8d88-4f150f79cf53 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 200 len: 1307 microversion: 2.1 time: 0.362924 Oct 04 20:48:40.997522 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1166/2315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:41.030490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.031832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.061457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.063506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.064811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.066490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.067758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.068833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.299194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:41.330267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4caad591-99bb-4f32-9306-18147263f52d tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1266 microversion: 2.1 time: 0.308068 Oct 04 20:48:41.340261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1150/2316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:41.379923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.381235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.409735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.410395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.411186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.413227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.413488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.421649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.662321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.671293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.713964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.719573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.720458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.730903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.734789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.737872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.141175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:42.165096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6dc341f6-bfd8-4ca6-828f-a2b6b45284e2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1504 microversion: 2.1 time: 0.798638 Oct 04 20:48:42.167423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1167/2317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1504 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:42.204882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.206934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:42.226465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.230454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.233866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.245276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.245276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.245276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.319800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:42.392306 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4cc0498-2a75-4d61-bf86-da39d0c09625 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.738531 Oct 04 20:48:42.408529 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1151/2318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:42.437588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.439313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: b81f0438-5f9b-40a0-8f05-ab1c7223dc9f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:42.450001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:42.455107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.456445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.457633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.461705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.464071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.474947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.505343 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] HTTP exception thrown: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Request method failure captured: Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f HTTP/1.1 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsVrrJ8T4dywUWJIVFwMgM8Wt6ugGWs0fz5Qo3FWolgeITKZUa1ZGmrPUP63PcunUCnYiqD9BfLlrGCJx6sHMJmMs7-ZfbPoniuyr14B_So-a8IW5vSBAeK0hZ3VSMJSKi3_pd_4dtO_oCb6NIbDV1WJbu4Nb4-5R4ovwJcsVkgQjM Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0ee50401fe4d4e6a857b1b85bd462a13 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0ee50401fe4d4e6a857b1b85bd462a13 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesAdminNegativeTest-399322333-project Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9a7cb787dae04a1c9c481438fa8cb9bb Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesAdminNegativeTest-399322333-project Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b81f0438-5f9b-40a0-8f05-ab1c7223dc9f'} Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:42.512887 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. Oct 04 20:48:42.521074 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.524116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Returning 404 to user: Instance b81f0438-5f9b-40a0-8f05-ab1c7223dc9f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:42.537620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e496ae23-fa71-450b-b6b2-a781302cfec3 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f" status: 404 len: 111 microversion: 2.1 time: 0.115461 Oct 04 20:48:42.537620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1152/2319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:42 2022] GET /compute/v2.1/servers/b81f0438-5f9b-40a0-8f05-ab1c7223dc9f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:42.542019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.542970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:42.587578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.588460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.590584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.600544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.600544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.600544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.672567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:43.074558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:43.105684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5385ee5-8da3-4427-845b-09d8847aa15f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 0.931939 Oct 04 20:48:43.121541 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1168/2320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:42 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:43.136463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.136463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.166017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.167171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.176396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.176396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.176770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.177236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.413774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bedd649b-50c6-4baa-b34f-9acf4cfe5da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 204 len: 0 microversion: 2.1 time: 0.883898 Oct 04 20:48:43.415365 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1153/2321] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:42 2022] DELETE /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:43.421769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:43.431742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.433366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.450595 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-322f29de-b129-4996-ae25-97ac04b3ade9 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1274 microversion: 2.1 time: 0.338764 Oct 04 20:48:43.456618 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1169/2322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:43 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1274 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.478834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.506830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.508155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.536467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.537426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.538234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.539662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.545878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.547067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.556761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:44.587663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1dc09468-6fec-4bba-9f8d-6d03867bc9a5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1510 microversion: 2.1 time: 1.164837 Oct 04 20:48:44.604689 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1154/2323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:43 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1510 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.620445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.624363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:44.642641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.644585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.645740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.647618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.648732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.649801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.800785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:44.831717 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46f293a0-8c62-4759-9b03-1ea9bff7357c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 1.368495 Oct 04 20:48:44.863571 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1170/2324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:43 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.884585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.888149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:44.912471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.913358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.914171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.915568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.916414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.917190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.203652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:45.225222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f50395a-8b36-4331-b1dd-d36f83f3a306 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1272 microversion: 2.1 time: 0.359556 Oct 04 20:48:45.226323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1171/2325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:45.654442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:45.658733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:45.689984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:45.705653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:45.709828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.712495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:45.713342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:45.722159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.731520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:46.132240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:46.152892 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd3b0a0e-7717-498f-b912-4f5b3256553b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1499 microversion: 2.1 time: 1.554182 Oct 04 20:48:46.155787 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1155/2326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1499 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:46.190475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:46.192603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:46.212804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.223755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.225205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.227011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.228263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.229393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.876222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:46.889038 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc3414b3-3b9d-46c6-b676-b95c532c05d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1510 microversion: 2.1 time: 1.254509 Oct 04 20:48:46.918922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1172/2327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:45 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1510 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:46.940312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:46.941512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:46.957904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.961939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.961939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.962327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.963295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.964534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.141438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:47.157985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:47.191461 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-383bebba-891a-464d-964e-a36f8203ea69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 1.031771 Oct 04 20:48:47.193428 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1156/2328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:46 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:47.209579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:47.212297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:47.230299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.233041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.234152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.237016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.238247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.240150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.265771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:47.307952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1672d793-dbe4-4d94-a6e2-a734aaeeb67f tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1272 microversion: 2.1 time: 0.385880 Oct 04 20:48:47.312464 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1173/2329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:46 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:47.945728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:47.948461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:47.988524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.989451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.990348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.005984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.007359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.008588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.877766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:48.907098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6145a515-e390-4769-9224-d9644b01635d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 200 len: 1476 microversion: 2.1 time: 1.704733 Oct 04 20:48:48.908266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1157/2330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:47 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 1476 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:48.921756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.931945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:48.955973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.964168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.971537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.971537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.971537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.971537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.781815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:49.808326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bbf8fdfd-aa66-44a4-9695-d9685f2ec080 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1510 microversion: 2.1 time: 1.870142 Oct 04 20:48:49.832339 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1174/2331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:47 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1510 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:49.858761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.860902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:49.875916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.878033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.879384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.881161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.882587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.887603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.940303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:49.976402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:49.984411 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5eff9056-3fdf-41be-a74e-e9ec5202105f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 1.073792 Oct 04 20:48:49.992011 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1158/2332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:48 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:50.007965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1109039871"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:50.023962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:50.071421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.072721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.074074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.080330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.080330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.080330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.971206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:50.999112 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc0a2986-8854-4061-951b-8478a116b22c tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 1.164218 Oct 04 20:48:51.027702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1175/2333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:49 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:51.066557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499", "name": "network-vif-deleted", "tag": "d302df17-5e97-417e-80da-60f9a7b72038"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:51.104009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.105280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.106441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.132720 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] Creating event network-vif-deleted:d302df17-5e97-417e-80da-60f9a7b72038 for instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 on n-h2-851029-13 Oct 04 20:48:51.148488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-42f041a7-d142-4cb8-b50f-f9880f549014 req-eae5bf0c-33c8-4271-8224-e64812ef466c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115071 Oct 04 20:48:51.150646 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1176/2334] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:51.166335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:51.167631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:51.198213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.199193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.207597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.207597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.208736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.209752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.253859 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e09bcb7b-2ca6-411d-a038-c49679da145b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5/action" status: 202 len: 0 microversion: 2.1 time: 1.257671 Oct 04 20:48:51.268404 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1159/2335] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:49 2022] POST /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5/action => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:48:51.291202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:51.301067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:51.349675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.350707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.353460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.354950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.355815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.356467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.411910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.412995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.413797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.431525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'fault' on Instance uuid 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:51.760661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:51.825408 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a8a3ec3-5589-4ea2-a41f-4ccf4411791d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 200 len: 1306 microversion: 2.1 time: 0.671464 Oct 04 20:48:51.826609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1177/2336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:51 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 1306 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:51.870508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b964ae4e-3936-44b2-ac0f-1673b97c701f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f06040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:52.072693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b964ae4e-3936-44b2-ac0f-1673b97c701f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.214816 Oct 04 20:48:52.073926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1178/2337] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:51 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:52.083724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:52.085194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:52.099270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.100571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.101800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.103906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.106397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.108369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.164795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:52.200429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:52.239722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8ec5e66-37cc-4687-988f-075da5517006 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.965896 Oct 04 20:48:52.244517 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1160/2338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:51 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:52.275498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2964415e-71ef-494a-9173-e21ed31b0343", "tag": "cfffdb00-96bb-48f6-9fb9-0f006195444c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:52.310110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.314155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.318580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.380081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] Creating event network-changed:cfffdb00-96bb-48f6-9fb9-0f006195444c for instance 2964415e-71ef-494a-9173-e21ed31b0343 on n-h2-851029-13 Oct 04 20:48:52.396686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9eebd469-52f6-4a62-9756-8ff7aa462f7a req-7e8eed76-f221-4bb6-b07f-3b89a6ee6eb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149419 Oct 04 20:48:52.403550 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1161/2339] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:52.436755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:52.438212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:52.450873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.452743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.453560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.454991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.456119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.457152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.755092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2cc33620-0f0e-46de-b8a0-7a25d491bd4f tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "DELETE /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 204 len: 0 microversion: 2.1 time: 0.674751 Oct 04 20:48:52.759670 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1179/2340] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:52 2022] DELETE /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:52.777641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:52.781012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:52.815259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.817867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.819681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.821454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.822732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.823855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.009125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.026707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac511f55-2e83-4f87-89f7-22adb84603ef tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 0.612424 Oct 04 20:48:53.042734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1162/2341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:52 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.066880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.072844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.090623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.092003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.092954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.094390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.095434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.096212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.136573 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 HTTP/1.1 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499'} Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.139182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-07b73292-084d-491c-ba6e-b093e913ec0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 404 len: 111 microversion: 2.1 time: 0.108500 Oct 04 20:48:53.155614 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1163/2342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:53.165638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-37fda490-8db9-409f-853c-9cb83bd3410d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f626faf0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.333974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.358330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-969965d9-b2ad-4d5c-8f7d-4b4a7c561c98 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1679 microversion: 2.1 time: 0.589818 Oct 04 20:48:53.360379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1180/2343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:52 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1679 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.365378 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-37fda490-8db9-409f-853c-9cb83bd3410d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.212264 Oct 04 20:48:53.370899 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1164/2344] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.387934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.390030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.391900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c495be90-ff49-4482-8d9a-4258a30a2a19", "tag": "7da8cc27-c21a-4197-a852-964f527e8ba9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:53.407650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.409038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.410378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.412317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.413651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.415833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.434292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.436102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.441288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.480969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] Creating event network-changed:7da8cc27-c21a-4197-a852-964f527e8ba9 for instance c495be90-ff49-4482-8d9a-4258a30a2a19 on n-h1-851029-13 Oct 04 20:48:53.496153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-759092e2-cb9b-4985-a2e1-cb5205acf408 req-84688c16-e39c-4fc7-b82d-1452f1a39830 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118778 Oct 04 20:48:53.501524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1165/2345] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:53.526583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.527992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.570634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.571786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.572617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.573945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.574865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.575678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.950708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.979761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56381c3e-e811-480f-9f7a-de5bf943a598 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.616592 Oct 04 20:48:53.990788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1181/2346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:54.067833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:54.078544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.079786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.083760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:54.090092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f4052a6-6be0-44f6-9c71-2d3b6b2add4a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.584786 Oct 04 20:48:54.104001 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1166/2347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:54.110195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.111728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.119767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.121585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.123756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.133928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.418162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05bf0346-d0d5-4044-8d2c-74a2efd1948b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f696ed30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.589665 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05bf0346-d0d5-4044-8d2c-74a2efd1948b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.194345 Oct 04 20:48:54.590605 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1167/2348] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:54.616518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.620090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.630841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.631567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.632677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.633882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.634793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.635537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.926159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:54.962469 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ba75413-08fb-4a36-8e6b-9f4b2a22a1ac tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 0.888867 Oct 04 20:48:54.964523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1182/2349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:54.986908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d032ac2c-87a7-48e2-83cc-24cd3daca3b4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d032ac2c-87a7-48e2-83cc-24cd3daca3b4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 163 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": 12345, "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 12345 Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:48:54.995848 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:48:55.005170 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:48:55.008470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d032ac2c-87a7-48e2-83cc-24cd3daca3b4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:55.010478 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d032ac2c-87a7-48e2-83cc-24cd3daca3b4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.043517 Oct 04 20:48:55.012018 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1183/2350] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:55.033291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:55.034307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:55.049940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.051579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.052836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.055007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.056376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.057660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.554238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:55.610887 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98ef9974-5476-47ba-825b-17bc01a46cc4 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1679 microversion: 2.1 time: 1.011784 Oct 04 20:48:55.640655 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1168/2351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1679 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:55.658988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:55.667568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:55.688210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.689100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.691404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.693993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.695442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.696253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.239376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:56.280775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0810c021-187d-468e-85bd-cc151181d9d4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.259993 Oct 04 20:48:56.282459 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1184/2352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:55 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:56.292160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-506d4c38-196d-4431-a11e-0f4e52116f85 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa64b430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.439443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-506d4c38-196d-4431-a11e-0f4e52116f85 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.154527 Oct 04 20:48:56.458998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1185/2353] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:56.465219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:56.469700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.472085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:56.488782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.491534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.494607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.496680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.498553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.499936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.508275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4bec91bd-38cb-427e-9206-5d33b48c3c69 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.878881 Oct 04 20:48:56.514732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1169/2354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:55 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:56.537297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.539099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:56.590631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.591779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.592434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.593819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.594726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.595544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.402309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:57.429231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41bccd60-2f61-4645-aaea-b1e7d0025359 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 0.967713 Oct 04 20:48:57.431149 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1186/2355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:57.446599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:57.448232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:57.465874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.468159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.468958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.470314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.471205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.472166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.486941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:57.528365 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ca3aea7-ba8a-4290-86a2-1501d1ec272a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.016132 Oct 04 20:48:57.535109 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1170/2356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:57.567034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3eb9c72e-596b-4d1f-b992-5ff41098f745 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f609f280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:57.762867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3eb9c72e-596b-4d1f-b992-5ff41098f745 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.219059 Oct 04 20:48:57.766085 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1171/2357] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:57 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:57.783766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:57.785448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:57.812755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.816101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.817302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.818966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.821057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.822143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.583931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:58.614602 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ab7f4ce-cd9f-41b0-8e19-570d5bd7dfa2 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1679 microversion: 2.1 time: 1.176347 Oct 04 20:48:58.615810 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1187/2358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:57 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1679 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:58.641955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4564d918-b93f-4ae3-b899-0d33f505dfc5", "name": "network-vif-plugged", "status": "completed", "tag": "53feefa5-a9a0-4df0-8fce-9d796ceaf289"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:58.671701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.672526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.673334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.698937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] Creating event network-vif-plugged:53feefa5-a9a0-4df0-8fce-9d796ceaf289 for instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 on n-h1-851029-13 Oct 04 20:48:58.711460 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-23f56ba5-ee64-4939-a532-0c00b6c49942 req-be11bd51-30cd-4086-962b-ac5c56890a3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090423 Oct 04 20:48:58.713022 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1188/2359] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:58.725614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:58.727492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:58.741290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.743359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.744466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.747180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.748625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.749830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.772913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:58.808973 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5ba97fa-3399-4309-9c09-f7ebc94e715c tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 1.034592 Oct 04 20:48:58.810573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1172/2360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:57 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:58.830321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43c73660-ec48-4e85-86d3-450b64449c7f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fcfa60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:58.985661 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43c73660-ec48-4e85-86d3-450b64449c7f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.167801 Oct 04 20:48:58.990003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1173/2361] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:58 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:59.670818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:59.677131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:59.714555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.715736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.716822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.718501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.719651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.723607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.007938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:00.033586 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b1d43d78-5a44-40b2-b390-8d8d27c5c624 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1612 microversion: 2.1 time: 0.370631 Oct 04 20:49:00.047004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1174/2362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:59 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1612 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:00.081317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:00.084272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:00.116150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.118257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.119764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.121465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.123249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.124544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.593886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:00.633733 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fae8f160-d58a-4b36-ac3b-6b0ff3377746 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 1.917673 Oct 04 20:49:00.635231 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1189/2363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:58 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:00.664743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37727118-a668-433e-8c2d-73b7b3e93305 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5ddf790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:00.812173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37727118-a668-433e-8c2d-73b7b3e93305 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.174572 Oct 04 20:49:00.817537 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1190/2364] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:00 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:00.839568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b36a3e-8320-4100-9567-baff91fcf2dd", "name": "network-vif-deleted", "tag": "693240e3-8bfd-45b4-9395-71f911b5d81f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:00.877899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.879797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.881110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.902184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:00.912878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] Creating event network-vif-deleted:693240e3-8bfd-45b4-9395-71f911b5d81f for instance 14b36a3e-8320-4100-9567-baff91fcf2dd on n-h2-851029-13 Oct 04 20:49:00.924746 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9e8262f9-e2c9-4949-b5dd-3e62ec01f891 req-dbfb6a43-0cc7-4520-b105-4bc6633ce85d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104546 Oct 04 20:49:00.927317 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1191/2365] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:00.931771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-543f76d5-21ac-4a1b-8c18-855eca98f781 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.881998 Oct 04 20:49:00.933257 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1175/2366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:00 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:01.090207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:01.093084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:01.111798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.114186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.115250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.117302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.118841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.122616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.197915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.199303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.200145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.201443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lazy-loading 'fault' on Instance uuid 14b36a3e-8320-4100-9567-baff91fcf2dd {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:01.207546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:01.299421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a7cb787dae04a1c9c481438fa8cb9bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee50401fe4d4e6a857b1b85bd462a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:01.337828 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c63024c-6a7e-4ca9-adde-5156a7e02b93 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 200 len: 1330 microversion: 2.1 time: 0.259837 Oct 04 20:49:01.345504 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1192/2367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:01 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 1330 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:01.687338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:01.696952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:01.728299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.730857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.737704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.744165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.745556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.751809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.943347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2c97eb4-eb4a-4ad8-aefd-db17097a4f82 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] Calling method '.version_select at 0x7f54f6450310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:01.971106 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2c97eb4-eb4a-4ad8-aefd-db17097a4f82 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.783448 Oct 04 20:49:01.973217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1176/2368] 10.222.0.36 () {60 vars in 1226 bytes} [Tue Oct 4 20:49:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:01.998201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d10a88d2-7f28-46e9-b563-b614dc7fa51c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62c8790>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:02.130005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d10a88d2-7f28-46e9-b563-b614dc7fa51c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.154245 Oct 04 20:49:02.131398 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1177/2369] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:01 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:02.141761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:02.143541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:02.159806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.162061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.163281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.167617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.167617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.168330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.272982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:02.338203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d686ae7b-1ebc-4616-8eed-0fee8d263166 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 0.659109 Oct 04 20:49:02.340174 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1193/2370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:01 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:02.351481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-baedda9f-0899-4405-9e93-e4c972114318 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] Action: 'update', calling method: .version_select at 0x7f54f5f36dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:02.728309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:02.747063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3251a33c-8b69-4f82-9311-094937c39a71 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.612998 Oct 04 20:49:02.748690 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1178/2371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:02 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:02.771815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:02.774171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] [instance: 14b36a3e-8320-4100-9567-baff91fcf2dd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:02.796067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.798061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.800446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.805955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.805955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.806292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.864490 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] HTTP exception thrown: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Request method failure captured: Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd HTTP/1.1 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJsVrrJ8T4dywUWJIVFwMgM8Wt6ugGWs0fz5Qo3FWolgeITKZUa1ZGmrPUP63PcunUCnYiqD9BfLlrGCJx6sHMJmMs7-ZfbPoniuyr14B_So-a8IW5vSBAeK0hZ3VSMJSKi3_pd_4dtO_oCb6NIbDV1WJbu4Nb4-5R4ovwJcsVkgQjM Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0ee50401fe4d4e6a857b1b85bd462a13 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0ee50401fe4d4e6a857b1b85bd462a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0ee50401fe4d4e6a857b1b85bd462a13 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-399322333 Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesAdminNegativeTest-399322333-project Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9a7cb787dae04a1c9c481438fa8cb9bb Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesAdminNegativeTest-399322333-project Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '14b36a3e-8320-4100-9567-baff91fcf2dd'} Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:02.874924 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Returning 404 to user: Instance 14b36a3e-8320-4100-9567-baff91fcf2dd could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13e31033-7f7b-47bb-b37a-759b9952811c tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd" status: 404 len: 111 microversion: 2.1 time: 0.127284 Oct 04 20:49:02.890102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1179/2372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:02 2022] GET /compute/v2.1/servers/14b36a3e-8320-4100-9567-baff91fcf2dd => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:02.901237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-388d4539-e192-44c5-b6f5-ff9ed0bd21e5 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] Calling method '.version_select at 0x7f54f6301dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.183155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-388d4539-e192-44c5-b6f5-ff9ed0bd21e5 tempest-VolumesAdminNegativeTest-399322333 tempest-VolumesAdminNegativeTest-399322333-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-222605186" status: 202 len: 0 microversion: 2.1 time: 0.292715 Oct 04 20:49:03.186120 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1180/2373] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-222605186 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:03.202446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c495be90-ff49-4482-8d9a-4258a30a2a19", "name": "network-vif-plugged", "status": "completed", "tag": "7da8cc27-c21a-4197-a852-964f527e8ba9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:03.235598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.238872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.240471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.289943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] Creating event network-vif-plugged:7da8cc27-c21a-4197-a852-964f527e8ba9 for instance c495be90-ff49-4482-8d9a-4258a30a2a19 on n-h1-851029-13 Oct 04 20:49:03.311367 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b6bb2bb6-28d1-42c4-b34f-ba874bafc31b req-90ad8ae9-c083-4551-ad6e-78a794f9842b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121828 Oct 04 20:49:03.316263 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1181/2374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:03.338327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c8c4c367-ccce-4f76-816a-e87c45925bcf tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6a4ac10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.561384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c8c4c367-ccce-4f76-816a-e87c45925bcf tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.237127 Oct 04 20:49:03.579970 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1182/2375] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:03.608249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.613598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:03.652911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.652911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.653888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.663680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.665862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.668876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.684089 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-baedda9f-0899-4405-9e93-e4c972114318 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.331636 Oct 04 20:49:03.695215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1194/2376] 10.222.0.36 () {62 vars in 1247 bytes} [Tue Oct 4 20:49:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:03.704482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d4162ff-18d2-49e1-983e-473f7f4ccf91 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] Calling method '.version_select at 0x7f54f5e21310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.733698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:03.807271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d4162ff-18d2-49e1-983e-473f7f4ccf91 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.109952 Oct 04 20:49:03.812419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1195/2377] 10.222.0.36 () {60 vars in 1226 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:03.863567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.872143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:03.928109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.929565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.930260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.931682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.932594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.937293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.546399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:04.576095 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2646f81-8bb2-4566-847c-84fcdbb775fc tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 0.983787 Oct 04 20:49:04.618364 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1183/2378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:04.627818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-215a22dd-5096-4289-b9dc-4d79320197e4 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] Action: 'update', calling method: .version_select at 0x7f54f605b040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:04.774691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:04.801987 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64107a2b-3dd9-4e23-b879-2e2182aaae32 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1314 microversion: 2.1 time: 0.961004 Oct 04 20:49:04.803600 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1196/2379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:04.814628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a970065-8dd3-4631-9b05-84038cd6237e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2071574648", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:05.012549 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3a970065-8dd3-4631-9b05-84038cd6237e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. Oct 04 20:49:05.035477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a970065-8dd3-4631-9b05-84038cd6237e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 358 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2071574648", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: exception: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2071574648', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2'}], 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:05.051613 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a970065-8dd3-4631-9b05-84038cd6237e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Block Device de5c2d76-e4a4-497a-9b55-2d91c5f4ccc2 is not bootable. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a970065-8dd3-4631-9b05-84038cd6237e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.253288 Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1197/2380] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:05.119247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-385d22d2-02aa-4c1a-b340-9a8366e387ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f289d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:05.293922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-385d22d2-02aa-4c1a-b340-9a8366e387ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.214123 Oct 04 20:49:05.299343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1198/2381] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:05 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:05.318644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:05.321591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:05.347119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.348736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.350237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.352064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.353276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.354356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.699234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:05.721379 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5561c4fd-c6b5-4d54-bf3e-038e924189f3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.419483 Oct 04 20:49:05.723983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1199/2382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:05 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:05.735077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2964415e-71ef-494a-9173-e21ed31b0343", "name": "network-vif-plugged", "status": "completed", "tag": "cfffdb00-96bb-48f6-9fb9-0f006195444c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:05.758631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.759959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.761168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.772062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-215a22dd-5096-4289-b9dc-4d79320197e4 tempest-QuotaClassesAdmin257Test-1185441112 tempest-QuotaClassesAdmin257Test-1185441112-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.151092 Oct 04 20:49:05.773454 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1184/2383] 10.222.0.36 () {62 vars in 1247 bytes} [Tue Oct 4 20:49:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:05.809435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] Creating event network-vif-plugged:cfffdb00-96bb-48f6-9fb9-0f006195444c for instance 2964415e-71ef-494a-9173-e21ed31b0343 on n-h2-851029-13 Oct 04 20:49:05.820128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:05.821639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:05.833477 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6d8da6de-99ca-4dbd-b9be-eeceffa3e219 req-38aa47f7-7756-4991-b522-7c1c7639336d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106861 Oct 04 20:49:05.842977 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1200/2384] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:05.854619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:05.871761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.872144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.872940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.874363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.875296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.876639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:05.893481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.907481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.908862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.910464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.913473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.914931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.916253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.777891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:06.800024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:06.824686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-815e1261-21f9-47b1-9b39-2d7e60941e62 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.978853 Oct 04 20:49:06.826208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1201/2385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:05 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:06.828555 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52c3edcb-d195-43b7-a78a-16677f79409b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 1.039481 Oct 04 20:49:06.858503 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1185/2386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:05 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:06.883804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:06.887661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:06.892284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a258b4f-fb9b-451b-9dac-7b92cb6321ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62d6820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:06.939592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.949100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.955251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.964415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.965547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.967388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.130356 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a258b4f-fb9b-451b-9dac-7b92cb6321ca tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.262019 Oct 04 20:49:07.132102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1186/2387] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:06 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:07.587761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:07.630826 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-031d15f8-886d-4867-81bd-f0fc30888cd9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1499 microversion: 2.1 time: 0.783512 Oct 04 20:49:07.631947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1202/2388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:06 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1499 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:07.704514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:07.713793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:07.748386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.749445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.750270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.751720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.756050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.758088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.872030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lazy-loading 'flavor' on Instance uuid c495be90-ff49-4482-8d9a-4258a30a2a19 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:07.892880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.905653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:07.962397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.963824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.964856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.967035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.970047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.971348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.601430 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9c33761-50eb-4743-a266-99eb3ba5b126 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "POST /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19/action" status: 200 len: 32 microversion: 2.1 time: 0.914946 Oct 04 20:49:08.611630 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1187/2389] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:07 2022] POST /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19/action => generated 32 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:49:08.628530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf164276-725c-48fa-8956-1c4d22dcac84 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6211310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:08.853624 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf164276-725c-48fa-8956-1c4d22dcac84 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.239119 Oct 04 20:49:08.855177 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1188/2390] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:08 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:08.881755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:08.884557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:08.905373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.920490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.923364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.927244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.933053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.942477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.205631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:09.239487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d05d6958-51cc-4cf9-8d77-1d6d8f8d4799 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1314 microversion: 2.1 time: 1.357054 Oct 04 20:49:09.247429 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1203/2391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:07 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1314 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:09.890310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7db8bdf4-5982-406c-a7d6-e9f89b4e099d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f0ee50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.152363 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7db8bdf4-5982-406c-a7d6-e9f89b4e099d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.263778 Oct 04 20:49:10.160086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1204/2392] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:09 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:10.299632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.307589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:10.381090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.381918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.382965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.384540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.416544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.425285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:11.101614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:11.137238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc32d755-ddd7-474a-b4eb-0925c451570a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 2.262931 Oct 04 20:49:11.147428 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1189/2393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:08 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:11.201020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3757552e-83cd-46f5-9107-92c6efc1856d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6263b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:11.449192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3757552e-83cd-46f5-9107-92c6efc1856d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.262529 Oct 04 20:49:11.450337 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1190/2394] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:11 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:11.728584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:11.784498 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09ed17de-d55e-47fd-a23f-29003a846d01 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1464 microversion: 2.1 time: 1.492315 Oct 04 20:49:11.812714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1205/2395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:10 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1464 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:12.205505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:12.237166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:12.257065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:12.262874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:12.264838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:12.270655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:12.272587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:12.281966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:12.956406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:12.989042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2f6f441-5724-4f8b-9bc3-00c8e181f771 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 0.793576 Oct 04 20:49:13.002205 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1206/2396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:12 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:13.017554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ded24ea-2e3c-4398-81eb-c77ee4e55e85 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f20670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.135917 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2ded24ea-2e3c-4398-81eb-c77ee4e55e85 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.130693 Oct 04 20:49:13.154348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1207/2397] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:13 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:13.253038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Calling method '.version_select at 0x7f54f5fcf430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.315723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.316651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.324288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.385304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.386766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.387875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.428081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a3982526-b252-4252-804a-c3f4db5983eb tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/aa4db8d7079f4f39a6309e0bf01e8a78?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364" status: 200 len: 695 microversion: 2.1 time: 1.583499 Oct 04 20:49:13.444192 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1191/2398] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 4 20:49:11 2022] GET /compute/v2.1/os-simple-tenant-usage/aa4db8d7079f4f39a6309e0bf01e8a78?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364 => generated 695 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:13.462024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '.version_select at 0x7f54f5e27670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.486118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.487468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.488830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.525607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.528133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.530339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.572655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7b69aa9-354d-4d65-b0b8-38fefea3a74b tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/aa4db8d7079f4f39a6309e0bf01e8a78?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364" status: 200 len: 691 microversion: 2.1 time: 0.119976 Oct 04 20:49:13.589892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1208/2399] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 4 20:49:13 2022] GET /compute/v2.1/os-simple-tenant-usage/aa4db8d7079f4f39a6309e0bf01e8a78?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364 => generated 691 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:13.606057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Calling method '.version_select at 0x7f54f6301c10>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.625446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.626798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.628092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.681743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.683518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.685849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.855655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34f6d4cb-9e62-4a79-a36a-250314a2d6fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-175381923", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "08650df2-2319-4b76-af09-4569093fd163", "destination_type": "local"}, {"source_type": "volume", "uuid": "9f393a64-2d5c-4cb6-b6ba-7636c6ce6d7c", "destination_type": "invalid"}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34f6d4cb-9e62-4a79-a36a-250314a2d6fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 494 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-175381923", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "08650df2-2319-4b76-af09-4569093fd163", "destination_type": "local"}, {"source_type": "volume", "uuid": "9f393a64-2d5c-4cb6-b6ba-7636c6ce6d7c", "destination_type": "invalid"}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-175381923', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '08650df2-2319-4b76-af09-4569093fd163', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '9f393a64-2d5c-4cb6-b6ba-7636c6ce6d7c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:13.876065 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:49:13.885536 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:13.892634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34f6d4cb-9e62-4a79-a36a-250314a2d6fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:13.895860 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34f6d4cb-9e62-4a79-a36a-250314a2d6fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.046158 Oct 04 20:49:13.900722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1209/2400] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:49:13.918098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.921904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:13.927318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:13.940652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.942982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.944371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.946220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.947516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.948579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.018570 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3874734-5175-4f23-8796-0399de44348a tempest-TenantUsagesTestJSON-1202094287 tempest-TenantUsagesTestJSON-1202094287-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364&detailed=1" status: 200 len: 30838 microversion: 2.1 time: 0.419544 Oct 04 20:49:14.020713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1192/2401] 10.222.0.36 () {58 vars in 1335 bytes} [Tue Oct 4 20:49:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A49%3A11.838364&end=2022-10-05T20%3A49%3A11.838364&detailed=1 => generated 30838 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:14.056741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:14.058212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:14.102782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.108223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.114408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.116340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.117784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.123719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.648784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:14.682984 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23d54fab-31fe-4ecc-a02f-361d2bf6adc6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.774826 Oct 04 20:49:14.682984 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1210/2402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:13 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:14.705109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:14.706734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:14.740983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.741860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.742774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.746692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.747742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.751961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.897644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:14.983971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:15.023484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-904b94dc-de3d-4bc5-8e4f-d49ad97e891e tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 0.982921 Oct 04 20:49:15.034605 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1193/2403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:14 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:15.053320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef09e43b-4784-40be-8728-a97769a35807 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62c89d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:15.299730 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef09e43b-4784-40be-8728-a97769a35807 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.262764 Oct 04 20:49:15.320020 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1194/2404] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:15 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:15.368541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:15.370434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:15.455263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:15.456892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:15.461556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:15.469001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:15.480174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:15.489219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:15.550680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76e596d4-07c7-4a85-9dea-333a060cb412 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 204 len: 0 microversion: 2.1 time: 0.865742 Oct 04 20:49:15.552410 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1211/2405] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:14 2022] DELETE /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:15.607790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:15.614625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:15.660351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:15.661342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:15.665653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:15.675011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:15.676480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:15.681055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:15.757401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:16.360488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:16.384483 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58b9b6d3-5b6e-45d7-aed2-f08693b3ba5e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.059502 Oct 04 20:49:16.386009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1195/2406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:15 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:16.409226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:16.421075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:16.436860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:16.451299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:16.451299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:16.451299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:16.451299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:16.451299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:16.475327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:16.525218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:16.555665 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad6819dd-ffb6-4982-982b-a8e4665ee314 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1470 microversion: 2.1 time: 0.994535 Oct 04 20:49:16.570706 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1212/2407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:15 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1470 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:16.570706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4502d38-5c79-462c-8a20-d67152acfb95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62bd700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:16.773790 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4502d38-5c79-462c-8a20-d67152acfb95 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.213720 Oct 04 20:49:16.780036 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1213/2408] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:16 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:16.956437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9aa369b-ce9c-4aba-862e-9101488ed77a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-31834008", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9aa369b-ce9c-4aba-862e-9101488ed77a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 490 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-31834008", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-31834008', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.974441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:49:16.980150 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:16.998023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9aa369b-ce9c-4aba-862e-9101488ed77a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:17.006454 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9aa369b-ce9c-4aba-862e-9101488ed77a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.061887 Oct 04 20:49:17.007747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1214/2409] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:16 2022] POST /compute/v2.1/servers => generated 624 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:17.041030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:17.042023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:17.079882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:17.089795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:17.090875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:17.093415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:17.094295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:17.095144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:17.881569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:17.908994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e95af3b1-2044-4b77-aae9-ee5a6f92d7ca tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.516448 Oct 04 20:49:17.927287 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1196/2410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:16 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:17.955983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2d4de8e-ea6e-456b-9794-42b459929335"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:17.955983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:17.983592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:17.990360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:17.990360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:17.990360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:17.990360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:17.991967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:18.122618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:18.146215 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d095056-4619-40df-b0db-d739ed94cce6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.131720 Oct 04 20:49:18.147352 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1215/2411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:17 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:18.202507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:18.203469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:18.244552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:18.244927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:18.246059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:18.248223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:18.249433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:18.251574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.060598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:19.087456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b16bbb29-e018-418c-83ff-f62817f88402 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1470 microversion: 2.1 time: 0.912567 Oct 04 20:49:19.088969 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1216/2412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:18 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1470 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:19.119499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51ad82e2-aeb9-4de6-af3d-a3965b01b2dd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fb9430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:19.309209 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51ad82e2-aeb9-4de6-af3d-a3965b01b2dd tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.203065 Oct 04 20:49:19.313998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1217/2413] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:19 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:19.333078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:19.335069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:19.381355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.386360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.390616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.397564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.404825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.422498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.053412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4805806c-5941-448d-9561-da3a0e21d878 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "POST /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.103159 Oct 04 20:49:20.065318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1197/2414] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 20:49:17 2022] POST /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments => generated 194 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:20.115611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.134587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:20.166255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:20.174473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:20.176128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.178553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.187019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.188518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.189437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.190318 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a232677-1085-4184-938a-1e871224e190 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.869104 Oct 04 20:49:20.192128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.192396 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1218/2415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:19 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:20.201470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2964415e-71ef-494a-9173-e21ed31b0343", "name": "network-vif-deleted", "tag": "cfffdb00-96bb-48f6-9fb9-0f006195444c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:20.221098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.222530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.223757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.326018 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] Creating event network-vif-deleted:cfffdb00-96bb-48f6-9fb9-0f006195444c for instance 2964415e-71ef-494a-9173-e21ed31b0343 on n-h2-851029-13 Oct 04 20:49:20.372745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-25c24a5e-7804-4ef7-b387-634c0699e093 req-3b8d1e25-233e-43da-97f1-cea455063892 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165932 Oct 04 20:49:20.373952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1219/2416] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:20.515408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.515408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:20.599375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.601647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.616093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.633983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.640038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.640038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.895056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.906929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.910355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.913737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lazy-loading 'fault' on Instance uuid 2964415e-71ef-494a-9173-e21ed31b0343 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:21.944171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:22.045783 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ace85794-7b98-4948-82c9-9b39e45b1acc tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.984180 Oct 04 20:49:22.046171 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1198/2417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:20 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:22.123867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c80262f-d675-44ec-8bb0-3dcaee041bb3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6012b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:22.210453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76712dbdd37a476188bea626f27959ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4db8d7079f4f39a6309e0bf01e8a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:22.272343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d00fbd4-bda5-4d6a-8ea5-883f40fad4f2 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 200 len: 1304 microversion: 2.1 time: 1.847955 Oct 04 20:49:22.276718 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1220/2418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:20 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 1304 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:22.312300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fe77156-483a-45fa-876a-ed2fa0ba06b0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fe77156-483a-45fa-876a-ed2fa0ba06b0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 416 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.347618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:49:22.354197 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:22.361974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fe77156-483a-45fa-876a-ed2fa0ba06b0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:22.368819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fe77156-483a-45fa-876a-ed2fa0ba06b0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.086457 Oct 04 20:49:22.397773 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1221/2419] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:22 2022] POST /compute/v2.1/servers => generated 619 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:22.414151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:22.421709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:22.464245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.465157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.465964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:22.480073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.481309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.486274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:22.620429 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c80262f-d675-44ec-8bb0-3dcaee041bb3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.541411 Oct 04 20:49:22.631417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1199/2420] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:22 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:23.108119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:23.123379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:23.184872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:23.191586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:23.192979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:23.210599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:23.213894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:23.216517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:23.524413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:23.681058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:24.859964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:24.877386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:24.902452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e34b002-5810-47eb-86c7-3e9a3a12f311 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.811126 Oct 04 20:49:24.906443 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1200/2421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:23 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:24.937555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30255b0a-7e9b-4389-afbf-d1c3e8a05767 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.533360 Oct 04 20:49:24.940931 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1222/2422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:22 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:24.946168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:24.954340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] [instance: 2964415e-71ef-494a-9173-e21ed31b0343] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:24.973442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9259c22d-71d6-48dc-8a13-fedaf97548e4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f0edc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:24.993244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:25.000520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:25.002258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:25.014943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:25.019947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:25.027416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:25.152933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] HTTP exception thrown: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Request method failure captured: Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 HTTP/1.1 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJwe6LWWUiI2zt7YRMqG0SX02bVd9Nvvqx54b86Dp4U3afmgfgKKc8a1gYCtr72n7eQXe2z_Ngk8Ea-pfeqiGI3PT1aOSU4X80JnaXwjCjVt2aE2seci-nRzN9wDg4qfeAmagzSYry9LpbX4YWZpOK3xpIaV1Yl4DLM-xrVbTgaK2fY Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: aa4db8d7079f4f39a6309e0bf01e8a78 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TenantUsagesTestJSON-897298583 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4db8d7079f4f39a6309e0bf01e8a78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/aa4db8d7079f4f39a6309e0bf01e8a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/aa4db8d7079f4f39a6309e0bf01e8a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_aa4db8d7079f4f39a6309e0bf01e8a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TenantUsagesTestJSON-897298583 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: aa4db8d7079f4f39a6309e0bf01e8a78 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TenantUsagesTestJSON-897298583 Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TenantUsagesTestJSON-897298583-project Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 76712dbdd37a476188bea626f27959ac Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TenantUsagesTestJSON-897298583-project Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2964415e-71ef-494a-9173-e21ed31b0343'} Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:25.170500 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] Returning 404 to user: Instance 2964415e-71ef-494a-9173-e21ed31b0343 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:25.187684 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d96760b-3622-46b4-825d-dd5e1f0cd082 tempest-TenantUsagesTestJSON-897298583 tempest-TenantUsagesTestJSON-897298583-project] 10.222.0.36 "GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343" status: 404 len: 111 microversion: 2.1 time: 0.265298 Oct 04 20:49:25.189537 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1201/2423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:24 2022] GET /compute/v2.1/servers/2964415e-71ef-494a-9173-e21ed31b0343 => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:25.262922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9259c22d-71d6-48dc-8a13-fedaf97548e4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.318061 Oct 04 20:49:25.280440 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1223/2424] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:24 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:25.336911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:25.338509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:25.386467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:25.387311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:25.404566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:25.412328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:25.417528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:25.421619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:26.155956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1513750416", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:26.446235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:26.902101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:26.948547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f55b2e04-e09e-43d0-9a50-d84dd6615b8f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.666121 Oct 04 20:49:26.949737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1224/2425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:25 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:27.006732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:27.010382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:27.035985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:27.043386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:27.045441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:27.047815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:27.050876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:27.055835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:28.085317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:49:28.088456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:49:28.089900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:49:28.092366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:49:28.108304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:49:28.161961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:28.163503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:28.164912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:28.166909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:28.170192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:28.175095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:28.268953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:28.295172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for user 9aa22e4620dc4028b22512a283c561cd and project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:28.328883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:49:28.335383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:49:28.546720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:28.606350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5498f3cb-65ec-4797-92fb-f3df22a7af76 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.415095 Oct 04 20:49:28.608220 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1202/2426] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:49:28.632540 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eade50e7-d68f-4ff9-9d6a-28a038ae5990 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.651781 Oct 04 20:49:28.658586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-085f23f6-d5d1-4ab2-b589-4ca85eb15173 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6ab94c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:28.666329 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1225/2427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:26 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:28.913935 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-085f23f6-d5d1-4ab2-b589-4ca85eb15173 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.279575 Oct 04 20:49:28.931988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1203/2428] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:28 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:28.978736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cecedc2-05e7-4762-b493-b8bbc0595ddd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2099837105", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": -1, "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:29.093045 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2cecedc2-05e7-4762-b493-b8bbc0595ddd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cecedc2-05e7-4762-b493-b8bbc0595ddd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 206 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2099837105", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": -1, "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor -1 could not be found. Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2099837105', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': -1, 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.112858 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 20:49:29.121993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:29.129115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cecedc2-05e7-4762-b493-b8bbc0595ddd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:29.132824 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2cecedc2-05e7-4762-b493-b8bbc0595ddd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.195475 Oct 04 20:49:29.148494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1204/2429] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:28 2022] POST /compute/v2.1/servers => generated 73 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:29.182078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:29.183732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:29.210209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:29.223056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:29.232676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:29.239313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:29.244786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:29.248072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:29.440862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-716046337", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "4313c7d9-5478-45da-b744-8ce5fae33937"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:29.821535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] validate_networks() for [('4313c7d9-5478-45da-b744-8ce5fae33937', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:32.545870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:32.618187 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2764c92-8c4f-4b9c-b478-a33f284e3cfb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 3.461524 Oct 04 20:49:32.623119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1205/2430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:29 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:32.642410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1295181055", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:33.020161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:36.211946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:49:36.215380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:49:36.219389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:49:36.220598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:49:36.221729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:49:36.227429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:36.277138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:36.291029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:36.292474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:36.295622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:36.297342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:36.298637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:36.399761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:36.450581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for user 9aa22e4620dc4028b22512a283c561cd and project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:36.551161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:49:36.597123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:49:37.040771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-078a646d-d83e-4960-9d69-4c444de5c5f6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.413946 Oct 04 20:49:37.047163 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1206/2431] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:49:37.070418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:37.075575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:37.107105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:37.111730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:37.120262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:37.124550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:37.129603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:37.130881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:38.568007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=28 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:38.710219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:49:38.710966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:49:38.713150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:49:38.714296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:49:38.715270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:49:38.735448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:38.796652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:38.801747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:38.803342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:38.808526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:38.814274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:38.815609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:38.894167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:38.916419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Getting quotas for project 5ef4c510d93645338b6a377dcea40fb8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:38.925982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a43c277f-f9aa-4671-989d-531d2881cbec tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1485 microversion: 2.1 time: 1.876224 Oct 04 20:49:38.927174 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1207/2432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:37 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1485 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:38.936945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Getting quotas for user 06b57e40f2d0405698bb171cd86c293e and project 5ef4c510d93645338b6a377dcea40fb8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:38.955206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e5d6432-52cd-444f-af3a-565ee041578f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6cfc0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:39.008991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:49:39.026793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:49:39.206538 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e5d6432-52cd-444f-af3a-565ee041578f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.271981 Oct 04 20:49:39.229888 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1208/2433] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:38 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:39.268306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:39.269583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:39.322652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:39.330609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:39.331710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:39.342904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:39.344320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:39.349105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:39.349582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d287b8cd-9b57-4a10-9e95-479c4e979a36 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 10.675263 Oct 04 20:49:39.363627 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1226/2434] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 10696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:49:39.388814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b57a5e4-a679-4ff0-969a-111a26943e72 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:39.389979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b57a5e4-a679-4ff0-969a-111a26943e72 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:40.119023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b57a5e4-a679-4ff0-969a-111a26943e72 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:40.156573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b57a5e4-a679-4ff0-969a-111a26943e72 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1214 microversion: 2.1 time: 0.790787 Oct 04 20:49:40.162133 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1227/2435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:39 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1214 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:40.179439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:40.196498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:40.233591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:40.235109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:40.236742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:40.238590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:40.239651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:40.240310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:40.442892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:40.494935 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94603e07-7cc9-422c-b179-53381547f5db tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.263010 Oct 04 20:49:40.502344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1209/2436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:40.539436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:40.545690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:40.925953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:41.019084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:41.025187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6b97818-d753-41b3-a16c-4240a9ccc99b tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "POST /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19/action" status: 202 len: 0 microversion: 2.1 time: 0.846972 Oct 04 20:49:41.043059 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1228/2437] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:40 2022] POST /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:41.051683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:41.063587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba917181-6427-42ae-b6c5-57baf741f91e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1258 microversion: 2.21 time: 0.549422 Oct 04 20:49:41.065335 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1210/2438] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:40 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1258 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:41.083341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b07d9ada-3194-45fe-8c2a-5a2c95c8eb67 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fbde50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:41.100801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:41.105120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:41.141661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.149146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.149729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.155454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.156767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.158018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.215430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b07d9ada-3194-45fe-8c2a-5a2c95c8eb67 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.166090 Oct 04 20:49:41.217317 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1229/2439] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:41 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:41.265275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17523bae-d2a4-4bd1-9884-a29a5b959d1a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-973786715", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17523bae-d2a4-4bd1-9884-a29a5b959d1a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 172 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-973786715", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-973786715', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi -1 Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:49:41.295054 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:49:41.310769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17523bae-d2a4-4bd1-9884-a29a5b959d1a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:41.313564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17523bae-d2a4-4bd1-9884-a29a5b959d1a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.085661 Oct 04 20:49:41.316098 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1230/2440] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:41.335015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:41.341590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:41.358815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.360645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.363390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.365109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.366428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.367715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.826169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:41.868145 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c35f129e-ffa7-4a05-b569-19c34ded89bc tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1210 microversion: 2.1 time: 0.547980 Oct 04 20:49:41.871722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1231/2441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:41 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1210 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:41.899520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:41.899520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:41.938443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.945378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.945378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.945378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.948391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.950632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:42.619757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:42.676314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c67f1cd1-6eb4-47e5-a03f-0aad81dcc071 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1493 microversion: 2.1 time: 1.604603 Oct 04 20:49:42.677293 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1211/2442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:41 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1493 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:42.713780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:42.719560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:42.958907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:42.998724 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91f89de7-520b-4c38-a417-6e0c49e6bad8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.121775 Oct 04 20:49:43.025492 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1232/2443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:41 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:43.068578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17cbd4ec-b72c-4af0-9b20-2a5612e783c0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fe3c10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:43.196603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:43.244842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:43.258624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:43.263474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95e6f095-efb0-4ef4-8fea-4e29506477de tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1258 microversion: 2.21 time: 0.576046 Oct 04 20:49:43.265045 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1212/2444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:42 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1258 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:43.272918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17cbd4ec-b72c-4af0-9b20-2a5612e783c0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.247960 Oct 04 20:49:43.274062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1233/2445] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:43 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:43.299623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:43.304546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:43.355360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:43.356727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:43.386147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.392841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.398187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:43.402227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.403692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.404514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:43.411076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.416445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.419150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.422548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:43.425855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.427136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:44.288908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:44.324655 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e33b079a-9fb0-4173-8b5d-46879cecaff2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1274 microversion: 2.1 time: 1.055613 Oct 04 20:49:44.325888 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1213/2446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:43 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1274 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:44.336100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:44.347125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:44.365137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:44.365889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:44.366595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:44.380036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:44.381382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:44.382546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.100059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.127694 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8d0304d-9843-42d4-af45-42927fa117b7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.831296 Oct 04 20:49:45.130241 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1234/2447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:43 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:45.165386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92d5bb50-c9d2-4327-a269-1dcb9e112f71 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f601f670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:45.302829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92d5bb50-c9d2-4327-a269-1dcb9e112f71 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.165977 Oct 04 20:49:45.315526 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1235/2448] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:45 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:45.328140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.345958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:45.372427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:45.383672 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-053afc86-6e4c-43ee-8582-4527dac59284 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1493 microversion: 2.1 time: 1.055484 Oct 04 20:49:45.385573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1214/2449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:44 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1493 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:45.409220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:45.411059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:45.419752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.423329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.428528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.430042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.431291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.435783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.443183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.447308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.449098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.461298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.465371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.468165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.808588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.836698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.895873 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2ca0a6c-3482-42ea-bb43-2b084dadfb8d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1272 microversion: 2.1 time: 0.499861 Oct 04 20:49:45.901183 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1215/2450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:45 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:45.921846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.934206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c78ffd57-eb4b-458a-b1af-7f182c7a8092 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-244959066", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:45.935205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:45.941016 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43628100-4cf0-4118-9aec-e03fef606356 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1310 microversion: 2.21 time: 0.623349 Oct 04 20:49:45.944961 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1236/2451] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:45 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1310 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:45.986174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c78ffd57-eb4b-458a-b1af-7f182c7a8092 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c78ffd57-eb4b-458a-b1af-7f182c7a8092 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 215 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-244959066", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-244959066', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:45.990244 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:49:46.000735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:46.010747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c78ffd57-eb4b-458a-b1af-7f182c7a8092 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:46.014183 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c78ffd57-eb4b-458a-b1af-7f182c7a8092 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.104486 Oct 04 20:49:46.016030 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1216/2452] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:46.041898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.048637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:46.067405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.070427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.073285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.075188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.076792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.078640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.335041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc3f489b-7e7d-4885-9b6f-9855604e76cc tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa5a0820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.358145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:46.483982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc3f489b-7e7d-4885-9b6f-9855604e76cc tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.155908 Oct 04 20:49:46.492625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:46.511142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1217/2453] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:46 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:46.524747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.526688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:46.529878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8b3b90c-b7a2-4063-8a95-2dbe217ccb78 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.506075 Oct 04 20:49:46.532543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1237/2454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:46 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:46.544686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.546039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.546890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.548332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.549363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.550346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.594858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.596207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:46.608662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.610054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.611317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.613171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.614499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.615408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.327554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:47.355691 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3efacbbf-3caa-47d5-90e8-e7b2396ddb67 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.762521 Oct 04 20:49:47.363531 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1238/2455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:46 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:47.375193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:47.378197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:47.404687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.406340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.408576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.411824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.413032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.414074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.659792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:47.698369 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3c75395-5fd3-4e49-8dce-a617e13b85b9 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1493 microversion: 2.1 time: 1.183765 Oct 04 20:49:47.715910 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1218/2456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:46 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1493 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:47.741186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:47.752304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:47.812413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.819340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.822033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.823741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.832893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.839622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.673390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.720329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99c563fb-f2d5-4397-b1f0-c15c2e92dc18 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1272 microversion: 2.1 time: 1.349725 Oct 04 20:49:48.722782 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1239/2457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:47 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1272 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:48.732059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-737db24d-ce46-49e4-859b-ddea2db608a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f028b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:48.782079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.817397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.829008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.833483 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d1257e1-72fb-497f-b258-250afd088198 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1328 microversion: 2.21 time: 1.115008 Oct 04 20:49:48.840706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1219/2458] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:47 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1328 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:48.870113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098016780", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-key-1338079131", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:48.881126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:48.935557 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-737db24d-ce46-49e4-859b-ddea2db608a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.202387 Oct 04 20:49:48.939373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1240/2459] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:48 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:48.968118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:48.976798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:49.033608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.037054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.047498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:49.056821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.060055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.063153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:49.149587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] validate_networks() for [('3f71e3c8-2f24-4002-ad98-706d0dd02af4', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:50.037881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:50.055938 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a839caea-6607-412f-a297-9b973d3e07b2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1499 microversion: 2.1 time: 1.113523 Oct 04 20:49:50.066940 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1241/2460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:48 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1499 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:50.107447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:50.114139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:50.130781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.131633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.133573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.141006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.143106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.144221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.155145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:50.703123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Invalid key_name provided. Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 247 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098016780", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-key-1338079131", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid key_name provided. Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1098016780', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'key_name': 'tempest-key-1338079131', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1338079131 not found for user 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:50.714028 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 20:49:50.721414 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:50.726917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid key_name provided. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:50.731346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d9ceba5-9658-41c0-aeec-71750221c62c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.885429 Oct 04 20:49:50.731910 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1220/2461] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 1890 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:49:50.748687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:50.780453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.781136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.782851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.797947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:50.815271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] Creating event network-changed:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:49:50.826489 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f00a0ba1-1d36-4926-bee6-6f4015fa4eea req-51fcf543-2869-4bc0-a0e1-8bd185fd0783 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092212 Oct 04 20:49:50.835074 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1221/2462] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:50.853210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:50.855455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:50.870539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.873191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.874252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.876231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.877220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.878060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.039984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.075260 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd6fba85-4e6d-4118-9043-6f8ca8bc63bf tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 1.005394 Oct 04 20:49:51.124829 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1242/2463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:50 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:51.139517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e59f0ee5-26e1-428c-aeb1-5ecad87ee3fc tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f06430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.170137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.227631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.238473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.241576 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a7330f6-2f98-4f4f-9162-9a654a4b079f tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1316 microversion: 2.21 time: 0.403661 Oct 04 20:49:51.264276 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1222/2464] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:50 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:51.289170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.297215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.317835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.319221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.322478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.324289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e59f0ee5-26e1-428c-aeb1-5ecad87ee3fc tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1414 microversion: 2.1 time: 0.194555 Oct 04 20:49:51.325365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.326466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.327514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.328015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1243/2465] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:51 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1414 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:51.350324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.359415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.403419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.404454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.405263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.406913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.409397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:51.410885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.415488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.544333 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a395673-652f-466f-b38a-c2cc1a1edc23 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207812 Oct 04 20:49:51.545998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1244/2466] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:51 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:51.586539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.588224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.608937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.609793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.610376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.611637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.612761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.613774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.918273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16c6fd9b-10db-4bbf-af7a-9e535e225135 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 204 len: 0 microversion: 2.1 time: 0.658349 Oct 04 20:49:51.920811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1223/2467] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:51 2022] DELETE /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:51.933619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.935801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.948909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.950420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.951629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.953322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.954490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.955592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.251688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lazy-loading 'services' on Instance uuid e18e87eb-0ab1-48b1-86d6-51209424af84 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:52.435894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:52.465985 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1bd57f7-21db-4584-9083-c63139701a9a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.915839 Oct 04 20:49:52.467149 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1245/2468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:51 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:52.495632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:52.498349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:52.530968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.541322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.542303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.544550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.545493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.546739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.041171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-062deb01-3d41-4caf-869b-ded103a05a1d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments/a2d4de8e-ea6e-456b-9794-42b459929335" status: 202 len: 0 microversion: 2.1 time: 1.116669 Oct 04 20:49:53.042723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1224/2469] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 20:49:51 2022] DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments/a2d4de8e-ea6e-456b-9794-42b459929335 => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:53.061783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:53.064671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:53.081062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.083756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.086101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.087552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.089891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.090796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.234249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:53.390154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:53.414769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-70052c37-bc29-45f8-a6a8-bbfeae7d8969 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 0.937982 Oct 04 20:49:53.418387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1246/2470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:52 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:53.436806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:53.442616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:53.464162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.471076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.471076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.472276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.487838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.489629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.846503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:53.877431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f17910e8-c0c3-43d0-827c-30d69ca80714 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 0.829771 Oct 04 20:49:53.901065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1225/2471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:53 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:53.930777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb7f4eb6-ad5c-43d0-9e83-484f8178e762 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62d6b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:54.089746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb7f4eb6-ad5c-43d0-9e83-484f8178e762 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1423 microversion: 2.1 time: 0.186231 Oct 04 20:49:54.108235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1226/2472] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:53 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1423 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:54.129008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:54.136105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:54.149437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.150916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.153137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:54.154880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.156119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.157279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:54.515087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:54.545138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:54.549184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:54.589689 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6ac4c7c-33a8-4645-a0fd-a72181ac8e12 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 1.147238 Oct 04 20:49:54.591381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1247/2473] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:53 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:49:54.623030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9b41767-c9b6-4259-bb99-a5560e4d5a4a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f361f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:54.739773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9b41767-c9b6-4259-bb99-a5560e4d5a4a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 200 len: 1423 microversion: 2.1 time: 0.145406 Oct 04 20:49:54.741134 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1248/2474] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:49:54 2022] GET /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 1423 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:54.749642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:54.750546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:54.769572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.771537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.772513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:54.774358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.775559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.777139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:55.323228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:55.370136 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f0804db-334c-4225-9cd7-ed471d8cb797 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.259494 Oct 04 20:49:55.373275 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1227/2475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:54 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:55.383262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f64214e-2336-4ad9-9cf5-afb6576dce4f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f60a3160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.461632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:56.505665 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32196f6e-0587-450d-8e1c-1a164f2cfb4f tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.763002 Oct 04 20:49:56.506780 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1249/2476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:54 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:56.531651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.569274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:56.603689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.605034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.606737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:56.608722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.609950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.611055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:56.645154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:58.286175 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f64214e-2336-4ad9-9cf5-afb6576dce4f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 204 len: 0 microversion: 2.1 time: 2.910589 Oct 04 20:49:58.289914 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1228/2477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:55 2022] DELETE /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 0 bytes in 2915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:58.314915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-19851421", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:58.642591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:58.679416 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7cd55554-a0c4-43aa-9a92-d340ed677db5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 2.165091 Oct 04 20:49:58.686154 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1250/2478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:56 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:58.708247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:58.714623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:58.744694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.750561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.752022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.759948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.766796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.767674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.997616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Neutron security group does_not_exist not found {{(pid=123542) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 20:49:58.998717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 256 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-19851421", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-19851421', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 20:49:59.013223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:49:59.023465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:59.032328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c5e60a0-a09b-4af2-b546-a3b990a36a06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.724385 Oct 04 20:49:59.032328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1229/2479] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:58 2022] POST /compute/v2.1/servers => generated 106 bytes in 730 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:59.036165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:59.044704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:59.068875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.072663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.073530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:59.076762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.080508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.081358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.010597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.033885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.049485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.056201 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b63ce63-ffed-4764-a82f-1eaee279f83c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 1.367339 Oct 04 20:50:00.062716 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1251/2480] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:49:58 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:00.071973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:00.083278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:00.097461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.120782 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bde046f8-0bd9-4edb-aaa3-350d4b748c27 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1505 microversion: 2.1 time: 1.097995 Oct 04 20:50:00.122074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:00.122985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:00.123769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.125071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:00.126261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:00.139834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.145458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1230/2481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:59 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1505 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:00.174166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:00.177563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:00.200016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:00.201626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:00.202818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.205159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:00.208004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:00.209383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.248290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:01.002643 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4d44d1f-e7b0-4f77-b067-7fc62d3617ea tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 204 len: 0 microversion: 2.1 time: 0.936244 Oct 04 20:50:01.003803 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1252/2482] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:00 2022] DELETE /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:01.096676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9822b8f-5142-4cf3-8970-f0636192a233", "tag": "f666bde8-d8f1-4e8a-9be4-aa14d774c487"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:01.160678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.161764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.162567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.210092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] Creating event network-changed:f666bde8-d8f1-4e8a-9be4-aa14d774c487 for instance c9822b8f-5142-4cf3-8970-f0636192a233 on n-h2-851029-13 Oct 04 20:50:01.220573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-08d365ac-9bc6-432e-b5d9-ca44bedbc50b req-57177308-2d87-44d2-953a-a9d750d86aca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178892 Oct 04 20:50:01.222965 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1253/2483] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:01.233974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:01.236082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:01.251535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.253305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.254630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.256701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.259295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.260569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.897248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:01.927013 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-657d7327-47db-46ce-96f4-2574df26400a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.779191 Oct 04 20:50:01.933195 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1231/2484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:00 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:01.982721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4564d918-b93f-4ae3-b899-0d33f505dfc5", "name": "network-vif-unplugged", "status": "completed", "tag": "53feefa5-a9a0-4df0-8fce-9d796ceaf289"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:02.007236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:02.008922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:02.010190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:02.037693 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] Creating event network-vif-unplugged:53feefa5-a9a0-4df0-8fce-9d796ceaf289 for instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 on n-h1-851029-13 Oct 04 20:50:02.050875 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-186a670e-fcf9-400f-9d91-be3b65a09872 req-ef33cfc1-b425-4556-b758-d91f61297ce1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096095 Oct 04 20:50:02.052896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1232/2485] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:02.064142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:02.066030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:02.078925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:02.080594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:02.081761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:02.083797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:02.086263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:02.087591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:02.773781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:02.791225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d067d3c4-eb98-4ab1-b201-507b14eb6bf4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 1.564992 Oct 04 20:50:02.808010 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1254/2486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:01 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:02.835999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:02.837223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:02.855189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:02.856994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:02.857163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:02.858683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:02.859629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:02.860476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.246593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.287825 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a9055d0-1c95-46b5-93ce-6c233937a643 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 200 len: 1463 microversion: 2.1 time: 0.477764 Oct 04 20:50:03.296262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1255/2487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:02 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 1463 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:03.325053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.331011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1377439920", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "7799ac52-f6d5-4905-977d-0ebc15f0fd4a"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:03.352440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.355424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.358354 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d5b5020-706e-4148-b619-b762e5eefed7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 1.302785 Oct 04 20:50:03.380003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1233/2488] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:02 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:03.419050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:03.423357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:03.462736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.476393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.481516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.483440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.487310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.488461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.558611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] validate_networks() for [('7799ac52-f6d5-4905-977d-0ebc15f0fd4a', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:05.421196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:05.456975 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da3bb0e6-3033-4675-a5a9-ecf0178a836e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.067878 Oct 04 20:50:05.499589 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1234/2489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:03 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:05.523907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c495be90-ff49-4482-8d9a-4258a30a2a19", "name": "network-vif-deleted", "tag": "7da8cc27-c21a-4197-a852-964f527e8ba9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:05.573150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:05.574943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:05.579597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:05.625986 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] Creating event network-vif-deleted:7da8cc27-c21a-4197-a852-964f527e8ba9 for instance c495be90-ff49-4482-8d9a-4258a30a2a19 on n-h1-851029-13 Oct 04 20:50:05.637404 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-84725a6d-dd77-442a-8b3d-602901060c83 req-97ffdc2d-0748-4aca-bef8-dafd461dc310 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130083 Oct 04 20:50:05.639822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1235/2490] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:05.683563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:05.685574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:05.705751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:05.707217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:05.708753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:05.710980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:05.712799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:05.714582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:06.936851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:06.976909 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85e8dd1b-b2fe-4759-84ac-45107d47293e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 1.333656 Oct 04 20:50:06.982112 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1236/2491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:05 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:07.021710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "name": "network-vif-plugged", "status": "completed", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:07.053736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.054601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.055368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.103240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] Creating event network-vif-plugged:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:50:07.138082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c02eced9-675e-420e-89da-76bc14669c79 req-337352ad-d932-4a4c-b23b-6b900bbd4855 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140355 Oct 04 20:50:07.141039 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1237/2492] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:07.160838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:07.163755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: c495be90-ff49-4482-8d9a-4258a30a2a19] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:07.181100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.184163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.186579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.189270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.191303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.192609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.232176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] HTTP exception thrown: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Request method failure captured: Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 HTTP/1.1 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvMFJAk4rSt43KEEqNqtoY8aQeTAMdMGZQKHDc8Arfd1zJwj7uJZdaGGMlWCUidjyq8ykNiA0CoGhJD3BZF-o80sLtMeRrJ_rSUjcZvuqv4laRM0cBoj1mGgKkPz2LIQj8yQuCADrGqbanU9I-kTUIEajw0jAZMTosc-J559aHnPbY Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 291b7a745e214dbda2af246e45c5eb6a Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 291b7a745e214dbda2af246e45c5eb6a Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueTestJSON-639890711-project Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 42d0482443d2472b80ab46311c0a6815 Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueTestJSON-639890711-project Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c495be90-ff49-4482-8d9a-4258a30a2a19'} Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:07.236275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. Oct 04 20:50:07.244849 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.247856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Returning 404 to user: Instance c495be90-ff49-4482-8d9a-4258a30a2a19 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:07.251208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-184cfe64-060d-4b0e-aa54-dd6b24df3785 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19" status: 404 len: 111 microversion: 2.1 time: 0.107075 Oct 04 20:50:07.253056 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1238/2493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:07 2022] GET /compute/v2.1/servers/c495be90-ff49-4482-8d9a-4258a30a2a19 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:07.272632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:07.274701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:07.291059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.294622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.296020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.298957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.300309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.301768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.221306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:09.222796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:09.224443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:09.231182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:09.233905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:09.240406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:09.288889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:09.295999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:09.299554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.300533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.304160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.304979 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fefbbd39-0449-4916-9634-1e277781aeba tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 2.048878 Oct 04 20:50:09.307464 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1239/2494] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:07 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:09.323965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.332049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.336375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.350152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:09.351446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:09.355065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:09.369293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/99e11b10-8ba1-46e6-89c9-80b4cb3ee28d HTTP/1.1 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '99e11b10-8ba1-46e6-89c9-80b4cb3ee28d'} Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:09.373198 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 99e11b10-8ba1-46e6-89c9-80b4cb3ee28d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4b795b0-cf5b-4bdc-9de1-4d7099783db2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/99e11b10-8ba1-46e6-89c9-80b4cb3ee28d" status: 404 len: 111 microversion: 2.1 time: 0.046566 Oct 04 20:50:09.395141 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1240/2495] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:09 2022] DELETE /compute/v2.1/servers/99e11b10-8ba1-46e6-89c9-80b4cb3ee28d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:09.431201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:09.464299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:09.506307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for user 9265d783835047bb8377fccd36c1fdb8 and project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:09.544568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:09.553941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:09.773498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b96a509f-b920-40b3-b685-582a60aacdd3 tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] Calling method '.version_select at 0x7f54fa5c23a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:09.812668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abd69125-a8f8-46b5-9e6c-f92dce209b96 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.514195 Oct 04 20:50:09.815087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1256/2496] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 6518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:09.825522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:09.826830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:09.843258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.845123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.846286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.847890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.848733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.851316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.898640 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b96a509f-b920-40b3-b685-582a60aacdd3 tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] 10.222.0.36 "GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163" status: 200 len: 784 microversion: 2.1 time: 0.517933 Oct 04 20:50:09.917231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1241/2497] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:09 2022] GET /compute/v2.1/images/08650df2-2319-4b76-af09-4569093fd163 => generated 784 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:09.980123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:10.109367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9cffd92-de71-437e-ac27-7a57153073c0 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Calling method '.version_select at 0x7f54f6012160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.208825 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9cffd92-de71-437e-ac27-7a57153073c0 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.288624 Oct 04 20:50:10.210196 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1242/2498] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:50:09 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:10.223530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36bb30e-b051-48ed-8fb1-bdccaa152f6a", "tag": "9f0c5475-e4a0-49e2-9aec-a2325785d9f0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:10.246642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.247555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.248375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.274325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] Creating event network-changed:9f0c5475-e4a0-49e2-9aec-a2325785d9f0 for instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a on n-h1-851029-13 Oct 04 20:50:10.285282 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9eefefc5-e555-4987-9f16-05491731106b req-16a141a4-1f74-430b-957b-2c9704182fe3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071603 Oct 04 20:50:10.287792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1243/2499] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:10.312763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.312763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.323990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.324997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.325875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.327590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.328471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.329361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.615361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:10.617031 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bd9a2e2-5736-4bc1-80f7-6bd0a669b2c6 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 204 len: 0 microversion: 2.1 time: 0.798900 Oct 04 20:50:10.619056 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1257/2500] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:09 2022] DELETE /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:10.632613 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04bd0036-5eb1-4b56-b3c7-c70f2e46927e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 0.341530 Oct 04 20:50:10.634289 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1244/2501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:10.641168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.646539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.655844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.657443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.671531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.672498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.672742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.673330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.673675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.674357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.674650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.675556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.675943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.676334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.677181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.678150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.708429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:10.740619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-27513a63-ac02-4d99-bd19-ec2544c9c815 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119110 Oct 04 20:50:10.741842 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1258/2502] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:10.753938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9822b8f-5142-4cf3-8970-f0636192a233", "name": "network-vif-plugged", "status": "completed", "tag": "f666bde8-d8f1-4e8a-9be4-aa14d774c487"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:10.775400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.776321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.777957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.806832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] Creating event network-vif-plugged:f666bde8-d8f1-4e8a-9be4-aa14d774c487 for instance c9822b8f-5142-4cf3-8970-f0636192a233 on n-h2-851029-13 Oct 04 20:50:10.816063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a21fa7e5-faa0-472d-ab6d-ad31cfb41ed2 req-f494f399-22c8-481f-b852-e4966ece6891 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070307 Oct 04 20:50:10.817718 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1259/2503] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:10.828443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02938099-4bea-4661-9390-d3004e04974c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.830449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02938099-4bea-4661-9390-d3004e04974c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.968367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-02938099-4bea-4661-9390-d3004e04974c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:10.983762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02938099-4bea-4661-9390-d3004e04974c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1208 microversion: 2.1 time: 0.163717 Oct 04 20:50:10.985174 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1260/2504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1208 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:10.994919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35ca28e8-a698-454d-a72b-2caf84bc766c tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] Calling method '.version_select at 0x7f54f5fbdf70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:11.064845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.082001 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f7f5c6c-bf16-4379-8662-1b4d1a8e05c7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.444968 Oct 04 20:50:11.094707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1245/2505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:11.096912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1522c28b-172c-433e-a5f6-3fb1a22609e3 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Action: 'create', calling method: .version_select at 0x7f54f62f9940>, body: {"pool": "non_exist_pool"} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:11.170403 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1522c28b-172c-433e-a5f6-3fb1a22609e3 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] HTTP exception thrown: Floating IP pool not found. Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1522c28b-172c-433e-a5f6-3fb1a22609e3 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Request method failure captured: Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 26 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJx__x23rkiaZNV82LjlSjYA7gmpM3mnLE3G3NuOvailfw644Z7aoIZP5l8ivzMLQ03aNaBIG4nRWvc1Aa3-iOGyKU0WEUGnBNTktagc4RX3R9S6lRxg6VSuDeyUh-ARpnL6YOk05BOWgMeRCMT8_R7YH7ISV236jcPb1xcHus144H0 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2cad7df0f551493da8eb9ab9e4859135 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2cad7df0f551493da8eb9ab9e4859135 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FloatingIPsNegativeTestJSON-568939953-project Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 64b2f5b006f64a67bb0d0e1a06ac02f0 Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-568939953-project Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: {"pool": "non_exist_pool"} Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: exception: Floating IP pool not found. Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:11.174382 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:11.184809 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 20:50:11.184809 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:11.184809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1522c28b-172c-433e-a5f6-3fb1a22609e3 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Returning 404 to user: Floating IP pool not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:11.186249 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1522c28b-172c-433e-a5f6-3fb1a22609e3 tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.098962 Oct 04 20:50:11.192651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35ca28e8-a698-454d-a72b-2caf84bc766c tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] 10.222.0.36 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.205257 Oct 04 20:50:11.197692 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1246/2506] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:50:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:50:11.200631 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1261/2507] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/images => generated 871 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:11.210957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:11.212065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:11.219130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:11.220448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:11.226292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.227281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.228364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.229757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.231183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.231948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.236991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.238225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.239220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.240851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.243036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.244453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.653130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.666694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.673697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6175898d-4ff6-43d4-b71c-6ca26b28f08a tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1492 microversion: 2.1 time: 0.470433 Oct 04 20:50:11.691704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1262/2508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:11 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1492 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:11.703430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:11.708300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:11.711549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.716898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.720437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81872e21-86c0-4c02-b87f-c0616809a03c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 0.519807 Oct 04 20:50:11.725340 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1247/2509] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:11 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:11.739088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.739088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.739088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.739515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.740156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.742275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:11.744492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:11.746362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.763317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.765436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.766792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.769915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.771907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.773645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.878356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02790bea-67f4-4705-a406-d07b1c995dcb tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184194 Oct 04 20:50:11.894783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1263/2510] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:11 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84/os-volume_attachments => generated 25 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:11.918819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Calling method '.version_select at 0x7f54f5dcb0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:12.231014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 could not be found", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:50:12.232274 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] HTTP exception thrown: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Request method failure captured: Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-floating-ips/53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 HTTP/1.1 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJx__x23rkiaZNV82LjlSjYA7gmpM3mnLE3G3NuOvailfw644Z7aoIZP5l8ivzMLQ03aNaBIG4nRWvc1Aa3-iOGyKU0WEUGnBNTktagc4RX3R9S6lRxg6VSuDeyUh-ARpnL6YOk05BOWgMeRCMT8_R7YH7ISV236jcPb1xcHus144H0 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2cad7df0f551493da8eb9ab9e4859135 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2cad7df0f551493da8eb9ab9e4859135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2cad7df0f551493da8eb9ab9e4859135 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-568939953 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-FloatingIPsNegativeTestJSON-568939953-project Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 64b2f5b006f64a67bb0d0e1a06ac02f0 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-568939953-project Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: exception: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8'} Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 could not be found Oct 04 20:50:12.242690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-696addf9-d8c1-457b-9533-fa546feb8171'] Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8. Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:12.255001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] Returning 404 to user: Floating IP not found for ID 53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:12.271254 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba4457dd-9ebe-4305-beb6-4e014da85dbd tempest-FloatingIPsNegativeTestJSON-568939953 tempest-FloatingIPsNegativeTestJSON-568939953-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8" status: 404 len: 111 microversion: 2.1 time: 0.358771 Oct 04 20:50:12.272851 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1264/2511] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:50:11 2022] DELETE /compute/v2.1/os-floating-ips/53e25dc3-86b3-49ce-b3f4-8f784c5aa9b8 => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:12.289187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82920ea6-10c9-4f97-a744-b0c419c012ed tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] Calling method '.version_select at 0x7f54f5f4cf70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82920ea6-10c9-4f97-a744-b0c419c012ed tempest-ListImagesTestJSON-1981226149 tempest-ListImagesTestJSON-1981226149-project] 10.222.0.36 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.200229 Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1265/2512] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 20:50:12 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.771358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:12.791014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bffa775d-ff10-4e23-9cf4-9557185f9c2b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.062776 Oct 04 20:50:12.807087 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1248/2513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:11 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:13.221196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:13.224610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:13.249446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:13.262951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.274521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.278592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.286091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.287585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.290000 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fffa9114-ce03-401f-be85-4cf66fb83182 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1314 microversion: 2.1 time: 0.792382 Oct 04 20:50:13.290584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.293939 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1266/2514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:12 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:13.315663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:13.321187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:13.347673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.349126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.350293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.356519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.357830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.359147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.463597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:13.610458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:13.668737 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a33a6b95-d268-44f4-982f-2bb7219848d4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1260 microversion: 2.1 time: 0.853536 Oct 04 20:50:13.672550 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1249/2515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:12 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1260 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:13.719623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4564d918-b93f-4ae3-b899-0d33f505dfc5", "name": "network-vif-deleted", "tag": "53feefa5-a9a0-4df0-8fce-9d796ceaf289"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:13.799828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:13.804804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.810063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.819017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.866415 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] Creating event network-vif-deleted:53feefa5-a9a0-4df0-8fce-9d796ceaf289 for instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 on n-h1-851029-13 Oct 04 20:50:13.887569 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bf06e78b-5df4-4b02-8a23-0c2e0cff5334 req-1f213f94-1b06-407a-a254-dfd722ad5b64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204774 Oct 04 20:50:13.887569 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1250/2516] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:13.897214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:13.900007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:13.914955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.916284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.917389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.924385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.925669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.926897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.310143 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86819013-4fc1-44cd-b394-98e70dbb4102 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 204 len: 0 microversion: 2.1 time: 1.010131 Oct 04 20:50:14.312883 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1267/2517] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:13 2022] DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:14.342724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:14.345382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:14.364565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:14.370891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:14.377305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.379062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:14.381387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:14.389336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.993929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:15.034547 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f579f5d-b809-4c90-8a10-12ac88ed13fe tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1492 microversion: 2.1 time: 1.149235 Oct 04 20:50:15.046947 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1251/2518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:13 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1492 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:15.080091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:15.084248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Failed to fetch instance by id 9223372036854775808 {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:50:15.086405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9223372036854775808 could not be found. Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9223372036854775808'} Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:15.100044 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:15.115358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:15.119731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:15.119993 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ad3d03c-9dc5-4c4c-89e9-c4a47e2e751f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.053302 Oct 04 20:50:15.119993 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1252/2519] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Oct 4 20:50:15 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:50:15.130861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:15.134232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:15.145622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:15.148921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:15.153325 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-387aae41-4887-4128-8a94-f8a79394d714 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 0.837870 Oct 04 20:50:15.154461 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1268/2520] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:14 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:15.192123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:15.193350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:15.198044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.199933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.204260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:15.206462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.210978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.212456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:15.221936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.223079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.237523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:15.239119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.239991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.240812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.668651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:16.712401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae0ac87b-c6bd-4b21-989f-fea1ba3c4034 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1681 microversion: 2.1 time: 1.586746 Oct 04 20:50:16.713734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1253/2521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:15 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1681 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:16.739180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:16.740951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:16.761018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.762282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.763462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.765684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.767062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.768687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.880163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:16.905255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6824544-b886-4bdc-a0ba-74ba0105abee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1464 microversion: 2.1 time: 1.744728 Oct 04 20:50:16.906604 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1269/2522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:15 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1464 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:16.948283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:16.955126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:16.965867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.966786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.968148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.969890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.971166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.973692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.026049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:17.054916 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75762b79-78f7-4fdf-804a-5b172c8758da tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1266 microversion: 2.1 time: 0.338235 Oct 04 20:50:17.071535 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1254/2523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:16 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:17.100703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:17.102425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:17.116055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.117162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.118303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.120079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.121411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.122869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.233265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.234241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.234885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.235837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lazy-loading 'fault' on Instance uuid 9e55e2b2-7b1f-475c-b067-173a27509901 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:17.600400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d0482443d2472b80ab46311c0a6815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291b7a745e214dbda2af246e45c5eb6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:17.632119 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afbf6c29-1ab3-46d5-8cbf-787e017992a2 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 200 len: 1304 microversion: 2.1 time: 0.557935 Oct 04 20:50:17.638730 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1255/2524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:17 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 1304 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:17.650270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:17.664799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:17.678817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.681179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.682599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.684981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.686651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.687788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.575512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:18.609629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa40b088-8ff0-4e7f-98a1-1ace43acdb4b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.688451 Oct 04 20:50:18.628361 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1270/2525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:16 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:18.633456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e55e2b2-7b1f-475c-b067-173a27509901", "name": "network-vif-deleted", "tag": "c71a618f-39cd-4566-ba71-fe2adbaf510e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:18.662749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:18.692522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:18.697110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:18.699849 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0d106e5-a368-4402-9e1a-8e5290943614 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 1.057928 Oct 04 20:50:18.709413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.709413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.709735 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1256/2526] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:17 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:18.709879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.739619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:18.743837 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] Creating event network-vif-deleted:c71a618f-39cd-4566-ba71-fe2adbaf510e for instance 9e55e2b2-7b1f-475c-b067-173a27509901 on n-h2-851029-13 Oct 04 20:50:18.766972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:18.771347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-688d982f-8849-4887-989b-de631dbca556 req-ca2795de-a37d-48ca-9e53-0bf9b0d44648 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152097 Oct 04 20:50:18.772514 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1271/2527] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:18.784618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.785106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:18.785503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.786294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.787166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:18.788488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.789736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.791500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.798401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.799409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.800043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.801294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.802337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.804260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.389645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:19.444513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:19.475192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be89bb0e-1941-4115-85d1-6b6f7f9a3977 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1681 microversion: 2.1 time: 0.698052 Oct 04 20:50:19.476129 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1272/2528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:18 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1681 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:19.485039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:19.486775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:19.506029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.507423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.509138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.510535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:19.512217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.513336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.514221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.540320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f84e6362-9bc2-4ac5-baf0-758fe85ca9ed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1464 microversion: 2.1 time: 0.836390 Oct 04 20:50:19.543044 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1257/2529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:18 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1464 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:19.556524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:19.558872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:19.581082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.584077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.585685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.587890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.615745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.618101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.879804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:19.903346 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f869c5a9-2b8b-4266-8dd5-c1420c2033fa tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1266 microversion: 2.1 time: 0.423086 Oct 04 20:50:19.908351 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1273/2530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:19 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:19.919769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:19.921556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] [instance: 9e55e2b2-7b1f-475c-b067-173a27509901] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:19.955227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.960479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.961889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:19.975962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:19.980758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:19.983099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:20.050172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] HTTP exception thrown: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Request method failure captured: Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 HTTP/1.1 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvMFJAk4rSt43KEEqNqtoY8aQeTAMdMGZQKHDc8Arfd1zJwj7uJZdaGGMlWCUidjyq8ykNiA0CoGhJD3BZF-o80sLtMeRrJ_rSUjcZvuqv4laRM0cBoj1mGgKkPz2LIQj8yQuCADrGqbanU9I-kTUIEajw0jAZMTosc-J559aHnPbY Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 291b7a745e214dbda2af246e45c5eb6a Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_291b7a745e214dbda2af246e45c5eb6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 291b7a745e214dbda2af246e45c5eb6a Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerRescueTestJSON-639890711 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerRescueTestJSON-639890711-project Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 42d0482443d2472b80ab46311c0a6815 Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerRescueTestJSON-639890711-project Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9e55e2b2-7b1f-475c-b067-173a27509901'} Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:20.067319 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. Oct 04 20:50:20.074632 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:20.084108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] Returning 404 to user: Instance 9e55e2b2-7b1f-475c-b067-173a27509901 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:20.086210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-090900c7-49a5-47af-b4a9-5610fb217255 tempest-ServerRescueTestJSON-639890711 tempest-ServerRescueTestJSON-639890711-project] 10.222.0.36 "GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901" status: 404 len: 111 microversion: 2.1 time: 0.175040 Oct 04 20:50:20.092854 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1274/2531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:19 2022] GET /compute/v2.1/servers/9e55e2b2-7b1f-475c-b067-173a27509901 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:20.121442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36bb30e-b051-48ed-8fb1-bdccaa152f6a", "name": "network-vif-plugged", "status": "completed", "tag": "9f0c5475-e4a0-49e2-9aec-a2325785d9f0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:20.158041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:20.163160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:20.163160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:20.206559 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] Creating event network-vif-plugged:9f0c5475-e4a0-49e2-9aec-a2325785d9f0 for instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a on n-h1-851029-13 Oct 04 20:50:20.218738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cedc79c6-7115-4c54-ab23-9eb12511f137 req-81ce3219-6641-43d3-ab1b-2185c866ae0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120036 Oct 04 20:50:20.220430 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1275/2532] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:20.242581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:20.244799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:20.263476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:20.265100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:20.267655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:20.273111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:20.275157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:20.276880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:20.977050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:21.390536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:21.427545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d741ef39-7a94-4081-8598-b5fc8714e88a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.880857 Oct 04 20:50:21.430557 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1258/2533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:19 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:21.442486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1480074521", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7c2310d4-398a-4ac8-92be-ba2fc037716e"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:21.741590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:21.746847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:21.780588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:21.783950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:21.786203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d87ec3b-7eb7-4d19-b41c-667711b8356b tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1358 microversion: 2.21 time: 1.563359 Oct 04 20:50:21.802714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1276/2534] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:20 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1358 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:22.192537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Calling method '.version_select at 0x7f54f611f160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:22.218579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.220104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.226933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:22.226933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.226933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.240071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:22.301455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-297f23eb-cd57-4863-b070-f6e6c5ebbabd tempest-AbsoluteLimitsTestJSON-336225893 tempest-AbsoluteLimitsTestJSON-336225893-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.495930 Oct 04 20:50:22.302448 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1277/2535] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 4 20:50:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:22.312631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:22.315182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:22.334237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.341399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.341399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:22.342993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.346774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.350323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:22.684213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:22.712503 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd838d92-a310-48a9-a4ed-d5fac09dce2a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1614 microversion: 2.1 time: 0.407680 Oct 04 20:50:22.713858 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1278/2536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:22 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1614 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:22.725120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:22.726997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:22.742033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.744636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.744924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:22.747482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:22.748464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:22.749254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.032153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:23.049779 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b876c6ee-a3f9-4f1d-8de5-aca105a235ce tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1266 microversion: 2.1 time: 0.333324 Oct 04 20:50:23.071098 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1279/2537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:22 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:23.071098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:23.071098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Failed to fetch instance by id -1 {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:50:23.073337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance -1 could not be found. Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '-1'} Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:23.085918 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:23.093623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:23.093623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:23.093623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 20:50:23.093623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:23.095610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance -1 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:23.097728 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8027cbcb-52ff-4c26-afb7-65a317f302e3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.042673 Oct 04 20:50:23.105643 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1280/2538] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:50:23 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:50:23.129197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:23.129197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.167170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.400363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:23.402211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:23.403190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:23.403970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:23.404731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:23.471849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.472748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.473586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.475104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.475992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.476793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.517694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:23.529814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Getting quotas for user 9aa22e4620dc4028b22512a283c561cd and project 8ea8b8d405e24994a0cac2296982a738. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:23.556573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:23.562515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:23.834535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1fa5894-fdf8-4169-bc37-361cfe76fb38 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400963 Oct 04 20:50:23.864759 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1259/2539] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:23.909010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:23.912802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:23.953885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.956477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.958368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.960246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.963723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.965388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.315730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:24.354034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:24.361769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:24.364484 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9fdf269-f995-40f6-b284-27814ffab79e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1550 microversion: 2.21 time: 1.256337 Oct 04 20:50:24.397646 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1281/2540] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:23 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1550 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:24.420912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18e87eb-0ab1-48b1-86d6-51209424af84", "name": "network-vif-deleted", "tag": "fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:24.442816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.445354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.448475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.520967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] Creating event network-vif-deleted:fc7ee8f2-89de-4ea9-b4a8-f7dbf2560bd5 for instance e18e87eb-0ab1-48b1-86d6-51209424af84 on n-h1-851029-13 Oct 04 20:50:24.546700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-384e0edb-1f44-4aa2-885a-ad8ef99cae77 req-5bf8b884-4316-46fc-965a-aa5a371706ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144439 Oct 04 20:50:24.552540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1282/2541] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:24.583309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:24.583309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:24.613630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.620126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.621022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.622307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.624200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.624200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.760018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.761893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.764438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.765636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lazy-loading 'fault' on Instance uuid e18e87eb-0ab1-48b1-86d6-51209424af84 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:24.959104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22537f1c2f9f44febcd351c5a1c065f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585040147d924bc781b6ff3b75c70714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.000668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bc50fed-317c-4bb8-b221-997f000f3313 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 200 len: 1331 microversion: 2.1 time: 0.441683 Oct 04 20:50:25.002180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1283/2542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:24 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 1331 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:25.012698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca27ed8d-b66f-467b-a40c-6b2a1f6b9e7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:25.013713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca27ed8d-b66f-467b-a40c-6b2a1f6b9e7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:25.055654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.096494 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c57730d4-049f-4503-849a-58249788b644 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.221591 Oct 04 20:50:25.097691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1260/2543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:23 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:25.133411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:25.135727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:25.158322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.159900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.160640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.162571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.164649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.165596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.347353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca27ed8d-b66f-467b-a40c-6b2a1f6b9e7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.381335 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca27ed8d-b66f-467b-a40c-6b2a1f6b9e7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1214 microversion: 2.1 time: 0.377140 Oct 04 20:50:25.397171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1284/2544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:25 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:25.401055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:25.402561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:25.433686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.435424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.439896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.441732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.447032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.448687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.552401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:25.947271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.979452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7dacd23e-84b7-4f72-9367-b9b7771d1dac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 0.871599 Oct 04 20:50:25.983237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1261/2545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:25 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:26.005026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:26.006599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:26.021213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.023753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.024796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.026498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.027674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.028730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.368203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-daadc94a-1b42-4d1f-96fe-0d895eef56e7 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 204 len: 0 microversion: 2.21 time: 0.982553 Oct 04 20:50:26.371783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1285/2546] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:50:25 2022] DELETE /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 0 bytes in 988 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:50:26.403490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:26.405978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:26.433147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.437085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.441192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.444421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.447388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.450099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.527925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] HTTP exception thrown: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Request method failure captured: Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 HTTP/1.1 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtLJrtv-fRD8RWI1aR19oHFLWbY8aJbUyizRJPGS2cc8jkNWbmfGIGZsOrtN5XW9xePDTT6vWNs4cex4ZAcjusiAAxNq802EAcjC8MXB068w2aCCnyybvlX7-Yt75Pb3rV1aGQro395-a2R8PSSSlNeAFCro5vJOe0N7N7FZHpzPA0 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/585040147d924bc781b6ff3b75c70714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_585040147d924bc781b6ff3b75c70714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 22537f1c2f9f44febcd351c5a1c065f4 Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e18e87eb-0ab1-48b1-86d6-51209424af84'} Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:26.531523 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.539699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Returning 404 to user: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:26.544283 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ac034bc-173e-4e6d-8259-4e1e7326e64a tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 404 len: 111 microversion: 2.1 time: 0.165994 Oct 04 20:50:26.548062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1286/2547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:26 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:26.584001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:26.591139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:26.609888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.611891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.613134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.617303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.618859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.624952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.914598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:26.965566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f511d1a-8f9f-4359-8144-9dc460dc6779 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.979419 Oct 04 20:50:26.981872 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1262/2548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:25 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:27.023231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:27.025501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.051093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.051931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.052602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.053969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.055185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.055833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.325139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:27.345499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d5aaf771-a4a4-494b-8359-eecde13d7ce5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1218 microversion: 2.1 time: 0.350446 Oct 04 20:50:27.359881 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1263/2549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:26 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1218 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:27.359881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86e700d3-ce3a-48c8-8881-128eba3588fe tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '.version_select at 0x7f54fa640430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:27.499375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:27.499375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:27.499375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:27.499375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b58bda90-37bb-4711-9a1b-dd521929676e tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1556 microversion: 2.21 time: 0.931435 Oct 04 20:50:27.499375 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1287/2550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:26 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1556 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:27.500727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:27.501704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: ce05cba0-0dc6-4a32-9231-a1472e51c1c4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.512807 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/ce05cba0-0dc6-4a32-9231-a1472e51c1c4/action HTTP/1.1 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 19 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: {"forceDelete": {}} Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ce05cba0-0dc6-4a32-9231-a1472e51c1c4', 'body': {'forceDelete': {}}} Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:27.522053 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance ce05cba0-0dc6-4a32-9231-a1472e51c1c4 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:27.534951 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45e2c1ca-7956-4b4a-be5e-65b91ff492ab tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/ce05cba0-0dc6-4a32-9231-a1472e51c1c4/action" status: 404 len: 111 microversion: 2.1 time: 0.042691 Oct 04 20:50:27.539637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1288/2551] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:27 2022] POST /compute/v2.1/servers/ce05cba0-0dc6-4a32-9231-a1472e51c1c4/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:27.547948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:27.549563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.564025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.564949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.565942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.567340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.568226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.569244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.618527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:28.066097 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86e700d3-ce3a-48c8-8881-128eba3588fe tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102780507" status: 202 len: 0 microversion: 2.1 time: 0.714569 Oct 04 20:50:28.066097 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1264/2552] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102780507 => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:28.146714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:28.167272 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-143528f4-d34f-4239-8145-bc55557b2191 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 0.627215 Oct 04 20:50:28.196407 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1289/2553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:27 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:28.214147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:28.216212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:28.235769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:28.237317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:28.238163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:28.239868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:28.242622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:28.246991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:28.861097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef00ab30-2b6a-4001-beb7-76ae3419c947 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f6270a60>, body: {"keypair": {"name": "tempest-keypair-1620361465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTdqs6axDzXIGtGKVCLOSD5V8lz+xRJp1/j4ENyS5OaRloO326DnAuyKpLkE1jMs9MOwbSCJHN7QeVuVTL1CKnhT1viKwOvL2hjzrLYX/FTOCTZUBwwS3dDDADok2VEWg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:28.893632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ef00ab30-2b6a-4001-beb7-76ae3419c947 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:28.908211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ef00ab30-2b6a-4001-beb7-76ae3419c947 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:29.059555 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef00ab30-2b6a-4001-beb7-76ae3419c947 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.991992 Oct 04 20:50:29.061530 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1265/2554] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 995 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:29.071634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:29.073272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:29.086907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.088453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.089923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:29.091474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.092488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.093369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:29.462907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:29.476623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b5c99e6-2741-4345-bb4d-82c09e575675 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1266 microversion: 2.1 time: 0.412338 Oct 04 20:50:29.495892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1266/2555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:29 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1266 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:29.515701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:29.517011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:29.536453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.537627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.538778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:29.541004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.543054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.552181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:29.552181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:30.251205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:30.268330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76761399-57c9-429b-bc2d-a215eef461d8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.069470 Oct 04 20:50:30.283296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1290/2556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:28 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:30.321561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a503a1bf-1653-42d1-9fa2-5554b4fd8e6e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5e210d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:30.337534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:30.340928 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a503a1bf-1653-42d1-9fa2-5554b4fd8e6e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1620361465" status: 200 len: 513 microversion: 2.2 time: 0.055531 Oct 04 20:50:30.342062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1291/2557] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 4 20:50:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1620361465 => generated 513 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:30.371590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:30.372852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:30.387395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:30.388772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:30.389752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:30.392476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:30.393864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:30.394951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:30.828749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:30.848005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:30.852151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:30.854831 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf5378ec-2db0-4659-9c1a-318f2cff669c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1556 microversion: 2.21 time: 1.356351 Oct 04 20:50:30.856632 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1267/2558] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:29 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1556 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:30.867141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:30.868877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:30.888921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:30.888921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:30.890655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:30.893003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:30.893847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:30.894738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:31.719332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:31.741232 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75d376e9-c417-486e-9248-509d15eccef3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 1.391445 Oct 04 20:50:31.757837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1292/2559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:30 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:31.780265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72ed100b-2900-4254-a682-1132964c1f43 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f601fdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:31.936702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72ed100b-2900-4254-a682-1132964c1f43 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620361465" status: 204 len: 0 microversion: 2.2 time: 0.153157 Oct 04 20:50:31.936702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1293/2560] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Oct 4 20:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620361465 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:31.947910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:31.960547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:31.981439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:31.982836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:31.983999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:31.985642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:31.986861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:31.987986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:32.116838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:32.161341 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60d6ca26-cd49-4ced-bfc3-3a23119ef1b1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.296480 Oct 04 20:50:32.164142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1268/2561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:30 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:32.185521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:32.192805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:32.220898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:32.222411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:32.223270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:32.224666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:32.225548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:32.226365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:32.272759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:32.935713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:32.959270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:32.976561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:32.984434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab3f5cad-11f9-4306-8e18-7899cabb2655 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1514 microversion: 2.21 time: 0.815021 Oct 04 20:50:33.017494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1269/2562] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:32 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1514 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:33.048613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ec3a701-4b06-410c-93d8-311f32b0a50d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f6012790>, body: {"keypair": {"name": "tempest-keypair-72003391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiz/UqTnbknIZcUEbFV8BOhm6ooZBQHH5ma117b8qaKDX10SXRLSuBEujYDvchgNsxN5hNL6VB3/rSx1hjqqs4LTCZ4VZL7l5XTu2garwcqBC4mGRkQjwHi+09rivR9Jw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:33.146308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0ec3a701-4b06-410c-93d8-311f32b0a50d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:33.181644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0ec3a701-4b06-410c-93d8-311f32b0a50d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:33.344520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:33.365359 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-623fd52f-d5c9-441b-aef9-afa1c3e836b7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 1.423986 Oct 04 20:50:33.390883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ec3a701-4b06-410c-93d8-311f32b0a50d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.359358 Oct 04 20:50:33.391142 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1294/2563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:31 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:33.407155 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1270/2564] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 389 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:33.412603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:33.418544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 63bdf2da-3f2f-4527-822b-4f774c571753] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:33.438260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:33.442589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. Oct 04 20:50:33.446648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/63bdf2da-3f2f-4527-822b-4f774c571753/action HTTP/1.1 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 39 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: {"os-getConsoleOutput": {"length": 10}} Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '63bdf2da-3f2f-4527-822b-4f774c571753', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:33.455786 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 63bdf2da-3f2f-4527-822b-4f774c571753 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c6102316-7d9a-4dc4-bb7f-744d4c340d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/63bdf2da-3f2f-4527-822b-4f774c571753/action" status: 404 len: 111 microversion: 2.1 time: 0.057057 Oct 04 20:50:33.470704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1295/2565] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:33 2022] POST /compute/v2.1/servers/63bdf2da-3f2f-4527-822b-4f774c571753/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:33.481818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a52fd52-0e35-4524-b566-14f5d58ca116", "tag": "2f012665-e616-4189-bf19-689c4707736e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:33.497714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.499188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.500062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:33.501987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.508954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.508954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:33.509325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.509481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:33.509655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.509655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:33.556228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] Creating event network-changed:2f012665-e616-4189-bf19-689c4707736e for instance 1a52fd52-0e35-4524-b566-14f5d58ca116 on n-h1-851029-13 Oct 04 20:50:33.570618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e2c8b025-0570-48a7-816d-d7eb8528abd5 req-4743bf86-413e-45ef-91b7-e4efc0148efd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096532 Oct 04 20:50:33.575005 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1296/2566] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:33.594026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1baf6ccd-6e82-45a5-be8b-1e5f962a89a2 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5ddfd30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:33.828961 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1baf6ccd-6e82-45a5-be8b-1e5f962a89a2 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-72003391" status: 204 len: 0 microversion: 2.2 time: 0.241037 Oct 04 20:50:33.848904 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1297/2567] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Oct 4 20:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-72003391 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:33.871010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:33.872802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:33.912491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.912491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.912491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:33.925671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.926760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.927680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.011122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:35.040916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e6c916b-b834-4bed-84f8-daafac8c4ec6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.189540 Oct 04 20:50:35.043728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1298/2568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:33 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:35.052920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97795f7b-16d5-4c55-8a03-eab10f2ddc57 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f639e310>, body: {"keypair": {"name": "tempest-keypair-1948673498", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:35.113396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-97795f7b-16d5-4c55-8a03-eab10f2ddc57 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:35.132744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:35.152872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-97795f7b-16d5-4c55-8a03-eab10f2ddc57 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:35.196521 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d971d89-e533-48e3-ac89-33a86050086a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 1.785197 Oct 04 20:50:35.200134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1271/2569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:33 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:35.210785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.213183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.235456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.238371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.240134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.242495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.243853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.245055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.362761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97795f7b-16d5-4c55-8a03-eab10f2ddc57 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.316869 Oct 04 20:50:35.374595 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1299/2570] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:35 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 319 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:35.381386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.382513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.412573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.413595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.432444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.436141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.437030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.440591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.441439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.442717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lazy-loading 'fault' on Instance uuid c36bb30e-b051-48ed-8fb1-bdccaa152f6a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:35.457034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.462166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.420779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:36.439695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:36.454159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06b57e40f2d0405698bb171cd86c293e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef4c510d93645338b6a377dcea40fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:36.456401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db3854c8-26c3-4402-a26a-5c09f066688c tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 200 len: 1348 microversion: 2.21 time: 1.255497 Oct 04 20:50:36.466149 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1272/2571] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:35 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 1348 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:36.486498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1415286-bc50-4e97-bd46-46991817af7a", "tag": "cc614f5e-fde6-4ee6-8987-6b66df0ca11c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:36.515601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:36.517049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:36.518210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.542932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] Creating event network-changed:cc614f5e-fde6-4ee6-8987-6b66df0ca11c for instance b1415286-bc50-4e97-bd46-46991817af7a on n-h2-851029-13 Oct 04 20:50:36.553474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-deeea3b4-1622-4bb6-bf3e-7b7ecfba3d1c req-80dfecfb-69b6-4ebb-b44b-01ca6253b0fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084300 Oct 04 20:50:36.555490 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1273/2572] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:36.573123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:36.575228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:36.579343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:36.595486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:36.596890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:36.598744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.600468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:36.601586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:36.602893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.992742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:37.083875 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-314d8e12-06e6-4c40-9361-a19006516774 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 1.703548 Oct 04 20:50:37.083875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1300/2573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:35 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:37.099737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a3120afe-234a-41ba-b318-c799d2a4af2e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f61e6790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:37.263709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a3120afe-234a-41ba-b318-c799d2a4af2e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948673498" status: 204 len: 0 microversion: 2.2 time: 0.187572 Oct 04 20:50:37.264525 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1301/2574] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Oct 4 20:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948673498 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:37.305874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:37.319302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:37.352284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:37.361176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.363460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.364949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.371612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.375585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.378596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.380874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad44b7c1-fcc4-48b7-bb9f-c3da8d7824cb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.822739 Oct 04 20:50:37.391278 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1274/2575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:36 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:37.445800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36bb30e-b051-48ed-8fb1-bdccaa152f6a", "name": "network-vif-deleted", "tag": "9f0c5475-e4a0-49e2-9aec-a2325785d9f0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:37.502217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.504025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.505910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.604477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] Creating event network-vif-deleted:9f0c5475-e4a0-49e2-9aec-a2325785d9f0 for instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a on n-h1-851029-13 Oct 04 20:50:37.621703 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3100d446-0188-4e79-8ef6-3ae454c03405 req-1b700881-57db-42a6-bd38-e601d9b2a652 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226957 Oct 04 20:50:37.627268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1275/2576] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:37.651009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b287a267-629c-474c-bf55-c36226faf2fe tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f61e2f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-819573109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2FFoygfbLhtNnseHPrsB/CFSirfiwjh9H4aoLNhj+b1hIqsxUMysIm8VKyPlUN/HzC9k6f8FpgQ9xtbVPIoW5phW00xiLaWjx0WMGi0v4vyGkIxWg4mM3vQj4Cwj7x9Q=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:37.725777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b287a267-629c-474c-bf55-c36226faf2fe tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:37.741400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b287a267-629c-474c-bf55-c36226faf2fe tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:38.030213 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b287a267-629c-474c-bf55-c36226faf2fe tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.399167 Oct 04 20:50:38.032434 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1276/2577] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:37 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 404 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:38.061218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.066444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: d887c10a-81ec-4952-9c8d-e2dfedc6a3b5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.080806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 HTTP/1.1 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd887c10a-81ec-4952-9c8d-e2dfedc6a3b5'} Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.086514 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:38.094776 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:38.094776 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:38.094776 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:38.094776 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. Oct 04 20:50:38.094776 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.100452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:38.102729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b95cdb20-a761-4aec-ba56-1b9cffbcb9e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/d887c10a-81ec-4952-9c8d-e2dfedc6a3b5" status: 404 len: 111 microversion: 2.1 time: 0.067398 Oct 04 20:50:38.106638 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1277/2578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/d887c10a-81ec-4952-9c8d-e2dfedc6a3b5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:38.137495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.138914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.155272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:38.166431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.168530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.170037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.173422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.174560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.176355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.196075 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-210cf294-9cac-4da1-b543-8ced186ef8db tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 0.928319 Oct 04 20:50:38.203784 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1302/2579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:37 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.219258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03e6220a-1772-472f-ba11-bb18543edc7e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f63ae9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-571190059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED6UMZVtf1wFxW4qG6BrwdzgdHcGKz4b2ywTYcsExB3YddSoOTxydXdGJGMkzvqe2KsnVM24afgenRTpRE5vIHjVjpmSs3Nd3i8P7fULi5qd5J7wmA1l1GgoP3bATTovw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:38.243983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] HTTP exception thrown: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Request method failure captured: Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a HTTP/1.1 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJxWpAPR3UKW13v5RE2mT2FQuu1yuf9y5I3dyW0BAsLuogCs7M3_YZfrdgYeEE7e4v4w2rj09VIkbRRdldxdVPYG68Nya-7GrE0CxQ6OTQRTfWckR8Bw78aryh-Sc_PCoLhW-AzVEYBkw5GREtQTzvJbTktVNfzMzR64NOY52HqEylw Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 06b57e40f2d0405698bb171cd86c293e Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c36bb30e-b051-48ed-8fb1-bdccaa152f6a'} Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.250225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Returning 404 to user: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95a98e39-5ccd-4b6a-abba-fb022acd0d60 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 404 len: 111 microversion: 2.21 time: 0.148845 Oct 04 20:50:38.270930 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1278/2580] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:38.279023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.280687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.297937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.299264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.306576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.306576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.306576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.307141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-03e6220a-1772-472f-ba11-bb18543edc7e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:38.308871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.333888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-03e6220a-1772-472f-ba11-bb18543edc7e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:38.580892 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03e6220a-1772-472f-ba11-bb18543edc7e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.374787 Oct 04 20:50:38.582580 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1303/2581] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:38 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 378 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:38.603959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.607749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.645662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.651545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.653027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.654890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.659475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.660982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.794240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:38.830874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f71679cd-e1c6-459e-85bf-dcf9ae6da8b2 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.569794 Oct 04 20:50:38.832920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1279/2582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.861305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '.version_select at 0x7f54fa640820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.862716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.897846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.901011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.902773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.906118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.907731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.908871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.078277 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43394579-1636-43f5-8456-d55aa6ed36ee tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.243367 Oct 04 20:50:39.080203 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1280/2583] 10.222.0.36 () {60 vars in 1337 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a/os-instance-actions => generated 611 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:50:39.090079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-403fdc0d-7f16-4f51-982f-0d84ac9603f3 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f5dc8e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1785799185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcFkmznlpbY15YokQ5jWYUoIsqzfX8MtiaGx0Shja2YrvhM6LfQrG6dApaXE1XC7yA5Xi5tUK9z5WG+V580jnhpJ6Vh3wMNg4sxZU293f0UDdPTkSHiV8wsk1QR/Z17qw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:39.124150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-403fdc0d-7f16-4f51-982f-0d84ac9603f3 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:39.140843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-403fdc0d-7f16-4f51-982f-0d84ac9603f3 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:39.153833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:39.171135 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10c53108-9037-4f68-908c-1d75aa0d705e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 0.584573 Oct 04 20:50:39.181029 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1304/2584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:39.210404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:39.211601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:39.224125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.225693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.226956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.228589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.229889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.230704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.367525 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-403fdc0d-7f16-4f51-982f-0d84ac9603f3 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.284891 Oct 04 20:50:39.369693 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1281/2585] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:39.402465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:39.404214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:39.436770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.439934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.441507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.443509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.444844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.446070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.491502 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] HTTP exception thrown: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Request method failure captured: Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a HTTP/1.1 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJxWpAPR3UKW13v5RE2mT2FQuu1yuf9y5I3dyW0BAsLuogCs7M3_YZfrdgYeEE7e4v4w2rj09VIkbRRdldxdVPYG68Nya-7GrE0CxQ6OTQRTfWckR8Bw78aryh-Sc_PCoLhW-AzVEYBkw5GREtQTzvJbTktVNfzMzR64NOY52HqEylw Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 06b57e40f2d0405698bb171cd86c293e Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c36bb30e-b051-48ed-8fb1-bdccaa152f6a'} Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:39.506277 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:39.515635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Returning 404 to user: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:39.524340 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c3474d5-5781-44c4-b9aa-a46136908055 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 404 len: 111 microversion: 2.21 time: 0.152019 Oct 04 20:50:39.526063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1282/2586] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:50:39 2022] DELETE /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:39.541088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:39.543092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:39.556146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.562299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.562299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.562299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.562997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.563532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.178240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:41.208888 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb58087e-f5b8-40af-8d98-ddb557748a92 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 1.675305 Oct 04 20:50:41.231671 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1283/2587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:39 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:41.276228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abfd3d66-ef59-40c3-af9f-b3459260f9c0 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f6411d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.294855 n-d-851029-13 devstack@n-api.service[123542]: WARNING oslo_db.sqlalchemy.utils [None req-abfd3d66-ef59-40c3-af9f-b3459260f9c0 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:50:41.334841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abfd3d66-ef59-40c3-af9f-b3459260f9c0 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.101068 Oct 04 20:50:41.340652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1284/2588] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 4 20:50:41 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:41.365283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.367091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] [instance: c36bb30e-b051-48ed-8fb1-bdccaa152f6a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:41.392631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.393549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.394349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.395670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.396548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.397217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.442971 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] HTTP exception thrown: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Request method failure captured: Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a HTTP/1.1 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJxWpAPR3UKW13v5RE2mT2FQuu1yuf9y5I3dyW0BAsLuogCs7M3_YZfrdgYeEE7e4v4w2rj09VIkbRRdldxdVPYG68Nya-7GrE0CxQ6OTQRTfWckR8Bw78aryh-Sc_PCoLhW-AzVEYBkw5GREtQTzvJbTktVNfzMzR64NOY52HqEylw Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ef4c510d93645338b6a377dcea40fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5ef4c510d93645338b6a377dcea40fb8 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1283564374 Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 06b57e40f2d0405698bb171cd86c293e Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceActionsV221TestJSON-1283564374-project Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c36bb30e-b051-48ed-8fb1-bdccaa152f6a'} Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.446041 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] Returning 404 to user: Instance c36bb30e-b051-48ed-8fb1-bdccaa152f6a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:41.454358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c82d631-7bbc-4a16-a47c-fa9bd8941c29 tempest-InstanceActionsV221TestJSON-1283564374 tempest-InstanceActionsV221TestJSON-1283564374-project] 10.222.0.36 "GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a" status: 404 len: 111 microversion: 2.21 time: 0.107897 Oct 04 20:50:41.458794 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1285/2589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:41 2022] GET /compute/v2.1/servers/c36bb30e-b051-48ed-8fb1-bdccaa152f6a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:41.478891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.478891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:41.502072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:41.503590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.504688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.525024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.525024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.528035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.533446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.541895 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e09f54ad-9785-4c5d-971b-c22263dbfd8c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.346100 Oct 04 20:50:41.544665 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1305/2590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:41.588566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32c4db3d-47ca-435b-95f0-adacaadc3a07 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f61a1700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.744866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32c4db3d-47ca-435b-95f0-adacaadc3a07 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1785799185" status: 204 len: 0 microversion: 2.2 time: 0.194801 Oct 04 20:50:41.745967 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1306/2591] 10.222.0.36 () {60 vars in 1321 bytes} [Tue Oct 4 20:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1785799185 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:41.778395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-219f61af-02e8-427e-b7e2-497f92fd5b49 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5f20940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.947468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-219f61af-02e8-427e-b7e2-497f92fd5b49 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-571190059" status: 204 len: 0 microversion: 2.2 time: 0.193841 Oct 04 20:50:41.949507 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1307/2592] 10.222.0.36 () {60 vars in 1318 bytes} [Tue Oct 4 20:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-571190059 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:50:41.972244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5685639-4e3c-47a0-8c14-b06f6bd90ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1515501800", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5685639-4e3c-47a0-8c14-b06f6bd90ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 238 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1515501800", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1515501800', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.020264 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5685639-4e3c-47a0-8c14-b06f6bd90ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5685639-4e3c-47a0-8c14-b06f6bd90ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.061243 Oct 04 20:50:42.031033 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1308/2593] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:42.039388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-630cef69-9219-487a-a30a-46dc57d04e09 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5fe3dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:42.206922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-630cef69-9219-487a-a30a-46dc57d04e09 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-819573109" status: 204 len: 0 microversion: 2.2 time: 0.189743 Oct 04 20:50:42.220021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1309/2594] 10.222.0.36 () {60 vars in 1318 bytes} [Tue Oct 4 20:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-819573109 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:42.239135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:42.240856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:42.266876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.268880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.269798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.271514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.278269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.279332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.846198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:42.875290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3df0b17-a80a-467c-a3b7-01183ef4e5e1 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 1.416621 Oct 04 20:50:42.876440 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1286/2595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:41 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:42.904752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef8d30ca-0b91-4679-8885-623557bcb01e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f6211ee0>, body: {"keypair": {"name": "tempest-keypair-462892925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHScV8chE8kmAnnXBLSELCEfwd8U7VomvGLF1ETo8070C/8uFjLANOY+YSyFosfeb0gI2HyuruJsBVHk2HlfiObuMA0Tg1tWD4GqfUTt/S2R7tAcgNe/g4g1nsl5PjKuzQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:42.939341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ef8d30ca-0b91-4679-8885-623557bcb01e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:42.955549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ef8d30ca-0b91-4679-8885-623557bcb01e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:43.228753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef8d30ca-0b91-4679-8885-623557bcb01e tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.342235 Oct 04 20:50:43.233549 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1287/2596] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 4 20:50:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 357 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:50:43.265924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:43.270141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:43.317713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.320959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.321964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.327426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.331657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.332816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.379369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:43.435128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c44e33c0-af2e-4b79-8171-e18a7f112dd0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.200909 Oct 04 20:50:43.435128 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1310/2597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:42 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:43.436140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da464d64-85db-4ae1-b694-0d19d03d6c0b tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5fbd430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:43.482819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da464d64-85db-4ae1-b694-0d19d03d6c0b tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-462892925" status: 200 len: 512 microversion: 2.2 time: 0.056274 Oct 04 20:50:43.486003 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1311/2598] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Oct 4 20:50:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-462892925 => generated 512 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:43.505264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:43.506347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:43.522300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.523720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.524740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.527128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.528934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.529783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.276558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:44.297349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68c4bff4-0aa7-4fad-b563-cfec572855b0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 1.058300 Oct 04 20:50:44.299380 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1288/2599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:43 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:44.309552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6347e8db-9602-4e85-bbf1-c4dc04496e63 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f6211dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:44.317614 n-d-851029-13 devstack@n-api.service[123542]: WARNING oslo_db.sqlalchemy.utils [None req-6347e8db-9602-4e85-bbf1-c4dc04496e63 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:50:44.342879 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6347e8db-9602-4e85-bbf1-c4dc04496e63 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.041061 Oct 04 20:50:44.355536 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1289/2600] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 4 20:50:44 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:44.368057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:44.369643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:44.396106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.408119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.409358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.411453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.412722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.413844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.442150 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] HTTP exception thrown: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Request method failure captured: Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 HTTP/1.1 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtLJrtv-fRD8RWI1aR19oHFLWbY8aJbUyizRJPGS2cc8jkNWbmfGIGZsOrtN5XW9xePDTT6vWNs4cex4ZAcjusiAAxNq802EAcjC8MXB068w2aCCnyybvlX7-Yt75Pb3rV1aGQro395-a2R8PSSSlNeAFCro5vJOe0N7N7FZHpzPA0 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/585040147d924bc781b6ff3b75c70714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_585040147d924bc781b6ff3b75c70714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 22537f1c2f9f44febcd351c5a1c065f4 Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e18e87eb-0ab1-48b1-86d6-51209424af84'} Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:44.444620 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Returning 404 to user: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b12b55d5-b40f-49a0-98e3-5cbbaba2be58 tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 404 len: 111 microversion: 2.1 time: 0.092097 Oct 04 20:50:44.454157 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1290/2601] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:44 2022] DELETE /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:44.462272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:44.462272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:44.478945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.480563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.481383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.483434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.484391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.485272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.185699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:45.221067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-172643ec-56e3-4cad-85cc-f3193d393985 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.732604 Oct 04 20:50:45.222180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1312/2602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:43 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:45.277600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74dbf9d7-1eac-4af0-8d4e-82d9222ef235 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f5f2f1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:45.463575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74dbf9d7-1eac-4af0-8d4e-82d9222ef235 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462892925" status: 204 len: 0 microversion: 2.2 time: 0.213665 Oct 04 20:50:45.463575 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1313/2603] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 4 20:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462892925 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:45.489228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:45.503808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] [instance: e18e87eb-0ab1-48b1-86d6-51209424af84] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:45.533195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.535123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.536619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.538725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.539717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.540585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.592305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] HTTP exception thrown: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Request method failure captured: Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 HTTP/1.1 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtLJrtv-fRD8RWI1aR19oHFLWbY8aJbUyizRJPGS2cc8jkNWbmfGIGZsOrtN5XW9xePDTT6vWNs4cex4ZAcjusiAAxNq802EAcjC8MXB068w2aCCnyybvlX7-Yt75Pb3rV1aGQro395-a2R8PSSSlNeAFCro5vJOe0N7N7FZHpzPA0 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/585040147d924bc781b6ff3b75c70714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/585040147d924bc781b6ff3b75c70714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_585040147d924bc781b6ff3b75c70714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 585040147d924bc781b6ff3b75c70714 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2065959957 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 22537f1c2f9f44febcd351c5a1c065f4 Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2065959957-project Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e18e87eb-0ab1-48b1-86d6-51209424af84'} Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:45.599101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] Returning 404 to user: Instance e18e87eb-0ab1-48b1-86d6-51209424af84 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:45.607240 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd960e9f-99f3-4d42-9190-17153cdc762d tempest-AttachSCSIVolumeTestJSON-2065959957 tempest-AttachSCSIVolumeTestJSON-2065959957-project] 10.222.0.36 "GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84" status: 404 len: 111 microversion: 2.1 time: 0.140625 Oct 04 20:50:45.614371 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1314/2604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:45 2022] GET /compute/v2.1/servers/e18e87eb-0ab1-48b1-86d6-51209424af84 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:45.627332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a52fd52-0e35-4524-b566-14f5d58ca116", "name": "network-vif-plugged", "status": "completed", "tag": "2f012665-e616-4189-bf19-689c4707736e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:45.656063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:45.680693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.681533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.682461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.695976 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-600359a7-9a8d-4733-8d21-2a6514eba416 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 1.241563 Oct 04 20:50:45.698182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1291/2605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:44 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:45.712587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:45.714504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:45.733886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.735779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.735987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.738025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.739673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.740447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.745832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] Creating event network-vif-plugged:2f012665-e616-4189-bf19-689c4707736e for instance 1a52fd52-0e35-4524-b566-14f5d58ca116 on n-h1-851029-13 Oct 04 20:50:45.755403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-62507800-c21d-41d2-bf3c-4ec2333a4eac req-f02529c6-5a81-448d-9a31-d0eba2b9c011 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138292 Oct 04 20:50:45.768125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1315/2606] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:45.789311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b530cf0-9b2e-4f9d-9051-a6cc98de0d08 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359145506", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b530cf0-9b2e-4f9d-9051-a6cc98de0d08 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 235 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359145506", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1359145506', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.807201 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b530cf0-9b2e-4f9d-9051-a6cc98de0d08 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:45.820508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b530cf0-9b2e-4f9d-9051-a6cc98de0d08 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.040816 Oct 04 20:50:45.828516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1316/2607] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:45 2022] POST /compute/v2.1/servers => generated 133 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:45.849579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Action: 'create', calling method: .version_select at 0x7f54f625c4c0>, body: {"keypair": {"name": "tempest-keypair-522150105", "type": "x509"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:45.924307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:45.957860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:46.018335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.processutils [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpkgmvbvp2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpkgmvbvp2/temp.key -subj /CN=21c1a745fec04e3ab6d3e69083c61b1a -extensions v3_req_client {{(pid=123541) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:50:46.488929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:46.534566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6301b7b-eee4-43a4-a3a7-c0ba132ef9d1 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 0.831147 Oct 04 20:50:46.541412 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1292/2608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:45 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:46.575161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:46.584462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:46.620534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:46.621438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:46.630639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:46.632193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:46.633091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:46.633914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:46.900372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.processutils [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpkgmvbvp2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpkgmvbvp2/temp.key -subj /CN=21c1a745fec04e3ab6d3e69083c61b1a -extensions v3_req_client" returned: 0 in 0.880s {{(pid=123541) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:50:46.908785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.processutils [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpkgmvbvp2/temp.key -password pass: {{(pid=123541) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:50:46.999626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.processutils [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpkgmvbvp2/temp.key -password pass:" returned: 0 in 0.088s {{(pid=123541) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:50:47.201959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:47.219053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Getting quotas for user 21c1a745fec04e3ab6d3e69083c61b1a and project dc028b59446b474b824529b63ff82b4a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:47.225946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:47.258956 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e52a07d3-7f9f-4d21-94b8-f7c38adf7200 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.428166 Oct 04 20:50:47.262297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1317/2609] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Oct 4 20:50:45 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1433 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:47.279189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:47.284956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:47.298417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.300414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.301766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.305050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.309377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.310574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.371174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:47.393984 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa76403a-66aa-4672-a11a-de1dfcf8843c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.844224 Oct 04 20:50:47.394945 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1293/2610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:46 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:47.442184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05a08cd0-9f46-42dc-9754-55ce7dbc7f8d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54fa55a940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:47.462289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05a08cd0-9f46-42dc-9754-55ce7dbc7f8d tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-522150105" status: 200 len: 1533 microversion: 2.2 time: 0.040597 Oct 04 20:50:47.476600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1294/2611] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Oct 4 20:50:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-522150105 => generated 1533 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:47.488793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:47.490503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:47.514851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.517122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.518512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.520304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.521520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.522603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.568113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:48.143005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:48.161939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:48.184855 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4711a4aa-3b6d-4ac2-a0ef-36a18e018e5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.695739 Oct 04 20:50:48.198762 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1295/2612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:47 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:48.198762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d285859-8157-4ce8-be7f-03dbb2e42aea tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54fa4f1820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.211372 n-d-851029-13 devstack@n-api.service[123542]: WARNING oslo_db.sqlalchemy.utils [None req-1d285859-8157-4ce8-be7f-03dbb2e42aea tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:50:48.228953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d285859-8157-4ce8-be7f-03dbb2e42aea tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.040368 Oct 04 20:50:48.236686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db1febad-9e03-438e-a0c9-5af92ccadcde tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 0.969775 Oct 04 20:50:48.245915 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1296/2613] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 4 20:50:48 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:48.255555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.257137 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1318/2614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:47 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:48.264242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:48.292424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1415286-bc50-4e97-bd46-46991817af7a", "name": "network-vif-plugged", "status": "completed", "tag": "cc614f5e-fde6-4ee6-8987-6b66df0ca11c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:48.306434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.308649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.309430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.311014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.311847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.312770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.314536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.315499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.317535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.361308 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] Creating event network-vif-plugged:cc614f5e-fde6-4ee6-8987-6b66df0ca11c for instance b1415286-bc50-4e97-bd46-46991817af7a on n-h2-851029-13 Oct 04 20:50:48.378398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e16c4474-e22a-45a3-a017-7d3c895b74a3 req-059e6842-e0b0-40e8-b41d-b68aef6e5ce0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118185 Oct 04 20:50:48.393662 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1319/2615] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:48.426329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:48.427725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 7c2c4424-2766-4e92-96ce-c2a74c1119c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:48.439994 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/7c2c4424-2766-4e92-96ce-c2a74c1119c7/action HTTP/1.1 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 13 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: {"pause": {}} Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7c2c4424-2766-4e92-96ce-c2a74c1119c7', 'body': {'pause': {}}} Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:48.450869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 7c2c4424-2766-4e92-96ce-c2a74c1119c7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b66d950c-7e97-4ccd-9f60-c3e2c9686fcb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/7c2c4424-2766-4e92-96ce-c2a74c1119c7/action" status: 404 len: 111 microversion: 2.1 time: 0.054437 Oct 04 20:50:48.466441 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1320/2616] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:48 2022] POST /compute/v2.1/servers/7c2c4424-2766-4e92-96ce-c2a74c1119c7/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:48.485610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-651e074d-7bc3-4858-a14d-79c873594b02 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] Calling method '.version_select at 0x7f54f639eca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.646160 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-651e074d-7bc3-4858-a14d-79c873594b02 tempest-KeyPairsV22TestJSON-413977898 tempest-KeyPairsV22TestJSON-413977898-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522150105" status: 204 len: 0 microversion: 2.2 time: 0.184948 Oct 04 20:50:48.654597 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1321/2617] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 4 20:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522150105 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:48.667803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.674115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:48.709192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.713483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.715202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.719559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.721665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.725205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:49.610977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:49.630959 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c696510c-80d1-4ed9-87f9-4637ee688184 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1308 microversion: 2.1 time: 1.382747 Oct 04 20:50:49.632079 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1297/2618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:48 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1308 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:49.663097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:49.663291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:49.680972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.681847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.683569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:49.685328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.686485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.687560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:49.845483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:49.874624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-165b05b6-e402-4a6f-bfc2-f133f7e03b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.217700 Oct 04 20:50:49.895446 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1322/2619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:48 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:49.944206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:49.946045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:49.973375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.974231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.978620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:49.978620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.978620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.978620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.637297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:50.658475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ea7f6b78-2b4a-4110-b157-83baf7f09f6d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1314 microversion: 2.1 time: 1.009626 Oct 04 20:50:50.661357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1298/2620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:49 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:50.684000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:50.689524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:50.730409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.732498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.734076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.736673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.739203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.742932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.950912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:50.979249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99dc37f4-d9ab-4365-8ead-cba19dd27e6b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.048733 Oct 04 20:50:50.981524 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1323/2621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:49 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:51.030392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:51.030392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:51.091269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.091269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.091269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.092702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.094877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.096083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.472007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:51.617849 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f93908c-cf02-41fb-94cd-2d3632a2e454 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 0.576931 Oct 04 20:50:51.626900 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1324/2622] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:51 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:50:51.659289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:51.660865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:51.671575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:51.685842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.687168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.688790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.690343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.698529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.699559 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfff0de0-349e-403a-9998-db4986f68405 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1489 microversion: 2.1 time: 1.026411 Oct 04 20:50:51.700020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.700799 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1299/2623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:50 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1489 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:51.729224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:51.740383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:51.769103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.770002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.770863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.772210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.773103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.773906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:52.576333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:52.594610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:52.622488 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9204089-1915-4ee8-809d-7abc9bd3f817 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1464 microversion: 2.1 time: 0.917368 Oct 04 20:50:52.626726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06c9a90f-c439-4caf-b1ac-9a76c4f3ddca tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1508 microversion: 2.1 time: 0.996589 Oct 04 20:50:52.666734 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1325/2625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:51 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1508 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:52.671168 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1300/2625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:51 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1464 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:52.711438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:52.726052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:52.753560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:52.753560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:52.753560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:52.753560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:52.767289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:52.770324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:52.855214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lazy-loading 'flavor' on Instance uuid 1a52fd52-0e35-4524-b566-14f5d58ca116 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:52.986471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=26 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:53.314365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.328049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'deleted': False, 'project_id': '9879d4f4c11f4426b7ecdd979385bd60'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:53.351370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.366839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.368617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.376156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.376156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.376156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.489473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb179dc2-23b5-41ab-9cef-5c47e3dd3a05 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116/action" status: 202 len: 0 microversion: 2.1 time: 0.820255 Oct 04 20:50:53.492846 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1326/2626] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:52 2022] POST /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:53.510196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.529346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:53.533435 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e683dee-9f8a-4820-a465-06428cb79fbe tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.860542 Oct 04 20:50:53.545022 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1301/2627] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:50:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:53.561737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.579176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.580374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.581645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.582516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.583371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.610107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.625560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'deleted': False} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:53.636922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.638201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.641903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.644472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.645872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.647294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.965279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:50:54.073242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:54.095680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b0bd327-bd7d-4093-a4e6-3139affa8a9a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1497 microversion: 2.1 time: 0.594511 Oct 04 20:50:54.129311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1327/2628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:53 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1497 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:54.148863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:54.148863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:54.159147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.160232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.161256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.162860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.164618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.165720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.208560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.208560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.209432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.590714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:54.611717 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9d75869-ee7a-4483-9fe9-2312e7245da0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1488 microversion: 2.1 time: 0.480290 Oct 04 20:50:54.623972 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1328/2629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:54 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1488 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:54.670274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:54.674466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:54.701057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.704987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.707969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.709562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.711890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.715250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.841460 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'pause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state paused Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 13 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: {"pause": {}} Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'pause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state paused Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'pause': {}}} Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state paused Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:54.846722 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:54.854993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:54.854993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:54.854993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:54.854993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state paused Oct 04 20:50:54.854993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:50:54.859444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'pause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state paused {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:54.863524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fde9eceb-402a-4caf-a41e-b5d213d5e801 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 143 microversion: 2.1 time: 0.201068 Oct 04 20:50:54.871467 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1329/2630] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:54 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 143 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:50:54.886637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:54.890793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:54.900916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.901847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.902647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.909915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.909915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.909915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.118315 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ee4ab27-5529-49ad-b932-4382e6e2e8aa tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 8105 microversion: 2.1 time: 1.525636 Oct 04 20:50:55.120486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1302/2631] 10.222.0.36 () {58 vars in 1171 bytes} [Tue Oct 4 20:50:53 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 8105 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:55.185083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.186510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:55.206784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.207667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.208488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.210286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.211172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.211810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.331437 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c1b0373-fbfd-479d-b7a5-81199881c699 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 0.454397 Oct 04 20:50:55.341917 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1330/2632] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:54 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:55.355854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.370708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'deleted': False, 'project_id': '9879d4f4c11f4426b7ecdd979385bd60'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:55.389599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.391640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.393534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.396964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.398412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.399583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.505560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a76c8d2-c869-46a7-886e-f5f8b870bcda tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?tenant_id=8ea8b8d405e24994a0cac2296982a738" status: 200 len: 15 microversion: 2.1 time: 0.157225 Oct 04 20:50:55.510026 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1331/2633] 10.222.0.36 () {58 vars in 1231 bytes} [Tue Oct 4 20:50:55 2022] GET /compute/v2.1/servers/detail?tenant_id=8ea8b8d405e24994a0cac2296982a738 => generated 15 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:55.525934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.525934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:55.536884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:55.551198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.556578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.558119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.561584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.562891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.565463 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a08da7e-9fe2-4ded-912d-50456d435f79 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 200 len: 1480 microversion: 2.1 time: 0.417758 Oct 04 20:50:55.567058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1303/2634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:55 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 1480 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:55.569376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.577214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.598181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'tenant_id': '8ea8b8d405e24994a0cac2296982a738', 'deleted': False} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:55.609574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.610732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.611577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.612634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.613853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.614609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.673779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:50:55.802866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.804489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.805635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.977688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.012303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d785311-ec9a-45e8-8314-6a49bf19e5b5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1495 microversion: 2.1 time: 0.499367 Oct 04 20:50:56.018454 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1332/2635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:55 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1495 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:56.031199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1882437347"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:56.058168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.077657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.080785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.081731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.084198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.085292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.086455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.116691 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d312735-45d9-43c4-be26-17c7a4a735ca tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8ea8b8d405e24994a0cac2296982a738" status: 200 len: 4834 microversion: 2.1 time: 0.547370 Oct 04 20:50:56.117808 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1304/2636] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 20:50:55 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8ea8b8d405e24994a0cac2296982a738 => generated 4834 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:56.171126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.184920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'tenant_id': '9879d4f4c11f4426b7ecdd979385bd60', 'deleted': False} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:56.194993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.196608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.197440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.199114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.200020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.201120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.260322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:56.271660 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b79ff05f-babe-4a36-9533-d3c66af0e0a4 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9879d4f4c11f4426b7ecdd979385bd60" status: 200 len: 15 microversion: 2.1 time: 0.108602 Oct 04 20:50:56.285561 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1305/2637] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9879d4f4c11f4426b7ecdd979385bd60 => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:56.321219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-464d9047-1ba3-43de-a21a-d7f7b6371cd5 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.334435 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-464d9047-1ba3-43de-a21a-d7f7b6371cd5 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019138 Oct 04 20:50:56.351913 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1306/2638] 10.222.0.36 () {58 vars in 1189 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:56.381630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:56.398907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.420601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.421436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.422223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.423778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.426140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.427071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.952294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43dc68e6-e74b-40bf-ac0a-bd73dfb5bd02 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 0 microversion: 2.1 time: 0.577271 Oct 04 20:50:56.959250 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1307/2639] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:56 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:56.968099 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94114d21-c36a-4a81-a984-4ec6758a4b37 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116/action" status: 202 len: 0 microversion: 2.1 time: 0.938240 Oct 04 20:50:56.969251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.970655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1333/2640] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:56 2022] POST /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:50:56.998951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17b6b89d-255a-4021-b0a4-050aea0480c0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f614f310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.006491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:57.010705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8ea8b8d405e24994a0cac2296982a738'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:50:57.042861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.044305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.047533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.055787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.060013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.061285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.165078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17b6b89d-255a-4021-b0a4-050aea0480c0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.176343 Oct 04 20:50:57.172415 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1334/2641] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:57.237311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=20 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:57.456189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:50:57.645150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.653109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.661083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.662389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.668044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.670300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.673584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.690351 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4320e779-ad81-4b3a-8d9d-6b687ff081ea tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.728885 Oct 04 20:50:57.691873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1308/2642] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:57.710719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.716499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.746498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.747896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.749087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.751495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.758610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.758610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.769655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf7aeacc-5b67-4a0f-9e7b-be5bb6e2393e tempest-AZV2TestJSON-1751132030 tempest-AZV2TestJSON-1751132030-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.597130 Oct 04 20:50:57.784971 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1335/2643] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 4 20:50:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:57.797280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:57.809152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.817289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.818496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.819214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.820398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.821408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.822355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:58.557121 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5e88494-5d84-4a76-b14b-91689aceef60 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 0 microversion: 2.1 time: 0.769622 Oct 04 20:50:58.572294 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1336/2644] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:57 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:58.614389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd404e7e-0a05-45d0-b932-03045d44bded tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5f2f0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:58.761666 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd404e7e-0a05-45d0-b932-03045d44bded tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.185363 Oct 04 20:50:58.764001 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1337/2645] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:50:58 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:58.775712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:58.779973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:58.813592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:59.149052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:59.186838 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac06ca44-52b6-47f4-bdef-3486a99c16c3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.483309 Oct 04 20:50:59.188214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1309/2646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:57 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:59.250108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:59.251210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:59.278829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.280149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.285979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:59.288552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.289393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.294191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.489157 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f167ad56-2038-4003-a94a-8e0c9be3aeb8 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1617 microversion: 2.1 time: 1.722628 Oct 04 20:51:00.491586 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1338/2647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:58 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1617 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:00.512957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a757aeb7-31f4-4a36-bcd2-46a869b6341e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6105a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.540922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.589630 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86f9e381-8b46-4ba3-9dd7-eae7d230ad28 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.346241 Oct 04 20:51:00.593742 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1310/2648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:59 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:00.605849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.607527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.621703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.622983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.656292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.658460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.664751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.670456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.688573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a757aeb7-31f4-4a36-bcd2-46a869b6341e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.194611 Oct 04 20:51:00.695950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1339/2649] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:00.725639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:00.733502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.760178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.766283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.767581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.769249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.773068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.774266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.824029 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action HTTP/1.1 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 28 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: {"reboot": {"type": "SOFT"}} Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:00.828405 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1f48d2a-02bb-451e-b781-9ea3b7c5e0d3 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action" status: 404 len: 111 microversion: 2.1 time: 0.133721 Oct 04 20:51:00.844325 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1340/2650] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:00 2022] POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:00.856946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.858143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.870738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.871561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.872289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.873522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.874284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.875077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.907925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:01.748575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b95b7b2-0d7b-4068-8537-6f07490d235c tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1617 microversion: 2.1 time: 1.149286 Oct 04 20:51:01.750291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1311/2651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1617 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:01.785441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94bef9ed-a42f-4d31-b96f-c911a0875d26 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5702940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:01.873598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:01.905255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09b43f17-f234-474f-82ab-5612d1798b6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.055528 Oct 04 20:51:01.936487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1341/2652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:01.965796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:01.994761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'host': 'n-h2-851029-13', 'deleted': False} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:51:01.995181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94bef9ed-a42f-4d31-b96f-c911a0875d26 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.238665 Oct 04 20:51:02.001059 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1312/2653] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:01 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:02.030184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:02.035639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:02.040228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.043046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.049155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.055550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.057358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.058517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.071771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.075535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.076845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.078180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.080925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.089534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.168878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:02.360826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:51:02.624924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1de61c32-fb9b-414f-950f-9a5692e9ebac tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=n-h2-851029-13&all_tenants=1" status: 200 len: 1319 microversion: 2.1 time: 0.686356 Oct 04 20:51:02.629125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1342/2654] 10.222.0.36 () {58 vars in 1192 bytes} [Tue Oct 4 20:51:01 2022] GET /compute/v2.1/servers?host=n-h2-851029-13&all_tenants=1 => generated 1319 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:02.669937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:02.728065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:51:02.757148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.758736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.759867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.764052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.769964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.776700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.896298 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe55a22c-2e1c-431d-a10d-2de80bd81d2e tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.250144 Oct 04 20:51:02.898166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1343/2655] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Oct 4 20:51:02 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:51:02.951941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:02.968880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.008504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.010109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.017392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.020748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.027515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.029031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.641973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:03.681516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1189d27-4e30-4d74-8c6c-9a19f5f7f970 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.675390 Oct 04 20:51:03.689211 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1313/2656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:01 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:03.722437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98112eb3-67e4-4067-9cd8-14fc961ab324 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5766310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:03.750155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fcf59a35-d53e-4788-bc26-eef48c8396a7 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 0 microversion: 2.1 time: 0.834530 Oct 04 20:51:03.754122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1344/2657] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:02 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:51:03.765023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:03.781774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: b7b3e084-3fb0-448a-9fd4-ea86f34e1a06] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.812529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/b7b3e084-3fb0-448a-9fd4-ea86f34e1a06/action HTTP/1.1 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 28 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: {"reboot": {"type": "SOFT"}} Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b7b3e084-3fb0-448a-9fd4-ea86f34e1a06', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. Oct 04 20:51:03.828058 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance b7b3e084-3fb0-448a-9fd4-ea86f34e1a06 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6012b1e-75c1-47e7-8c94-89279819e61e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/b7b3e084-3fb0-448a-9fd4-ea86f34e1a06/action" status: 404 len: 111 microversion: 2.1 time: 0.085263 Oct 04 20:51:03.844667 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1345/2658] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:03 2022] POST /compute/v2.1/servers/b7b3e084-3fb0-448a-9fd4-ea86f34e1a06/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:03.860164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:03.874200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.898805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.927200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.928098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.929463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.929463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.929463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.019227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98112eb3-67e4-4067-9cd8-14fc961ab324 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.316527 Oct 04 20:51:04.063476 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1314/2659] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:03 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:04.107248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:04.108462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:04.141940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.148803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.150548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.152838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.158578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.159863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.433384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:04.438776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:04.445134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:04.446630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:04.452199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:05.031580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.067161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.071482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.078319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.082291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.083648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.097160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.229856 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cde86ffa-2801-4e3a-a09b-d1653707dc84 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 1068 microversion: 2.1 time: 1.378184 Oct 04 20:51:05.231379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1346/2660] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:03 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 1068 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:51:05.238468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ac400a6-940c-4805-8beb-558a185aa723 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fbd9d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.479741 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2ac400a6-940c-4805-8beb-558a185aa723 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.231711 Oct 04 20:51:05.481127 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1347/2661] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:05.518191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.524253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.540687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.554117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.557776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.560875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.565195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.568177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.569936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf2d706e-3538-4b6c-95be-fa820586359c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.502648 Oct 04 20:51:05.570944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.574566 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1315/2662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:04 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:05.675972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.683114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.699413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.700763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.703473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.703473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.703473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.705292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.836899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:07.144768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:07.321081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.373317 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c205cb6-4006-4ffc-b105-36d8dfd8b3ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.750658 Oct 04 20:51:07.375577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1316/2663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:07.396870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c7faba2-4215-4cf6-b8fd-c6133503ffaf tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5dc8e50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:07.536081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.568459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47a413ff-9d51-47e7-8c9c-c1ffdcd13b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 2.085116 Oct 04 20:51:07.573243 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1348/2664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:07.591111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a52fd52-0e35-4524-b566-14f5d58ca116", "name": "network-vif-plugged", "status": "completed", "tag": "2f012665-e616-4189-bf19-689c4707736e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:07.593847 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c7faba2-4215-4cf6-b8fd-c6133503ffaf tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.210120 Oct 04 20:51:07.601398 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1317/2665] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:07 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:07.644450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.645658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.646859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.649092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:07.669209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:07.698025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.699884 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] Creating event network-vif-plugged:2f012665-e616-4189-bf19-689c4707736e for instance 1a52fd52-0e35-4524-b566-14f5d58ca116 on n-h1-851029-13 Oct 04 20:51:07.705409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.710331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.713137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.716145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.720845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.722932 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d7265e51-e102-4c39-9c52-ea4a964f2955 req-841680a2-90b9-4a59-9d5b-30f206d82e6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140249 Oct 04 20:51:07.726863 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1349/2666] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:07.758392 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action HTTP/1.1 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 65 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499', 'body': {'rebuild': {'imageRef': '08650df2-2319-4b76-af09-4569093fd163'}}} Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 20:51:07.762803 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:07.779811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:07.783455 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b822db7e-76bb-459c-baa9-77b7a65ae826 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action" status: 404 len: 111 microversion: 2.1 time: 0.168076 Oct 04 20:51:07.794737 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1318/2667] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:07 2022] POST /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499/action => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:07.811727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:07.813747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:07.828624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.831896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.833350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.835315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.837491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.839563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.629531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:08.636448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:08.692939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.696611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.700966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.707936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.711144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.720983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.564979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.607070 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf7ed963-0771-4900-9aa8-91301c7b2af0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.806394 Oct 04 20:51:09.622719 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1350/2668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:07 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:09.625858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9356ff5-19a7-476d-aa76-220583b5a719 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61081f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:09.852022 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9356ff5-19a7-476d-aa76-220583b5a719 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.240523 Oct 04 20:51:09.853754 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1351/2669] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:09 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:09.865053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:09.866953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:09.882646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.884184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.885594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.887624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.889118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.890199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:10.925847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:10.989825 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9513fd34-2125-44d6-bd5d-55b43c200cc9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 2.356711 Oct 04 20:51:11.051221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1319/2670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:08 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:11.069968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb425353-60c3-42bc-a1ad-229386a11b3d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f57023a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:11.127257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:11.214613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa961872-cc88-49c2-b6ef-7d51b44b0343 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.357860 Oct 04 20:51:11.215800 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1352/2671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:09 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:11.270703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:11.281264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: ace6636e-6859-4fb1-9fb9-9ec3afef4365] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:11.352043 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. Oct 04 20:51:11.362209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb425353-60c3-42bc-a1ad-229386a11b3d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.308887 Oct 04 20:51:11.372085 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1320/2672] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:11 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/ace6636e-6859-4fb1-9fb9-9ec3afef4365/action HTTP/1.1 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 65 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ace6636e-6859-4fb1-9fb9-9ec3afef4365', 'body': {'rebuild': {'imageRef': '08650df2-2319-4b76-af09-4569093fd163'}}} Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:51:11.393046 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance ace6636e-6859-4fb1-9fb9-9ec3afef4365 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:11.402370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdcdad2e-05fa-4360-a60a-16d3010a5ce5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/ace6636e-6859-4fb1-9fb9-9ec3afef4365/action" status: 404 len: 111 microversion: 2.1 time: 0.133925 Oct 04 20:51:11.415902 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1353/2673] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:11 2022] POST /compute/v2.1/servers/ace6636e-6859-4fb1-9fb9-9ec3afef4365/action => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:11.421482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:11.423119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:11.445826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.449524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.449524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.449524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.452884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.456419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.069651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.078463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:12.132211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.163289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.179390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.189408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.191201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.195286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.860061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:13.820453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:13.857208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c19f293-9c7b-41de-b69f-1b836050d93b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.445330 Oct 04 20:51:13.866310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1321/2674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:11 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:13.882752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e05d39cc-0036-405f-9b15-cf3911089dbe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f654b310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:14.008705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:14.050118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d30485b2-9ed3-4bdb-81fe-69abd770405d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 1.984521 Oct 04 20:51:14.076870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e05d39cc-0036-405f-9b15-cf3911089dbe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.208308 Oct 04 20:51:14.081575 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1322/2675] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:13 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:14.096263 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1354/2676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:14.106148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1175008664", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "56f1042e-5d80-4b02-91cf-ef81f86e9730"}, {"uuid": "a33a27b7-2518-490f-b2ef-e4e3a758098c"}, {"uuid": "56f1042e-5d80-4b02-91cf-ef81f86e9730"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:14.117046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:14.118285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:14.171189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.177951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.179331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.181622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.186206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.188308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.329791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] validate_networks() for [('56f1042e-5d80-4b02-91cf-ef81f86e9730', None, None, None, None, None), ('a33a27b7-2518-490f-b2ef-e4e3a758098c', None, None, None, None, None), ('56f1042e-5d80-4b02-91cf-ef81f86e9730', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:15.570159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:15.616581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad736889-a978-49cd-b53e-a51cb6bda999 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.518025 Oct 04 20:51:15.647019 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1355/2677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:14 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:15.657482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:15.667846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:15.697871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.698716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.699539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:15.700876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.701754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.702516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:17.190811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:17.227253 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74e3ab2a-d57e-452c-8c6b-695dac3c4b0f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 1.594460 Oct 04 20:51:17.232855 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1356/2678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:15 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:17.256242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67a1e68a-1f02-485f-897a-e5e1261f4465 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f625c1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:17.488172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67a1e68a-1f02-485f-897a-e5e1261f4465 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.249139 Oct 04 20:51:17.500376 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1357/2679] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:17 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:17.534003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:17.535283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: a4d1e545-da86-42fc-a3a2-d008ddabc3cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:17.581460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:17.584292 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/a4d1e545-da86-42fc-a3a2-d008ddabc3cf/action HTTP/1.1 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: {"restore": {}} Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a4d1e545-da86-42fc-a3a2-d008ddabc3cf', 'body': {'restore': {}}} Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:17.592213 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:17.605515 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:17.605515 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:17.605515 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. Oct 04 20:51:17.605515 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:17.607601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance a4d1e545-da86-42fc-a3a2-d008ddabc3cf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:17.610838 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93f3e871-7c05-4e81-b642-cc295898ddb5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/a4d1e545-da86-42fc-a3a2-d008ddabc3cf/action" status: 404 len: 111 microversion: 2.1 time: 0.107392 Oct 04 20:51:17.614951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1358/2680] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:17 2022] POST /compute/v2.1/servers/a4d1e545-da86-42fc-a3a2-d008ddabc3cf/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:17.646404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:17.649945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:17.725721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:17.727200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:17.730592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:17.739690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:17.739690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:17.739690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.449323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:20.492116 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c278f33-1bd4-4ad2-9592-ea32371c6a74 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.860530 Oct 04 20:51:20.517481 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1359/2681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:17 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:20.538017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:20.547394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:20.562915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.565053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.566274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.568005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.569160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.570270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:23.829392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=30 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.019261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:24.101817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab4e645c-933f-45b3-a119-85beb2f89e14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 3.566169 Oct 04 20:51:24.118255 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1360/2682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:20 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 3599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:24.159233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9db368a-23d8-4815-87fd-149b8148dfd3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f580ab80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.196483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=25 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.369688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9db368a-23d8-4815-87fd-149b8148dfd3 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.248690 Oct 04 20:51:24.375343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1361/2683] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:24.394270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.396049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:24.409413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.410841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.412199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.414046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.415420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.417107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.498646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.680980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:24.682520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:24.684147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:24.685459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:24.689449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:24.733323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.734958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.743138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.747621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.749244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.751773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.847272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Getting quotas for project 5f8548060d5c4b84bd8e3b7565884306. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:24.863821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Getting quotas for user 4df2155d4ba740d897b901567be94516 and project 5f8548060d5c4b84bd8e3b7565884306. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:24.897138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:24.909924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:25.453112 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7b43fdd-af8b-4831-b790-be4f7201465f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.369285 Oct 04 20:51:25.461961 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1323/2684] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 11379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:51:25.492334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:25.496005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:25.531667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.532606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.533420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.535144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.536448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.542069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.770395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.844941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b595ee9-91c6-4d24-92f4-44db6154edeb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.466971 Oct 04 20:51:25.846107 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1362/2685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:25.873837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7bf3505-b028-42fd-abf4-1196c68ac89e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f639eaf0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:26.076623 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7bf3505-b028-42fd-abf4-1196c68ac89e tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.214682 Oct 04 20:51:26.082053 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1363/2686] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:25 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:26.120015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1751420-d92d-43fd-b58e-a399f6600ce9 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:26.121324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1751420-d92d-43fd-b58e-a399f6600ce9 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:26.431014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1751420-d92d-43fd-b58e-a399f6600ce9 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:26.489647 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1751420-d92d-43fd-b58e-a399f6600ce9 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1213 microversion: 2.1 time: 0.405362 Oct 04 20:51:26.515339 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1364/2687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:26 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1213 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:26.586033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:26.598580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:26.638326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.643822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.650131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.655330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.660760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.665347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.800525 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'restore' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: {"restore": {}} Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'restore' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'restore': {}}} Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state active. Cannot restore while the instance is in this state. Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:26.804647 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'restore' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0004728-8d31-465b-bf26-5dfd9efb632c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 145 microversion: 2.1 time: 0.294112 Oct 04 20:51:26.816005 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1365/2688] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:26 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 145 bytes in 299 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:51:26.835743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:26.837165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:26.854440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.855868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.856754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.858066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.859220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.860377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.045634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.079755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20816bb8-311c-4fa4-8433-d3ce0a7a4b43 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 1.614205 Oct 04 20:51:27.081198 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1324/2689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:25 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:27.144784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51e82f60-dabe-4464-bade-1fcc7a9ecee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5702ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:27.369396 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51e82f60-dabe-4464-bade-1fcc7a9ecee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.258822 Oct 04 20:51:27.369396 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1325/2690] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:27 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:27.554735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0c9b48f-b29e-4f82-bf7f-52f113484b1c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:27.565468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c0c9b48f-b29e-4f82-bf7f-52f113484b1c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:27.887470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0c9b48f-b29e-4f82-bf7f-52f113484b1c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.919836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0c9b48f-b29e-4f82-bf7f-52f113484b1c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1213 microversion: 2.1 time: 0.375005 Oct 04 20:51:27.927768 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1326/2691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:27 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:28.137938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:28.143292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:28.218371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.219714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.221261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.226138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.232083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.233058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.127339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.211454 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40e4015e-e744-4417-bac1-ed06a9c1008c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.383809 Oct 04 20:51:29.250642 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1366/2692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:26 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:29.297796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e08186fb-7c0b-4a55-9d79-f3240aab8d31 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f580a5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:29.517767 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e08186fb-7c0b-4a55-9d79-f3240aab8d31 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.249921 Oct 04 20:51:29.535058 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1367/2693] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:29 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:29.585856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:29.592127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.615832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.616405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.621755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.623381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.624299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.625096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.429223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.512216 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a1b31bd-3765-4e00-8cf5-8bc20cfe58a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1209 microversion: 2.1 time: 0.955226 Oct 04 20:51:30.520107 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1368/2694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:29 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1209 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:30.565228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:30.568309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:30.626773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.628605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.629931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.632609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.634046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.635250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.894034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.959114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-411e928c-dee9-4f56-842a-61fb9848d3af tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 2.832375 Oct 04 20:51:30.966602 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1327/2695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:28 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 2841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:31.001531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b1fcf96-9549-4ba7-b310-1d4a44085b7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa55a820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:31.232889 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b1fcf96-9549-4ba7-b310-1d4a44085b7d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.261912 Oct 04 20:51:31.236400 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1328/2696] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:30 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:31.585727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:31.594550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:31.632855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.639769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.640592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.649666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.651691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.658575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.313798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.360062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-315d5f57-e22b-4e98-84d4-c6f5e089b7ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1273 microversion: 2.1 time: 0.783697 Oct 04 20:51:32.371438 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1329/2697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:31 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1273 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:32.407878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:32.423502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:32.476084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.481758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.485793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.487893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.501289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.504894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.567217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:33.618535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f240fbba-b43b-4c5b-b78f-94b813df450a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 3.087906 Oct 04 20:51:33.624069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1369/2698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:30 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 3103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:33.741445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62c84c31-ccab-41d8-895d-a895da6a0880 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f622e1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:33.983592 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62c84c31-ccab-41d8-895d-a895da6a0880 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.291149 Oct 04 20:51:34.009281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1370/2699] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:33 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:34.041890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:34.043927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:34.087242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.089037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.094993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.100522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.105590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.111052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.846760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:35.607228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:35.639264 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94c2711a-8010-4dfe-b620-9e8a41cadc0e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1271 microversion: 2.1 time: 1.626269 Oct 04 20:51:35.640385 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1371/2700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:34 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1271 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:35.686418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:35.692205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:35.693682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 57c4200f-dd11-4845-8ee8-f16cafa2b8f8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:35.706296 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/57c4200f-dd11-4845-8ee8-f16cafa2b8f8/action HTTP/1.1 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 14 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: {"resume": {}} Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '57c4200f-dd11-4845-8ee8-f16cafa2b8f8', 'body': {'resume': {}}} Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:35.718354 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:35.726623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:35.726623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:35.726623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. Oct 04 20:51:35.726623 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:51:35.729707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 57c4200f-dd11-4845-8ee8-f16cafa2b8f8 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:35.731817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce384cbe-3904-4f84-ba85-e5a8ef5077e6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/57c4200f-dd11-4845-8ee8-f16cafa2b8f8/action" status: 404 len: 111 microversion: 2.1 time: 0.067024 Oct 04 20:51:35.732105 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e2e583a-1b50-44ab-99db-77c7c27ce4d6 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 3.357692 Oct 04 20:51:35.733460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1372/2701] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:35 2022] POST /compute/v2.1/servers/57c4200f-dd11-4845-8ee8-f16cafa2b8f8/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:35.745578 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1330/2702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:32 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 3368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:35.774575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02b2a78e-e8ab-4493-a0db-2d970ff75b71 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5866550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:35.779959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:35.780616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:35.805690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.811589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.812753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:35.817033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.820480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.824138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:35.977401 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02b2a78e-e8ab-4493-a0db-2d970ff75b71 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.228108 Oct 04 20:51:35.987011 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1373/2703] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:35 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:36.687853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:36.700532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:36.703763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:36.723527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.726057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.730202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.732757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.734807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.736042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.438452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:37.479521 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57eac00c-2365-45ce-96be-e5ad29e2bd4e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1271 microversion: 2.1 time: 0.778533 Oct 04 20:51:37.491652 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1374/2704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:36 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1271 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:37.528402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:37.528402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:37.595765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.597218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.598417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.602090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.604822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.607094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.918620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:38.461357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:38.511694 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e5c97ca6-f956-4a73-8bb9-688662a929f1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.763683 Oct 04 20:51:38.517542 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1331/2705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:35 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:38.530170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81641ef7-cda2-41bf-8cc1-2475f79b6545 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa55a430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:38.705960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81641ef7-cda2-41bf-8cc1-2475f79b6545 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.185836 Oct 04 20:51:38.707388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1332/2706] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:38 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:39.163470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db4430e3-4819-4eb4-89fa-4ae113b4b30f tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:39.219824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:39.238036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db4430e3-4819-4eb4-89fa-4ae113b4b30f tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.521701 Oct 04 20:51:39.246789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1333/2707] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:51:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:39.260463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:39.262427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:39.278815 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79f13130-518e-4198-a45d-0569024c2eff tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1472 microversion: 2.1 time: 1.784687 Oct 04 20:51:39.280353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1375/2708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:37 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1472 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:39.280689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.291357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.291357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.291357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.291357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.291357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.294039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:39.297589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:39.318021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.319513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.320857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.322952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.325838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.327923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.902551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:40.014819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-594bbdde-1720-458e-93b4-f73cea535aec tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1271 microversion: 2.1 time: 0.765468 Oct 04 20:51:40.039837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1334/2709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:39 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1271 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:40.080394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b70c429b-7e0c-4fe0-86ea-199dbed0a28d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5722550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:41.312528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:41.343718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17771702-2eb7-458d-8fe8-c0dc169151d1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.061178 Oct 04 20:51:41.352828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1376/2710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:41.391444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:41.393323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:41.428495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.430199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.432262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:41.445897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.448823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.452959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.344563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:42.381328 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11b4640f-3080-496f-9811-a81926b8e35b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1478 microversion: 2.1 time: 1.025902 Oct 04 20:51:42.401561 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1377/2711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:41 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1478 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:42.452658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:42.462593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:42.494892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.498238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.499046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.505754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.506752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.509121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.648176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b70c429b-7e0c-4fe0-86ea-199dbed0a28d tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 2.602462 Oct 04 20:51:42.675023 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1335/2712] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:40 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:42.695860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:42.697573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:42.734148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.735991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.739850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.745000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.747925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.751689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.867328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'resume' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 14 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: {"resume": {}} Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'resume' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'resume': {}}} Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state active. Cannot resume while the instance is in this state. Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:42.883183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:51:42.897170 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:42.903536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'resume' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:42.903536 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4859009-2b38-45c4-bca1-57f31662ff1f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 144 microversion: 2.1 time: 0.225013 Oct 04 20:51:42.913093 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1336/2713] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:42 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 144 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:51:42.929190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1478221357", "imageRef": "9d013c2a-db6d-4016-9567-2332472753e7", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:43.089046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:43.997191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:44.031999 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d572234-0530-4042-a6da-c24fd117c75f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1313 microversion: 2.1 time: 1.628472 Oct 04 20:51:44.033125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1378/2714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:42 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1313 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:44.067441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:44.069490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:44.084166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.085604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.086841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.088754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.090111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.091435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.489208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] Request method failure captured: Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 143 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJzZfOr1bdGHaJdQ583aE0KV7RJSLDAMJhmv_7Hkn23jSntA_nQ6lr8UoCDzfhoQSgZbkzJ-PBnSt16-56fdJjMdiOC443dvKLFNP2-dmrI-utVDEIbKyexub-Zb033vQrelE_y_bJ2cnY0DnjXjLDcLRG7Yz26R_Se-1gVT7JDlYSw Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: d3f986003383454db1ca9fddc9d75820 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-FlavorsV2NegativeTest-207015869 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3f986003383454db1ca9fddc9d75820"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3f986003383454db1ca9fddc9d75820"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3f986003383454db1ca9fddc9d75820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3f986003383454db1ca9fddc9d75820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-FlavorsV2NegativeTest-207015869 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: d3f986003383454db1ca9fddc9d75820 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-207015869 Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-FlavorsV2NegativeTest-207015869-project Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9595bf28f8c248e8a0c349c4a957902e Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-FlavorsV2NegativeTest-207015869-project Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1478221357", "imageRef": "9d013c2a-db6d-4016-9567-2332472753e7", "flavorRef": "452"}} Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor's memory is too small for requested image. Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1478221357', 'imageRef': '9d013c2a-db6d-4016-9567-2332472753e7', 'flavorRef': '452'}}} Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:44.492707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:44.503159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:44.508997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-461d7bda-e850-4292-815a-ded9791e3402 tempest-FlavorsV2NegativeTest-207015869 tempest-FlavorsV2NegativeTest-207015869-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.589975 Oct 04 20:51:44.529328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1337/2715] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:42 2022] POST /compute/v2.1/servers => generated 93 bytes in 1615 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:44.551447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:44.557733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:44.597336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.598812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.601983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.608186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.612384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.614284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:45.280101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:45.342627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0a66b07-005f-49a0-8b19-963751881584 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.288876 Oct 04 20:51:45.343157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:45.348750 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1379/2716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:44 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:45.411897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc7c636c-5dfd-43c9-bda0-a0036e030f81 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f624cdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:45.416185 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc641030-7054-452b-ab27-b22d1cd77ca2 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1478 microversion: 2.1 time: 0.883496 Oct 04 20:51:45.428024 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1338/2717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:44 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1478 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:45.846685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1129826375", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "931f7db1-f8be-4b90-9ca3-01705c225eac"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:46.292433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] validate_networks() for [('931f7db1-f8be-4b90-9ca3-01705c225eac', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:46.307392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc7c636c-5dfd-43c9-bda0-a0036e030f81 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.949584 Oct 04 20:51:46.308527 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1380/2718] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:45 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:46.349508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:46.350776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:46.382692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.383658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.384534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:46.386782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.390587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.393989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:48.160612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:48.180428 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c6cc1d7f-b84a-4948-9ea8-5e36a561b5c1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1313 microversion: 2.1 time: 1.863685 Oct 04 20:51:48.202309 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1381/2719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:46 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1313 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:48.246543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:48.261094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:48.277816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=38 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:48.295618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:48.296764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:48.297765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:48.312228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:48.313670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:48.314718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.377372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:50.423184 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b3a52626-44e9-41a6-92d0-3d4eb5e8577e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.211823 Oct 04 20:51:50.447668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1382/2720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:48 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:50.471121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:50.472781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:50.542309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.542309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.543268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.547106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.554207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.555697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.495776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:51.496735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:51.497689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:51.498384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:51.499147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:51.532793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.535894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.541283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.543313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.544561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.545660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.595081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Getting quotas for project ad6b7cfd72a94805b60a6b73ef1668ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:51.623288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Getting quotas for user 58e361704c50409c89bdefa7f9ee39ad and project ad6b7cfd72a94805b60a6b73ef1668ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:51.657806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:51.664275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:51.793281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:51.825782 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d08948fc-2ff4-4f8d-a20d-3152457b4c89 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1478 microversion: 2.1 time: 1.375690 Oct 04 20:51:51.838948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1383/2721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:50 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1478 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:51.996072 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09a55c8a-0bf9-45f6-afeb-9102c3285898 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 6.548854 Oct 04 20:51:51.997643 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1339/2722] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 20:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 6569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:51:52.021454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-209ac917-073a-44bb-aecf-54f83535dff4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54fa4d7dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:52.320687 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-209ac917-073a-44bb-aecf-54f83535dff4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.321083 Oct 04 20:51:52.331383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1340/2723] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:51 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:52.349863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:52.356638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:52.394248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:52.402915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:52.404515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:52.412048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:52.413479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:52.419616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.208278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1679449486", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "f872e63a-c889-472b-9fe9-436be0327e38"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:53.519443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.523994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] validate_networks() for [('f872e63a-c889-472b-9fe9-436be0327e38', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:53.557901 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-add2deb5-9b5a-4d83-8370-92e2917828e4 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1334 microversion: 2.1 time: 1.224257 Oct 04 20:51:53.559957 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1341/2724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:52 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1334 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:53.595214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b8693b2-fa31-4ce3-9151-678fff30f728 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b8693b2-fa31-4ce3-9151-678fff30f728 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 160 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3f71e3c8-2f24-4002-ad98-706d0dd02af4"}]}} Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': '', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'networks': [{'uuid': '3f71e3c8-2f24-4002-ad98-706d0dd02af4'}]}}} Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi '' Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:53.610095 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b8693b2-fa31-4ce3-9151-678fff30f728 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:53.624690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b8693b2-fa31-4ce3-9151-678fff30f728 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.050273 Oct 04 20:51:53.643257 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1342/2725] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:53 2022] POST /compute/v2.1/servers => generated 108 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:53.656021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:53.656021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:54.565445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.601772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.605911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.629682 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9943331-5af1-41e8-8251-8e495181ef3e tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1262 microversion: 2.26 time: 0.983293 Oct 04 20:51:54.632346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1343/2726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:53 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1262 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:54.682191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "name": "network-vif-plugged", "status": "completed", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:54.728441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:54.737301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.740562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.742162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.764294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=57 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:54.814932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] Creating event network-vif-plugged:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:51:54.862585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-afcba9fa-5b4c-41c5-b546-fbb1e9fb32fc req-e0957b1f-9c90-48f4-86bf-4890c6f69a54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203902 Oct 04 20:51:54.871202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1344/2727] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:54.902797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:54.912672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:54.956214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.974776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.977994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.985505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.989797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.993919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.714382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:55.717825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:55.717825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:55.717825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:55.717825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:55.772960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.775640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.781330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.788040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.789872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.793556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.833317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=85 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:55.875566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Getting quotas for project 2bc16419d68e4e3a8742af2ded2087d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:55.887927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:55.891876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Getting quotas for user cdffecda35014b7abc6aa680c92ed16d and project 2bc16419d68e4e3a8742af2ded2087d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:55.925980 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16dc794d-cbed-47d6-a526-ef8f86c22d12 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1478 microversion: 2.1 time: 1.051317 Oct 04 20:51:55.933282 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1345/2728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:54 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1478 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:55.952698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:55.953026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b40d36d-8224-48de-b7e6-08ea5f157d97 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f56e85e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:55.968044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:56.130364 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b40d36d-8224-48de-b7e6-08ea5f157d97 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1440 microversion: 2.1 time: 0.194353 Oct 04 20:51:56.132525 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1346/2729] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:55 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1440 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:56.163831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:56.166964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:56.190871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:56.193662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:56.195032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:56.196996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:56.198692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:56.200171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:56.309539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ed2b976-d064-473a-b566-11fd5c2164ea tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.480347 Oct 04 20:51:56.325363 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1384/2730] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:51:57.203877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a962723-80ce-40bd-99a5-c1a38dc2d409 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Action: 'create', calling method: .version_select at 0x7f54f624cdc0>, body: {"keypair": {"name": "tempest-keypair-1325409756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAKXFcgDzDlIPZkF5oZK9lAFVjg6FbaPmdlbld5Q8fds3jZEJ+ykUBVvyrIIGtpnX9UBTC3f+rDVFudL+9kNexxM4l5IZ6bX+Bd7eR5+41kn985Zn6y9HfpmpVXWvQF/g=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:57.282721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8a962723-80ce-40bd-99a5-c1a38dc2d409 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for project c3bb2a48b24347c28d987418dedca0d8. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:57.298569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8a962723-80ce-40bd-99a5-c1a38dc2d409 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for user 3e2e7c905c0e4eaea92e962086799213 and project c3bb2a48b24347c28d987418dedca0d8. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:57.469430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a962723-80ce-40bd-99a5-c1a38dc2d409 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.141490 Oct 04 20:51:57.491180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1385/2731] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:51:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:57.524026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:57.530470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:57.569396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.572451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.575717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.579981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.581475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.587631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.751121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:57.778971 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e20bad6-5006-418e-a02f-74585c315b3f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.639046 Oct 04 20:51:57.781409 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1347/2732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:56 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:57.800597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:57.806955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:57.859971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.862974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.875707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.877702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.883203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.885305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.570304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.628853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.634924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.654439 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7177fd53-57d7-4aef-b562-36e1e48d9b0f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1314 microversion: 2.26 time: 0.866202 Oct 04 20:51:58.681816 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1348/2733] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:57 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:58.714074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5233bd5d-a2ab-4152-88bb-fc9fe31a96e2 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:58.723226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5233bd5d-a2ab-4152-88bb-fc9fe31a96e2 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:58.870017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.922947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d935617f-2157-4a35-8f06-53b4f46544a8 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1334 microversion: 2.1 time: 1.428409 Oct 04 20:51:58.932196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1386/2734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:57 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1334 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:58.954926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:58.965395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:58.983377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.988006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.992431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.994420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.998150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.999556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.150164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5233bd5d-a2ab-4152-88bb-fc9fe31a96e2 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:59.170841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5233bd5d-a2ab-4152-88bb-fc9fe31a96e2 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1225 microversion: 2.1 time: 0.482414 Oct 04 20:51:59.183896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1349/2735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:58 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1225 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:59.200632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a64980a2-44f8-4e4e-bb77-018e19c1b6ac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f570ee50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:59.458159 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a64980a2-44f8-4e4e-bb77-018e19c1b6ac tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1449 microversion: 2.1 time: 0.272294 Oct 04 20:51:59.475170 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1350/2736] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:59 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1449 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:59.499839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:59.500966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:59.549125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:59.549976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:59.555114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.556820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:59.557487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:59.558246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.921671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:59.979355 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e107b7c5-6ca2-4e2e-976d-a956398e383f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1464 microversion: 2.1 time: 1.007444 Oct 04 20:51:59.980515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1387/2737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:58 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1464 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:00.037382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c7563e2-eebe-496e-b9ac-579afc7832f7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5fe3dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:00.387008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c7563e2-eebe-496e-b9ac-579afc7832f7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 200 len: 1449 microversion: 2.1 time: 0.402762 Oct 04 20:52:00.390480 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1388/2738] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:51:59 2022] GET /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 1449 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:00.405898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:00.408850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:00.448439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.449376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.450618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.452510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.453946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.455404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.278918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.327754 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-409b1977-1467-42a0-a544-9bac1a6fb7e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.850473 Oct 04 20:52:01.339763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1351/2739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:59 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:01.359937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:01.370755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:01.398174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.399916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.405776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.408019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.409724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.415980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.424223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.502635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.518683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.534653 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65295dc4-7ccc-4ece-9536-1b646d170cd6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1320 microversion: 2.26 time: 1.136007 Oct 04 20:52:01.595300 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1389/2740] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:00 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1320 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:01.610744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:01.612353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:01.616059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:01.626758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.627867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.630014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.631401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.632514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.633229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.083398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.114225 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5722561f-2c72-4fb5-9a10-7087a4e9c302 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 1.771754 Oct 04 20:52:03.149190 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1352/2741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:01 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:03.192069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:03.201018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:03.201409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.213923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.217114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.218200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.219817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.220876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.221861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.244707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f5db0bdd-0c5a-4ed6-a472-b15893bd8dcb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1464 microversion: 2.1 time: 1.645695 Oct 04 20:52:03.247270 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1390/2742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:01 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1464 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:03.267449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36387f13-8b8c-4952-ad3b-c7b75f87f595 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f57c8dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:03.726072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.811814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5ae8045-8ee9-48d8-af0a-88ff22d34847 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1285 microversion: 2.1 time: 0.659685 Oct 04 20:52:03.840840 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1353/2743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:03 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1285 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:03.880666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06aba1dc-0463-490c-92d8-c0b7f42468b6 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f5722790>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.102598 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06aba1dc-0463-490c-92d8-c0b7f42468b6 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c" status: 200 len: 636 microversion: 2.1 time: 0.259527 Oct 04 20:52:04.120372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1354/2744] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:03 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c => generated 636 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:04.169549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:04.170878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: fe449449-070a-44b4-8163-0d7828ceffb8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:04.224362 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/fe449449-070a-44b4-8163-0d7828ceffb8/action HTTP/1.1 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 14 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: {"shelve": {}} Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fe449449-070a-44b4-8163-0d7828ceffb8', 'body': {'shelve': {}}} Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:04.244115 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:04.252469 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:04.252469 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:04.252469 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. Oct 04 20:52:04.252469 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:04.252469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance fe449449-070a-44b4-8163-0d7828ceffb8 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:04.254719 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b0381c7-f141-42b6-8352-95f87656f6ce tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/fe449449-070a-44b4-8163-0d7828ceffb8/action" status: 404 len: 111 microversion: 2.1 time: 0.131826 Oct 04 20:52:04.255921 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1355/2745] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:04 2022] POST /compute/v2.1/servers/fe449449-070a-44b4-8163-0d7828ceffb8/action => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:04.277566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a52fd52-0e35-4524-b566-14f5d58ca116", "name": "network-vif-unplugged", "status": "completed", "tag": "2f012665-e616-4189-bf19-689c4707736e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:04.360068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.380761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.381452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.418522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] Creating event network-vif-unplugged:2f012665-e616-4189-bf19-689c4707736e for instance 1a52fd52-0e35-4524-b566-14f5d58ca116 on n-h1-851029-13 Oct 04 20:52:04.447919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-98631fce-53bb-44e4-93d1-a6962c2b1bca req-a9e50cb6-1360-42c4-a751-4d905c501892 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172662 Oct 04 20:52:04.449145 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1356/2746] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:04.470960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.472821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:04.487804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.489353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.490627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.492461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.493799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.496035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:05.833760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:06.022969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.047911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.050751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.053581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bd503f9-4c36-4228-a574-8562f15cad1b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 1.599191 Oct 04 20:52:06.056174 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1357/2747] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:04 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:06.066540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:06.072962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.086268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.088054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.098982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.098982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.098982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.098982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.272149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36387f13-8b8c-4952-ad3b-c7b75f87f595 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 204 len: 0 microversion: 2.1 time: 3.015934 Oct 04 20:52:06.283958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1391/2748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:03 2022] DELETE /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 0 bytes in 3035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:06.301200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:52:06.302555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:52:06.304041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:52:06.305073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-558536ae-bbe3-4233-9f8f-9608cdedea85 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f585d8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:06.306445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:52:06.308438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:52:06.507794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-558536ae-bbe3-4233-9f8f-9608cdedea85 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:06.522841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-558536ae-bbe3-4233-9f8f-9608cdedea85 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:06.743072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.805362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.807359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.812023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.814250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.824729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.826056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.928228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2f040bf-8ff0-45ca-b7da-2b35045993f9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 1068 microversion: 2.1 time: 0.869490 Oct 04 20:52:06.930210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1358/2749] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:06 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 1068 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:52:06.941945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:06.951000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.959005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.960852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.972002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.974043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.975135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.976614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:07.634955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-558536ae-bbe3-4233-9f8f-9608cdedea85 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 1.348950 Oct 04 20:52:07.639255 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1392/2750] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:06 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:07.654611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:07.656757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:07.672145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.673873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.675187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:07.677607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.680656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.680656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.503456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.522739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e56da3a-01c2-40f8-92bd-4065c48023eb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 1.588960 Oct 04 20:52:08.524401 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1359/2751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:06 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:08.546909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.575523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:08.579336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:08.584294 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11caf073-3d64-4021-9202-c66aa4c98672 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.941214 Oct 04 20:52:08.591987 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1393/2752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:07 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:08.604526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-834499891", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ba22405c-fd7b-4dbe-a4d9-d22ddced7a10"}], "security_groups": [{"name": "tempest-securitygroup--871223532"}], "key_name": "tempest-keypair-1325409756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:08.637004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.644049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.651971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.651971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.651971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.651971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.159313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:09.198607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] validate_networks() for [('ba22405c-fd7b-4dbe-a4d9-d22ddced7a10', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:09.425324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:09.454111 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0169a2eb-7b29-42cf-86a4-ca8abbbcf7ba tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1325 microversion: 2.1 time: 0.910567 Oct 04 20:52:09.455650 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1360/2753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:08 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1325 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:09.466432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:09.467721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:09.482131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.483619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.484843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.488522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.488522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.489744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.560170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:10.150578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3452e538-ac8b-479a-8c13-efc3deab741b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 204 len: 0 microversion: 2.1 time: 0.690900 Oct 04 20:52:10.153293 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1361/2754] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:09 2022] DELETE /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:10.163925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:10.166586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:10.180122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.181247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.182163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.189091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.190216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.191100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.886629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.903537 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3dcd228c-22b6-482d-901e-7d2eb9b60eee tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1473 microversion: 2.1 time: 0.747721 Oct 04 20:52:10.904649 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1362/2755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:10 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1473 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:10.913835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:10.915454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:10.927033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.927940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.928741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.930482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.932279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.932511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.965620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:11.065361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for project c3bb2a48b24347c28d987418dedca0d8. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:11.077082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for user 3e2e7c905c0e4eaea92e962086799213 and project c3bb2a48b24347c28d987418dedca0d8. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:11.105260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:52:11.106037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:52:11.107017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:52:11.107789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:52:11.108570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:52:11.125796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.126860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.127704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:11.129170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.130056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.130893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:11.174707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for project c3bb2a48b24347c28d987418dedca0d8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:11.186972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Getting quotas for user 3e2e7c905c0e4eaea92e962086799213 and project c3bb2a48b24347c28d987418dedca0d8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:11.224779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:52:11.230503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:52:11.351385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:11.368884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:11.372316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:11.374762 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71ac3c8e-996f-4dd7-8da4-d36cd05d9e5f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 0.468141 Oct 04 20:52:11.375898 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1363/2756] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:10 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:11.435799 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84160c5e-abd5-4f8c-89b8-d3d6d58d6e11 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.841021 Oct 04 20:52:11.452053 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1394/2757] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:52:11.463114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb62913d-6767-48c2-8ad9-24903931cda5 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f5832790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:11.591266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "tag": "e51954d1-891b-4dd1-91e2-a94131d8bb6f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:11.610968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.611890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.612787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:11.638125 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] Creating event network-changed:e51954d1-891b-4dd1-91e2-a94131d8bb6f for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:11.648298 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8883bc8f-77d3-43b3-aca6-de6aec5eacdd req-abee1980-e98f-4754-8bbb-2624dcd6ce19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270047 Oct 04 20:52:11.650274 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1364/2758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:11.662624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:11.664190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:11.680294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.681108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.682280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:11.684642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.687994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.694197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.166726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb62913d-6767-48c2-8ad9-24903931cda5 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "DELETE /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.712323 Oct 04 20:52:12.173676 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1395/2759] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 4 20:52:11 2022] DELETE /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_version => generated 0 bytes in 721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:12.317096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7713309-3b55-43a9-819b-4f2a8ccbf8fd", "tag": "b5d5dd82-aec1-4848-9f7b-b20639a70570"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:12.333698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.340303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.340303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.358526 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] Creating event network-changed:b5d5dd82-aec1-4848-9f7b-b20639a70570 for instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd on n-h2-851029-13 Oct 04 20:52:12.369518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-853b1c43-21e0-4c64-aa64-4838dcd8981a req-59b94f6f-f3fa-437d-90e7-a4c18369ed37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192505 Oct 04 20:52:12.371469 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1396/2760] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:12.384121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:12.388081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:12.406587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.407660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.409461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.410972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.411841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.412830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.699108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:12.725619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-533445d9-6172-4fa2-8788-deced0f82d92 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.071542 Oct 04 20:52:12.729279 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1365/2761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:11 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:12.767527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-511345610", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "7799ac52-f6d5-4905-977d-0ebc15f0fd4a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:12.883330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] validate_networks() for [('7799ac52-f6d5-4905-977d-0ebc15f0fd4a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:13.127484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:13.146712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5da224b-bd07-40f4-9230-5b6d6d7cf71a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.772677 Oct 04 20:52:13.148246 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1397/2762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:12 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:13.165731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:13.168375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:13.187267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.188845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.189824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.191526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.192881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.193985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.942993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:13.963292 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e7e4c6c-ed6f-4e82-a1eb-4eb5117ffec5 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1325 microversion: 2.1 time: 0.806113 Oct 04 20:52:13.964608 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1398/2763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:13 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1325 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:13.974570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:13.976307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:13.989760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.991873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.993549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.995486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.996766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:14.004295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.637828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:14.657015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb5f2801-791a-49e5-a0a0-753682ee82e1 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1281 microversion: 2.1 time: 0.689933 Oct 04 20:52:14.659373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1399/2764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:13 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1281 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:14.670056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:14.672107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:14.688582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:14.689775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:14.690755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.693957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:14.697316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:14.699104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.981879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:52:14.982875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:52:14.983518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:52:14.985069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:52:14.985844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:52:15.025178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.026715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.027802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.029266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.030267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.031374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.077339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:15.090901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Getting quotas for user 9265d783835047bb8377fccd36c1fdb8 and project 7a1d1403475041c0b5bc1c99e019b785. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:15.121876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:52:15.127104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:52:15.257647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:15.270760 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-557cd33f-53bb-47ca-9958-eb60c7491145 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1473 microversion: 2.1 time: 0.608428 Oct 04 20:52:15.272069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1400/2765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:14 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1473 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:15.282796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-699ab39e-fe8a-4b1e-8491-3c91b5c394ff tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f57c8430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:15.411974 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-699ab39e-fe8a-4b1e-8491-3c91b5c394ff tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.137499 Oct 04 20:52:15.422949 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1401/2766] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:52:15 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 37 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:15.433605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:15.436032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:15.442847 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31113914-67b2-4846-9aea-73b343f20ee7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710889 Oct 04 20:52:15.448816 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1366/2767] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:52:15.458879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:15.460417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:15.476030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.478191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.479499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.480402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.481365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.481566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.482611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.483789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.484426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.488779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.489598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.492738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.549907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'flavor' on Instance uuid e348ea2c-51f3-4cd7-aa1b-3beed529f909 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:16.134918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.178390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.182156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.185247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bfa295d-d099-4fd8-811d-b4b0bfb1d5cf tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 0.759682 Oct 04 20:52:16.187363 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1402/2768] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:15 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:16.197692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1539bee5-b35f-412f-be7a-8371e24ea03c", "tag": "95750b97-010d-4656-8ea2-ee5ddcc5728f"}, {"name": "network-changed", "server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "tag": "bb7bf376-2005-47e5-9717-75df91868c15"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:16.221240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.222471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.223612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.262291 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Creating event network-changed:95750b97-010d-4656-8ea2-ee5ddcc5728f for instance 1539bee5-b35f-412f-be7a-8371e24ea03c on n-h1-851029-13 Oct 04 20:52:16.263343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] Creating event network-changed:bb7bf376-2005-47e5-9717-75df91868c15 for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:16.280482 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-942e6557-17a1-4662-b209-b6acc43b44c2 req-aa6c4146-13f3-4ebc-b61e-eba1aa72573a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.090628 Oct 04 20:52:16.283075 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1403/2769] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:16.299535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:16.299903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:16.320056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.321638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.322896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.324527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.325753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.326990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.700999 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a292f9d0-eb9b-47ed-bbfa-0a66ebd677ad tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 1.249814 Oct 04 20:52:16.727160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1367/2770] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:15 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:16.752791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a52fd52-0e35-4524-b566-14f5d58ca116", "name": "network-vif-deleted", "tag": "2f012665-e616-4189-bf19-689c4707736e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:16.785811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.787377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.789024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.823697 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] Creating event network-vif-deleted:2f012665-e616-4189-bf19-689c4707736e for instance 1a52fd52-0e35-4524-b566-14f5d58ca116 on n-h1-851029-13 Oct 04 20:52:16.834427 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c73f23c7-ae64-4140-bf38-a905cd08ef82 req-b3c3890b-fb08-4e23-8cf6-3449f68548df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102582 Oct 04 20:52:16.839337 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1368/2771] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:16.881254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:16.882526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:16.897028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.899610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.900864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.902872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.904059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.917384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.301944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:17.318451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-591697dd-e878-4a2d-8211-7afd036fa291 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 1.033220 Oct 04 20:52:17.319605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1404/2772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:16 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:17.330043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b24ab877-1250-48ef-a34a-92ce0fa24054 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f62a1310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:17.439262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=25 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:17.447804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b24ab877-1250-48ef-a34a-92ce0fa24054 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:17.473499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b24ab877-1250-48ef-a34a-92ce0fa24054 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:17.622453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:17.651549 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1dc5a00c-a3b8-407f-bbec-8b86b34697b7 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1325 microversion: 2.1 time: 0.791140 Oct 04 20:52:17.663671 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1369/2773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:16 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1325 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:17.672929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:17.680091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:17.712920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.716361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.717785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.719469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.720787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.721904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.052379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.076092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d886e2d7-1596-48c2-81a7-b7fbcae81a6a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1211 microversion: 2.1 time: 0.420974 Oct 04 20:52:18.087689 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1370/2774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:17 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1211 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:18.108979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.110998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.130070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.131582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.132368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.133736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.134588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.135535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.288349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b24ab877-1250-48ef-a34a-92ce0fa24054 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.966294 Oct 04 20:52:18.290759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1405/2775] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:17 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:18.302513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7713309-3b55-43a9-819b-4f2a8ccbf8fd", "name": "network-vif-plugged", "status": "completed", "tag": "b5d5dd82-aec1-4848-9f7b-b20639a70570"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:18.324581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:18.328790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.330114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.331333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.367024 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] Creating event network-vif-plugged:b5d5dd82-aec1-4848-9f7b-b20639a70570 for instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd on n-h2-851029-13 Oct 04 20:52:18.380707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0b949ef6-9d77-4c14-8927-2b9ab2ad343c req-1e375fb0-6e10-43cf-a708-b276fd028b89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085142 Oct 04 20:52:18.382408 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1406/2776] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:18.402940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.407840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.410007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.431213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.433178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.434530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.437092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.438553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.439855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.445615 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95a1d089-198a-444e-8a06-aa40b1b4bd0d tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1337 microversion: 2.1 time: 0.355845 Oct 04 20:52:18.470763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1371/2777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1337 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:18.869513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.876017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.906860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.907850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.909157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.911862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.912784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.913581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.284970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.300748 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7cdb727-b2e3-4b9a-b18b-473d55c9daba tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1473 microversion: 2.1 time: 0.915986 Oct 04 20:52:19.320721 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1407/2778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1473 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:19.320721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.320721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:19.329018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.330404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.331575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.334109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.338284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.338284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.466133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.484140 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2bdde6d6-bd9b-4c1b-8b36-f984497e19fb tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 1.022382 Oct 04 20:52:19.488654 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1372/2779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:19.499229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edf37ab8-7b24-402a-86a8-37e2afae46b3 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f60a35e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.607785 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edf37ab8-7b24-402a-86a8-37e2afae46b3 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.117157 Oct 04 20:52:19.609373 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1373/2780] 10.222.0.36 () {58 vars in 1290 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_distro => generated 33 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:19.627088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "tag": "fea51754-6700-468e-b053-4913538fbebf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:19.644032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.645244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.646292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.677214 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] Creating event network-changed:fea51754-6700-468e-b053-4913538fbebf for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:19.687518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4ab225f9-1dc0-4b68-9220-d346e4a47945 req-94841a00-eee7-470b-8da2-61f8eaad4f3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066771 Oct 04 20:52:19.689928 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1374/2781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:19.702421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.704526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:19.718123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.719047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.720081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.721988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.723407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.724638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.796886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.835486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.839424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.841738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eecbb2f1-af23-420d-ab7e-ba63f6ba5eb1 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 0.538404 Oct 04 20:52:19.847398 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1408/2782] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:19.857084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.858499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:19.880671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.881564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.883798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.897278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.898474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.901211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.719562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:20.727554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:20.737722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7e35b60-18d9-4d51-b063-150c2bd27bc1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 1.045007 Oct 04 20:52:20.738800 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1375/2783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:20.768237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:20.769878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:20.779275 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc703403-e904-4000-8b49-f09603666a7d tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1325 microversion: 2.1 time: 0.929817 Oct 04 20:52:20.781266 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1409/2784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1325 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:20.792358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:20.793913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:20.808165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.809621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.810863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.812497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.813708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.814794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.818388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.823534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.824361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.825694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.828821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.829697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.088103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.107959 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a50869c-74a7-457e-9142-d535bf6f733c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1277 microversion: 2.1 time: 0.366963 Oct 04 20:52:21.109938 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1376/2785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:20 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1277 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:21.120577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d06f65a-c85d-4077-8d39-e93f6a5d2a05 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54fa4d70d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:21.153084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:21.234103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9d06f65a-c85d-4077-8d39-e93f6a5d2a05 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:21.245717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9d06f65a-c85d-4077-8d39-e93f6a5d2a05 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:21.486428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.504989 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93dbdeee-2754-489d-9f9f-7d30628868e0 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.721217 Oct 04 20:52:21.516508 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1410/2786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:20 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:21.525960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:21.532759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:21.549598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.551588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.553369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.554896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.556964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.558194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.568047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:21.619018 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d06f65a-c85d-4077-8d39-e93f6a5d2a05 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.506523 Oct 04 20:52:21.620246 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1377/2787] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:21 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:21.744983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1539bee5-b35f-412f-be7a-8371e24ea03c", "name": "network-vif-plugged", "status": "completed", "tag": "95750b97-010d-4656-8ea2-ee5ddcc5728f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:21.764714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.765720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.767954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.798462 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] Creating event network-vif-plugged:95750b97-010d-4656-8ea2-ee5ddcc5728f for instance 1539bee5-b35f-412f-be7a-8371e24ea03c on n-h1-851029-13 Oct 04 20:52:21.810509 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-814b9f3a-d6fa-4eb1-9600-6394723578cb req-45d3d3fd-0bf2-47ab-8077-cb4df764df45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188082 Oct 04 20:52:21.812034 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1378/2788] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:21.828563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:21.828563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:21.838174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.838824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.839648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.841004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.842048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.842856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.037360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.054289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84a0d598-03b5-4768-831f-81588c6702cb tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1473 microversion: 2.1 time: 0.535686 Oct 04 20:52:22.070781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1411/2789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:21 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:22.070781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.070781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:22.081954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.082942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.084016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.085358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.087167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.088057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.362591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.379923 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d71825c0-1c3c-46f3-8dfb-f810e3283654 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 0.565815 Oct 04 20:52:22.381111 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1379/2790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:21 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:22.391486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-314f95a4-0ba6-4b98-901c-5e314b885179 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f5dc8940>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.471358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-314f95a4-0ba6-4b98-901c-5e314b885179 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.087906 Oct 04 20:52:22.472470 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1380/2791] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:22.505152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.505152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:22.515443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.516332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.517140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.518550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.519496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.520248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.536037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.554270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.559775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.562693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0aa176d9-33bf-448f-8ef2-bf25ebda9f9b tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 0.504478 Oct 04 20:52:22.564304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1412/2792] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:22.573094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a2e9c7e-59e6-4739-acd1-3eedc04872ad", "tag": "40cd5a3d-ce14-4a96-8e61-34e80747498b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:22.600745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.602713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.603935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.626592 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] Creating event network-changed:40cd5a3d-ce14-4a96-8e61-34e80747498b for instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad on n-h1-851029-13 Oct 04 20:52:22.636561 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-10e32ebe-cdd3-4e4c-9a67-4f4591fb2383 req-a93661c6-f1ef-4a04-831a-2749384b248a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069527 Oct 04 20:52:22.637711 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1413/2793] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:22.648702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.654302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:22.663380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.664294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.665689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.667058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.667941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.668722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.937747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:22.957293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a282031-9d31-4f57-a941-36ac70d473fa tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.482574 Oct 04 20:52:22.971034 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1381/2794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:22.971034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.971034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:22.982917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.983862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.985406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.986177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.987122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.987958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.042180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.053495 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80fd0051-b7bb-41d8-9650-6d25f593bb26 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1523 microversion: 2.1 time: 0.413261 Oct 04 20:52:23.054584 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1414/2795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:23.064747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c96de83-bda1-4872-9993-92c582834bfd tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f581aca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:23.114870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.133822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-303f4e01-b72e-44bb-b747-9ea20390aeb0 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1265 microversion: 2.1 time: 0.172892 Oct 04 20:52:23.143514 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1382/2796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:23.148706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.150466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.162923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:23.165881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.166970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.169322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.169786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.170467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.171291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.187721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5c96de83-bda1-4872-9993-92c582834bfd tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:23.208548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5c96de83-bda1-4872-9993-92c582834bfd tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:23.546776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.570649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c8b61de-2799-44cc-905a-245875558195 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.432350 Oct 04 20:52:23.572328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1383/2797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:23.583793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.585301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.591101 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c96de83-bda1-4872-9993-92c582834bfd tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.532950 Oct 04 20:52:23.592772 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1415/2798] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:23 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:23.604165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.605864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.611616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.612562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.613418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.614768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.615637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.616453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.618590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.619540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.620371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.622061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.623030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.623768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.653762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:23.675240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Request method failure captured: Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd/ips/invalid HTTP/1.1 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJziSsNKBE2ncctLbWoJVyF1jkHg15fYob9oepRnwiPr4foTnQw_gbHL0efFw79BcnJczLz-PjYc8-cJrWn9Pyn6WEwDUaLP9-lHnJKkHdFGBbhnLShui0zbq4lTwUTm0yOYM7sJkIRDR028o-Yid3qOR70U6WcWzr9KxUoMc1LOnrk Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: cdffecda35014b7abc6aa680c92ed16d Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance is not a member of specified network Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'e7713309-3b55-43a9-819b-4f2a8ccbf8fd', 'id': 'invalid'} Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 20:52:23.681735 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:23.699040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Returning 404 to user: Instance is not a member of specified network {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:23.699040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9ce662e-b96d-4875-88cf-ea6414f85926 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.110464 Oct 04 20:52:23.699040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1384/2799] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd/ips/invalid => generated 91 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:23.699756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.700052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.710835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.712165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.712516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.713872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.714823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.715496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.620885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:24.637765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47150be5-b2ab-49e0-8a90-b5d444f7f2e9 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1473 microversion: 2.1 time: 1.042884 Oct 04 20:52:24.639382 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1416/2800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1473 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:24.650354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75a07e17-9e0c-47ac-99f0-a7674da6e610 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f7bc6700>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:24.762420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-75a07e17-9e0c-47ac-99f0-a7674da6e610 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:24.784302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-75a07e17-9e0c-47ac-99f0-a7674da6e610 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:25.047232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:25.438232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:25.464627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec117682-a4e4-45ea-b76f-8b4189705c6d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 1.776090 Oct 04 20:52:25.467225 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1385/2801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:25.482164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:25.484207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:25.512251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.513318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.514154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:25.515553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.516399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.518442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:25.683709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75a07e17-9e0c-47ac-99f0-a7674da6e610 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 64 microversion: 2.1 time: 1.041525 Oct 04 20:52:25.684892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1417/2802] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:24 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 64 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:25.694297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:25.695223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Failed to fetch instance by id 999 {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:52:25.696111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Request method failure captured: Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJziSsNKBE2ncctLbWoJVyF1jkHg15fYob9oepRnwiPr4foTnQw_gbHL0efFw79BcnJczLz-PjYc8-cJrWn9Pyn6WEwDUaLP9-lHnJKkHdFGBbhnLShui0zbq4lTwUTm0yOYM7sJkIRDR028o-Yid3qOR70U6WcWzr9KxUoMc1LOnrk Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: cdffecda35014b7abc6aa680c92ed16d Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 999 could not be found. Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': '999'} Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 20:52:25.697728 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:25.717593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Returning 404 to user: Instance 999 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:25.717593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5391968-501f-43cc-94c2-5f605edae70f tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012783 Oct 04 20:52:25.717593 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1418/2803] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:52:25 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:25.717593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:25.717593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:25.721201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.721866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.722433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:25.723319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.723826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.724798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.337940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:26.355223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:26.358468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:26.360887 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c15b66d8-fb10-4c19-9ab2-a86e866676b3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1362 microversion: 2.26 time: 0.890074 Oct 04 20:52:26.362003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1386/2804] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:25 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1362 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:26.371263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:26.372450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:26.407320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:26.407699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.408397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.409270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.410619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.426255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.427117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.445555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-90649161-9bb0-4b0c-966e-b9344fe9cc59 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.737320 Oct 04 20:52:26.459916 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1419/2805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:25 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:26.473943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:26.475639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:26.498600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.499937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.501049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.502855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.505465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.507697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.148631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:27.167956 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32d4a62d-1ae4-422f-8f8c-fb430dd9aa3b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.803397 Oct 04 20:52:27.183295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1387/2806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:26 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:27.194629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:27.199433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:27.203400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:27.218460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.219426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.220255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.222414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.223722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.224923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.230704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-172d7a20-24df-401a-b01f-4fcf7d7d7c09 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.764859 Oct 04 20:52:27.232358 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1420/2807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:26 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:27.264566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d07917b-54c6-449e-aa69-94c4aeedaad2 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f5744550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:27.362162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d07917b-54c6-449e-aa69-94c4aeedaad2 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.117282 Oct 04 20:52:27.364474 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1421/2808] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:52:27 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 64 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:27.378862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:27.380691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:27.394500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.395596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.396412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.398049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.399001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.399805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.476703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:27.818798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:27.861261 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4543272-790d-48af-b87c-4176e45cefed tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1479 microversion: 2.1 time: 0.682992 Oct 04 20:52:27.862555 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1388/2809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:27 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1479 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:27.881379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:27.882739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:27.896653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.897863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.899578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.901301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.902783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.904084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.987697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f528185c-ddfa-413b-aca0-382c045b2110 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 204 len: 0 microversion: 2.1 time: 0.620199 Oct 04 20:52:27.989207 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1422/2810] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:27 2022] DELETE /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:27.999469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c06082fb-a408-44c5-8d13-b9e13fe1fd73 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f5fe3f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:28.099940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c06082fb-a408-44c5-8d13-b9e13fe1fd73 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:28.113496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c06082fb-a408-44c5-8d13-b9e13fe1fd73 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:28.213507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.234508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5676849-56ad-4c30-87b4-726dc0ac4a5f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 0.366612 Oct 04 20:52:28.234508 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1389/2811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:27 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:28.274491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.280853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.296825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.298312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.300064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.303769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.305163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.306474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.616233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.639542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.643626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.647576 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7d2edb2-2ebf-470f-9671-7151dcc5adcb tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1547 microversion: 2.26 time: 0.398736 Oct 04 20:52:28.649099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1390/2812] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1547 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:28.660451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.661428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.675582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.677688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.679580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.682093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.683418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.684575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.912954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.929097 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5af1ed7e-ff8e-4cc5-97f7-db644df3aacb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.277347 Oct 04 20:52:28.931124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1391/2813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:28.940386 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c06082fb-a408-44c5-8d13-b9e13fe1fd73 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.948765 Oct 04 20:52:28.941268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.941610 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1423/2814] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:27 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:28.942731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.954940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.955829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.956614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.957949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.958814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.958954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.959612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.960491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.974778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.976262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.977787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.979269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.980160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.985376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.309014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:29.322257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:29.334424 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9de99774-c297-46d8-990a-f76ca5a85c73 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1529 microversion: 2.1 time: 0.401383 Oct 04 20:52:29.348232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1392/2815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1529 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:29.348587 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15bb9783-e065-4f7a-aa49-7442d8ac7e35 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.389042 Oct 04 20:52:29.348764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:29.348764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:29.352495 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1424/2816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:29.358152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.359124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.359932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.360912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.362034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.363430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.373211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454b444d-e131-4d4d-bca9-1d4849cac8a7", "tag": "a451742e-7377-4f45-9199-344c3e0f5e50"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:29.390298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.391063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.391852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.412286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] Creating event network-changed:a451742e-7377-4f45-9199-344c3e0f5e50 for instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 on n-h1-851029-13 Oct 04 20:52:29.422358 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-03c150a5-9020-4090-8130-a536b5d41b90 req-6c6744de-b0c5-4eba-b909-b17a693ced0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059242 Oct 04 20:52:29.424134 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1425/2817] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:29.435657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "name": "network-vif-unplugged", "status": "completed", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:29.454849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.456035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.456909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.485942 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] Creating event network-vif-unplugged:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:52:29.495952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5d6ae086-abc8-4514-8107-c9555eca92bb req-b264bafc-1633-42a5-8fae-6edaf3ae8673 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068702 Oct 04 20:52:29.497171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1426/2818] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:29.507990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f581aca0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:29.529683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.531094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.532280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.534075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:29.547335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.548672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.549863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.551774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.553094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.554396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.625554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.626735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.627909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.676569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.677499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.682499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.704713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:29.717668 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78a42b86-c608-40aa-a509-d540f3c3ea86 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.380583 Oct 04 20:52:29.718735 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1393/2819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:29 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:29.735794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:29.737195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:29.754699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.756067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.757099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.759343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.760457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.761547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.882846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:29.949348 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdf92c6b-5c8a-4227-9abf-01aaf336391f tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-423393466" status: 201 len: 0 microversion: 2.26 time: 0.449800 Oct 04 20:52:29.952241 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1427/2820] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 4 20:52:29 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-423393466 => generated 0 bytes in 454 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 20:52:29.964944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36773504-0161-415b-a3bb-3e027eaa3678 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update', calling method: .version_select at 0x7f54f5fbd550>, body: {"meta": {"os_version": "alt"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:30.072695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:30.088397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3cae2f7-1c3b-46d9-9fd1-c187e04c276a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1479 microversion: 2.1 time: 0.363000 Oct 04 20:52:30.103042 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1394/2821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:29 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1479 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:30.103042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.103042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:30.115846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.117288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.122844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.122844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.122844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.122844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.134591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-36773504-0161-415b-a3bb-3e027eaa3678 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:30.159255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-36773504-0161-415b-a3bb-3e027eaa3678 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:30.810157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:30.839848 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad198a07-2a25-43f7-b39c-76947217a630 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 0.743448 Oct 04 20:52:30.846705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1395/2822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:30.857026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04e60f6f-da19-4a4d-b7b0-11db5e204a25 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f626f0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.892645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04e60f6f-da19-4a4d-b7b0-11db5e204a25 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.893538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04e60f6f-da19-4a4d-b7b0-11db5e204a25 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.900954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04e60f6f-da19-4a4d-b7b0-11db5e204a25 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.966391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36773504-0161-415b-a3bb-3e027eaa3678 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.011259 Oct 04 20:52:30.969068 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1428/2823] 10.222.0.36 () {60 vars in 1313 bytes} [Tue Oct 4 20:52:29 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata/os_version => generated 31 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:30.971484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04e60f6f-da19-4a4d-b7b0-11db5e204a25 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-423393466" status: 204 len: 0 microversion: 2.26 time: 0.122482 Oct 04 20:52:30.972653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1396/2824] 10.222.0.36 () {60 vars in 1358 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-423393466 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:30.992629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.997039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:30.997895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.999481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:31.014179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.016583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.018035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.019839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.023277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.025101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.026474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.027594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.028025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.029004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.030115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.031088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.257404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:31.386970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdffecda35014b7abc6aa680c92ed16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc16419d68e4e3a8742af2ded2087d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:31.417751 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1c773d7-c821-46a3-8fd9-3ded4b650ab9 tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 200 len: 1487 microversion: 2.1 time: 0.436590 Oct 04 20:52:31.419919 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1397/2825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 1487 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:31.431682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:31.440283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:31.447749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.449234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.450470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.452532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.453926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.455289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.044584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:32.083611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff8f3ed6-1a5f-4688-af11-2a02131b071d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 1.110750 Oct 04 20:52:32.102709 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1429/2826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:32.102709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:32.108889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:32.121076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.122040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.122892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.128189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.129413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.130750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.334626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:32.369575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74379148-95b3-4363-ae45-998c7e31e862 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.947248 Oct 04 20:52:32.371591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1398/2827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:31 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:32.394993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afb54e0e-226d-47c9-a6e8-b44267b98796 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54fa576280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:32.501645 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afb54e0e-226d-47c9-a6e8-b44267b98796 tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.127732 Oct 04 20:52:32.505121 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1399/2828] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:52:32 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 58 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:32.530004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5dc8d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:32.557511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.571455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.571455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.571455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:32.602616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.604481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.606419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.613203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.614119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.614999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.720960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.731739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.733998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.918767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:32.967506 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f216c113-84fb-4073-844c-9cffef5ae543 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 204 len: 0 microversion: 2.26 time: 0.450941 Oct 04 20:52:32.969279 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1400/2829] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 4 20:52:32 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:32.989106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7713309-3b55-43a9-819b-4f2a8ccbf8fd", "name": "network-vif-deleted", "tag": "b5d5dd82-aec1-4848-9f7b-b20639a70570"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:33.035995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.037460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.038766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.077753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] Creating event network-vif-deleted:b5d5dd82-aec1-4848-9f7b-b20639a70570 for instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd on n-h2-851029-13 Oct 04 20:52:33.097290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a45b7573-c972-4edf-80a2-a1f67ac1e829 req-2a94e1fa-89dc-4d88-9e57-a331410b5cbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124221 Oct 04 20:52:33.098838 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1401/2830] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:33.108731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:33.110541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:33.126011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.127789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.129235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.131094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.133071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.136121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.270892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:33.295189 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f60fb035-96d8-4c81-87f0-25d5857c2fd9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 1.199144 Oct 04 20:52:33.306729 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1430/2831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:32 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:33.314384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-plugged", "status": "completed", "tag": "bb7bf376-2005-47e5-9717-75df91868c15"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:33.357663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.362267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.362267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.393323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] Creating event network-vif-plugged:bb7bf376-2005-47e5-9717-75df91868c15 for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:33.410063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3eaf4970-34fd-44cc-8cab-ec5b0744a7a9 req-78709597-cf06-40e1-9a20-ffba76c695bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109529 Oct 04 20:52:33.413194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1431/2832] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:33.424489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:33.429278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:33.441900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.442815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.443805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.447319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.448224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.449493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.475630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:34.506894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-390f3aff-7a47-4593-b6ae-baccc73f9d86 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1479 microversion: 2.1 time: 1.405219 Oct 04 20:52:34.527234 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1402/2833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:33 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1479 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:34.584385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:34.587783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] [instance: e7713309-3b55-43a9-819b-4f2a8ccbf8fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:34.601105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.603547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.604868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.607912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.609432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.610529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.670359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:34.674260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] HTTP exception thrown: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Request method failure captured: Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd HTTP/1.1 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJziSsNKBE2ncctLbWoJVyF1jkHg15fYob9oepRnwiPr4foTnQw_gbHL0efFw79BcnJczLz-PjYc8-cJrWn9Pyn6WEwDUaLP9-lHnJKkHdFGBbhnLShui0zbq4lTwUTm0yOYM7sJkIRDR028o-Yid3qOR70U6WcWzr9KxUoMc1LOnrk Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2bc16419d68e4e3a8742af2ded2087d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2bc16419d68e4e3a8742af2ded2087d1 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429744496 Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: cdffecda35014b7abc6aa680c92ed16d Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429744496-project Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e7713309-3b55-43a9-819b-4f2a8ccbf8fd'} Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:34.679226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. Oct 04 20:52:34.689246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:34.692019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] Returning 404 to user: Instance e7713309-3b55-43a9-819b-4f2a8ccbf8fd could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:34.694459 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fbd72b37-dc6d-46f8-8c88-d79052ecb82c tempest-ServerAddressesNegativeTestJSON-1429744496 tempest-ServerAddressesNegativeTestJSON-1429744496-project] 10.222.0.36 "GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd" status: 404 len: 111 microversion: 2.1 time: 0.164882 Oct 04 20:52:34.696586 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1403/2834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:34 2022] GET /compute/v2.1/servers/e7713309-3b55-43a9-819b-4f2a8ccbf8fd => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:34.706180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:34.721478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:34.724997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d39402a-df24-4e0a-ba48-f60051f2c84c tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'update_all', calling method: .version_select at 0x7f54f6270dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:34.743761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ebba7973-eb4b-48d6-abe8-96eac9ff18c8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1530 microversion: 2.1 time: 1.327619 Oct 04 20:52:34.745145 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1432/2835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:33 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1530 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:34.762450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a3ad6c8-604c-410d-be9b-61af9362cdf3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5744af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:34.791370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a3ad6c8-604c-410d-be9b-61af9362cdf3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.797970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a3ad6c8-604c-410d-be9b-61af9362cdf3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.800426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a3ad6c8-604c-410d-be9b-61af9362cdf3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.837611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a3ad6c8-604c-410d-be9b-61af9362cdf3 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 12 microversion: 2.26 time: 0.089478 Oct 04 20:52:34.839668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1433/2836] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:52:34 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 12 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:34.851862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:34.854852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:34.869348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.871090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.872274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.874179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.875567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.876925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.896223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-4d39402a-df24-4e0a-ba48-f60051f2c84c tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:34.928509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-4d39402a-df24-4e0a-ba48-f60051f2c84c tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:35.441197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:35.486081 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b185e241-2192-46af-b05a-115dee053c1d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.643255 Oct 04 20:52:35.487996 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1434/2837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:34 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:35.508642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:35.511274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:35.552778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.559676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.562469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.566931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.570455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.576357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.987318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:36.016646 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-669e2209-da1c-48d1-b41d-0fa4d1e14c19 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.526152 Oct 04 20:52:36.017653 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1435/2838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:35 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:36.028949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d39402a-df24-4e0a-ba48-f60051f2c84c tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 61 microversion: 2.1 time: 1.329766 Oct 04 20:52:36.032437 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1404/2839] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:34 2022] PUT /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 61 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:36.035744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:36.036843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.044500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f629cf70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:36.069577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.070183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.070403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.071102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.072035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.073293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.075493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.077163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.078375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.079596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.094167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.095765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.104792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.104792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.104792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.104792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.163470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.164987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.165825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.186200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.187195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.188301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.333379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:36.407456 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d26e268-b4c7-44de-b208-6d266ba21df6 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-375529787" status: 201 len: 0 microversion: 2.26 time: 0.372056 Oct 04 20:52:36.419374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1405/2840] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 4 20:52:36 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-375529787 => generated 0 bytes in 386 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 20:52:36.429990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:36.431299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.435124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:36.444465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.445920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.447926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.449550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.451585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.452507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.461953 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4dced70c-aad8-455c-b5e1-6b714cf6068b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.437165 Oct 04 20:52:36.463423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1436/2841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:36 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:36.478143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-plugged", "status": "completed", "tag": "fea51754-6700-468e-b053-4913538fbebf"}, {"server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "name": "network-vif-plugged", "status": "completed", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}, {"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-plugged", "status": "completed", "tag": "e51954d1-891b-4dd1-91e2-a94131d8bb6f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.502877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.504574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.505872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.543843 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Creating event network-vif-plugged:fea51754-6700-468e-b053-4913538fbebf for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:36.545326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Creating event network-vif-plugged:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:52:36.547839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] Creating event network-vif-plugged:e51954d1-891b-4dd1-91e2-a94131d8bb6f for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:36.602777 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9ba85bb2-4de7-4c34-885e-bcbd4ac54850 req-a1b21167-aa33-48d7-8baa-72fa04567e64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.132241 Oct 04 20:52:36.602777 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1437/2842] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:36.615475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:36.617635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.638236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.639798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.641034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.643332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.644596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.645962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.905644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:36.939120 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62bbc235-40db-43fa-bf30-215466967944 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1479 microversion: 2.1 time: 0.517532 Oct 04 20:52:36.959446 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1406/2843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:36 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1479 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:36.989060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8a886309-fe54-42c1-aac6-765ea588e53f tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Action: 'create', calling method: .version_select at 0x7f54f6211940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:37.135999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:37.144182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8a886309-fe54-42c1-aac6-765ea588e53f tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:37.158691 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b6977dc-9c26-4b6d-a26e-21dee9f35a05 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.553298 Oct 04 20:52:37.166976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1438/2844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:36 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:37.188884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8a886309-fe54-42c1-aac6-765ea588e53f tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Getting quotas for user e60e722a5ae2422da291938ac22e8cfc and project 31628b08c0c6458aaccb8beba59c30be. Resources: dict_keys(['metadata_items']) {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:37.205115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51a4f0cc-2158-44e1-b24b-eb4ac4ad8804 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5767e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:37.256238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51a4f0cc-2158-44e1-b24b-eb4ac4ad8804 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.272629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51a4f0cc-2158-44e1-b24b-eb4ac4ad8804 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.273737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51a4f0cc-2158-44e1-b24b-eb4ac4ad8804 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.300799 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51a4f0cc-2158-44e1-b24b-eb4ac4ad8804 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 35 microversion: 2.26 time: 0.109675 Oct 04 20:52:37.310729 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1439/2845] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:52:37 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 35 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:37.315894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:37.315894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:37.327048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.328054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.338442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.340187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.341663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.342631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.000143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:38.027284 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6f2381c-0b25-467d-b735-3d0211f7c8cb tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1355 microversion: 2.1 time: 0.716495 Oct 04 20:52:38.051761 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1440/2846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:37 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1355 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:38.073943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:38.087244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:38.114080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.115988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.117326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.119306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.120525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.126536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.512548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8a886309-fe54-42c1-aac6-765ea588e53f tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "POST /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 85 microversion: 2.1 time: 1.545345 Oct 04 20:52:38.515069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1407/2847] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 85 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:38.538508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f626f5e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:38.585856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.587917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.590365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.591761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:38.592003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:38.616866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00983ff3-cc61-4992-9baa-146a060f7ee6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.561298 Oct 04 20:52:38.616866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1441/2848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:38 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:38.626856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:38.628716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:38.629328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.631191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.633992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.641682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.643239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.645769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.654355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:38.668964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.668964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.670513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.671848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.672733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.673492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.745294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:38.746316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:38.747272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:38.993208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:39.061935 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0bd0e3ed-a437-438b-837c-fb818c0d4c65 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-375529787" status: 204 len: 0 microversion: 2.26 time: 0.541809 Oct 04 20:52:39.069150 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1408/2849] 10.222.0.36 () {60 vars in 1361 bytes} [Tue Oct 4 20:52:38 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-375529787 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:39.094972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.099487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:39.145292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.150742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.151514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.154686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.155548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.156328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.169323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:39.230945 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfb9b548-6253-440c-925f-bf60404e8b80 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.611082 Oct 04 20:52:39.240285 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1442/2850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:38 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:39.278809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.301607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:39.332876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.333919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.334800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.337662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.342485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.344031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.617547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:39.647644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf381e76-ee41-4aa2-b494-d3b849a565a4 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1464 microversion: 2.1 time: 0.581520 Oct 04 20:52:39.656985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1409/2851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1464 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:39.682016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b951c601-1411-435b-9a04-89f083a0539e tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] Calling method '.version_select at 0x7f54f6b209d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.909500 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b951c601-1411-435b-9a04-89f083a0539e tempest-ImagesMetadataTestJSON-1904244596 tempest-ImagesMetadataTestJSON-1904244596-project] 10.222.0.36 "GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.245982 Oct 04 20:52:39.912803 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1410/2852] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/images/f9e82ecb-c166-49a3-a874-0e38407ce37c/metadata => generated 85 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:52:39.944304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2e9c7e-59e6-4739-acd1-3eedc04872ad", "name": "network-vif-plugged", "status": "completed", "tag": "40cd5a3d-ce14-4a96-8e61-34e80747498b"}, {"server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:40.025383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:40.046261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75ba81a0-89a7-4764-b67a-ff747beb0f17 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.802486 Oct 04 20:52:40.062755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.063052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1443/2853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:40.063258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.063258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.082185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.082994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:40.113573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.121039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.122266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.124143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.124967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.130931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.177216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Creating event network-vif-plugged:40cd5a3d-ce14-4a96-8e61-34e80747498b for instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad on n-h1-851029-13 Oct 04 20:52:40.178300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] Creating event network-vif-plugged:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:52:40.209411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=19 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:40.255405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-be083517-2d67-4d1f-b6d1-6c5d264ce6a8 req-8db21eea-b771-4be6-a344-b2bf7988d214 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.322205 Oct 04 20:52:40.256647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1411/2854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:40.302553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08c85ed3-c203-4c87-a6c5-214c785a11f8 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f6761310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.375000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08c85ed3-c203-4c87-a6c5-214c785a11f8 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.381978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08c85ed3-c203-4c87-a6c5-214c785a11f8 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.385864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08c85ed3-c203-4c87-a6c5-214c785a11f8 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.421775 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08c85ed3-c203-4c87-a6c5-214c785a11f8 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 12 microversion: 2.26 time: 0.153936 Oct 04 20:52:40.423285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1412/2855] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:52:40 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 12 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:40.434442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.436304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:40.454334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.455343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.456169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.457809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.459301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.460018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.980341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:41.009252 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32d0396a-af89-4519-b159-27b004d58948 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1805 microversion: 2.1 time: 0.950495 Oct 04 20:52:41.024405 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1444/2856] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:40 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1805 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:41.038731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:41.056160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:41.074840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.088963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.089834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.095032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.096394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.098987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.386046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:41.407814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2794452f-b7df-4166-b342-78c0a689d971 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.981789 Oct 04 20:52:41.424860 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1413/2857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:40 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:41.452578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:41.454035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:41.481086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.482224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.484169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.485562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.487416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.488260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.737406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da0921d6-b208-46b5-bb12-819669332606 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 0 microversion: 2.1 time: 0.709846 Oct 04 20:52:41.738790 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1445/2858] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:41 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:41.772733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f56bedc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:41.798360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.801095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.803021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.804289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:41.821478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.822291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.824058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.826318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.827786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.830710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.886275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.887977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.889493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.916162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:41.950471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46fddc1b-26aa-47a9-8f98-4e21d1a2196a tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 204 len: 0 microversion: 2.26 time: 0.202507 Oct 04 20:52:41.952768 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1446/2859] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 4 20:52:41 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:41.964621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:41.966272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:41.980939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.982745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.983502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.985156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.990982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.990982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.050235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ba39a89-768a-43be-8695-633619d113ad tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059/ips" status: 200 len: 218 microversion: 2.1 time: 0.094944 Oct 04 20:52:42.053557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1447/2860] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 20:52:41 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059/ips => generated 218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:42.067205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:42.069608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:42.074289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:42.086880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.088345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.089527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.093757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.093757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.093757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.094206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d15b83d-62ab-43e3-9b93-4b68f990aeeb tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1402 microversion: 2.1 time: 0.665557 Oct 04 20:52:42.111283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1414/2861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:41 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1402 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:42.131621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:42.133553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:42.148302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.149233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.150458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.152103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.153498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.154631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.251071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.252354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.253486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.254886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lazy-loading 'fault' on Instance uuid 7c2310d4-398a-4ac8-92be-ba2fc037716e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:42.823359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:42.847567 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-976cc1bc-6011-4696-a2c7-4f0094a5fe06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.790512 Oct 04 20:52:42.849502 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1448/2862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:42 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:42.869863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f58053a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:42.912091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.915520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.916717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.917912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:42.934012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.935781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.937328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.938487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.939832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.940729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.007853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:43.022286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.022286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.034589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.076070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.078253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.082753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.168892 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe4d41a1-c19c-47e0-996e-59b95914a761 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1600 microversion: 2.1 time: 1.055510 Oct 04 20:52:43.175436 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1415/2863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:42 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1600 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:43.202156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:43.205666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:43.238973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.240755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.248919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.250916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.255481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.258894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.301973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:43.356939 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-646685fe-17c7-463d-8657-7dcac8694605 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-392030122" status: 201 len: 0 microversion: 2.26 time: 0.504527 Oct 04 20:52:43.359059 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1449/2864] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 4 20:52:42 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-392030122 => generated 0 bytes in 508 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 20:52:43.373193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:43.375351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:43.377344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:43.395389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.397696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.399146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.401238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.403866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.406941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.976205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:43.992823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86b100d7-3e91-4952-b95a-158fad70896a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 0.630567 Oct 04 20:52:44.008615 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1450/2865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:43 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:44.015199 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77e2b0ab-2b2b-451b-a990-08d4227db76a tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 204 len: 0 microversion: 2.1 time: 0.830935 Oct 04 20:52:44.016462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1416/2866] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:43 2022] DELETE /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:44.034724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:44.042555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:44.055835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:44.056919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:44.057115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.058421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.059725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.061655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.064473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.065883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.073638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.074607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.075446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.076741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.077737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.078315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.635389 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f834c4e9-d34e-4ca1-a367-ed51106a734f tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action" status: 202 len: 0 microversion: 2.1 time: 0.615819 Oct 04 20:52:44.636561 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1417/2867] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:44 2022] POST /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:44.653414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f628b8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:44.678833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.680273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.681206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.682089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:44.696483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.697380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.698615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.700258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.701375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.704418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.740491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:44.775882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.777156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.778224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:44.778847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.799737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.800642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.801468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.803419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16db486f-c630-4390-af4b-8660a14dbe5b tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1589 microversion: 2.1 time: 0.792762 Oct 04 20:52:44.840166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1451/2868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:44 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1589 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:44.853423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454b444d-e131-4d4d-bca9-1d4849cac8a7", "name": "network-vif-plugged", "status": "completed", "tag": "a451742e-7377-4f45-9199-344c3e0f5e50"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:44.873005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.874809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.876067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.919352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] Creating event network-vif-plugged:a451742e-7377-4f45-9199-344c3e0f5e50 for instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 on n-h1-851029-13 Oct 04 20:52:44.930992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8659ffee-d7e6-4c46-b830-1a21d66099ee req-d5558b3f-31af-4ff5-b1dc-6d940dc39007 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087372 Oct 04 20:52:44.932895 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1452/2869] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:44.946634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:44.946634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:44.958486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.958902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.959652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:44.960930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:44.961764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:44.962390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.005137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:45.072618 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ccfcadcf-dd04-44e3-a2a8-9e1dc0d09981 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-816095397" status: 201 len: 0 microversion: 2.26 time: 0.434011 Oct 04 20:52:45.074833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1418/2870] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 4 20:52:44 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-816095397 => generated 0 bytes in 437 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 20:52:45.085395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:45.089644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:45.105794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.106627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.107649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.108719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.109389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.110016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.698358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:45.723831 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f87191af-27b8-4c03-a595-ad6aebb77c2e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.788756 Oct 04 20:52:45.724750 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1453/2871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:44 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:45.746359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:45.747702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:45.772781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.773817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.774734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.776172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.777110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.778204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.995429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:46.013151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b381ded1-4d09-445d-bc9d-012bedbadb9d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1811 microversion: 2.1 time: 0.935573 Oct 04 20:52:46.021502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1419/2872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:45 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1811 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:46.038415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.040506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:46.071373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.072228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.072984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.074300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.075178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.083807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.398394 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48340ba3-1604-449d-888f-75daee9e6088 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.374299 Oct 04 20:52:46.400395 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1420/2873] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:52:46 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad/os-interface => generated 285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:46.429182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.431195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:46.444210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:46.448309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.449731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.451201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.454772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.456208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.457242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.773774 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-df765a60-418f-425e-9575-3d941eba0490 tempest-ServersAdminTestJSON-1970814277 tempest-ServersAdminTestJSON-1970814277-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1617 microversion: 2.1 time: 1.038061 Oct 04 20:52:46.773774 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1454/2874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:45 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1617 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:46.797438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5866280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:46.839081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.840084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.840941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.841969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:46.878347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.885719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.885719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.892727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:46.892727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:46.892727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.065011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.066375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.067347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.221595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:47.236700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:47.347840 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-732b49e0-876b-431a-b855-896d4297b40d tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 204 len: 0 microversion: 2.26 time: 0.567187 Oct 04 20:52:47.350549 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1455/2875] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 4 20:52:46 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:47.377424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:47.378832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:47.403390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.406050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.406050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.406916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.407777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.408672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.728294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:47.774768 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0211a938-9f21-40a3-ac5e-c3697eeb0c0f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1307 microversion: 2.1 time: 1.371258 Oct 04 20:52:47.812221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1421/2876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:46 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1307 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:47.828378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:47.829511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:47.844302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.845135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.845966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.847526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.848485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.849328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.939998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:48.346485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:48.378347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8aefd1e7-f9e5-4109-8182-897d34b70724 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.024762 Oct 04 20:52:48.384254 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1456/2877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:47 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:48.404484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:48.405380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:48.442266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:48.449539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:48.451182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:48.452960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:48.461450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:48.463208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:48.632492 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac465837-7fcd-4d4a-ad4b-3c3add9aff14 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 204 len: 0 microversion: 2.1 time: 0.817753 Oct 04 20:52:48.635273 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1422/2878] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:47 2022] DELETE /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:48.660629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c201fa3d-2e50-4024-90b2-71a27a25ebee tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5e06430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:48.691311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c201fa3d-2e50-4024-90b2-71a27a25ebee tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:48.692235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c201fa3d-2e50-4024-90b2-71a27a25ebee tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:48.693106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c201fa3d-2e50-4024-90b2-71a27a25ebee tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:48.723792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c201fa3d-2e50-4024-90b2-71a27a25ebee tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 12 microversion: 2.26 time: 0.082888 Oct 04 20:52:48.723792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1423/2879] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:52:48 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 12 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:49.157928 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2ac9140-f1f0-46b8-ab49-8823837e066c tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.433237 Oct 04 20:52:49.170714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1424/2880] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 4 20:52:48 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:52:49.181196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:49.183568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:49.208837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.209839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.211322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.218463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.219538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.220251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.454812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:49.503391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11fb4db9-2044-4402-9761-375870cf579b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1811 microversion: 2.1 time: 1.116390 Oct 04 20:52:49.514269 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1457/2881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:48 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1811 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:49.533578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f57155e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:49.613642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.619545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.622221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.625323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:49.671078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.672170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.673284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.675643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.676570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.677407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.748995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.750042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.751372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.780540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:49.872554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c7b747a-8311-4e37-b346-6676fa8cb649 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 204 len: 0 microversion: 2.26 time: 0.356105 Oct 04 20:52:49.881026 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1458/2882] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 4 20:52:49 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:49.913723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:49.923705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:49.948542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.949368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.950333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.955620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.963865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.964573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.377597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:51.406895 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a1f5c3a-d740-4e24-a312-c2f6b014b77d tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 200 len: 1470 microversion: 2.1 time: 2.233558 Oct 04 20:52:51.416065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1425/2883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:49 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 1470 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:51.443412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fa11f88-2af2-4d1a-8a43-b2f29d76eb80 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Calling method '.version_select at 0x7f54f62df5e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:51.504176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9fa11f88-2af2-4d1a-8a43-b2f29d76eb80 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] HTTP exception thrown: Image not found. Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fa11f88-2af2-4d1a-8a43-b2f29d76eb80 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Request method failure captured: Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ0fFQfnAinXBhcZ5FG94Xh8p1SHntUDVvO2-426QzhwGLrbLWdpCoTBJpSjmmZ2vTwqUSq_gdewSve_aEn6Q8Y_2rsPxzRuV885T6GqBPW_wInwcWi9AjfWs19TZdTzl1a2F3rF148hNC5Zjr_khFkt1rxYPJc9rlT97OYYU97xUvc Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5ace2861d6694248ad0c9377755ee488 Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '-1'} Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.509087 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:51.518444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.521902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fa11f88-2af2-4d1a-8a43-b2f29d76eb80 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:51.524223 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fa11f88-2af2-4d1a-8a43-b2f29d76eb80 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.105912 Oct 04 20:52:51.526247 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1426/2884] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 4 20:52:51 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:51.545169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-deleted", "tag": "bb7bf376-2005-47e5-9717-75df91868c15"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:51.566940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.568363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.569462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.594947 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] Creating event network-vif-deleted:bb7bf376-2005-47e5-9717-75df91868c15 for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:51.609722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bb465b7b-bf9f-48c9-9a06-178443b9f154 req-991113c6-1327-4b70-aa6c-14541d650e4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079709 Oct 04 20:52:51.611574 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1427/2885] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:51.626073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:51.628861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:51.642166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.643933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.645947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.647897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.649356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.650528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.428195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:52.463924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:52.464845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-805e178c-8fa7-4ffc-b3a2-11bb7a7d7c9e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.849916 Oct 04 20:52:52.474747 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1428/2886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:51 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:52.479794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-unplugged", "status": "completed", "tag": "fea51754-6700-468e-b053-4913538fbebf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:52.497408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.498290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.499236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.511472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64ab0fe5-a942-42af-9f09-4fda6658e58c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1487 microversion: 2.1 time: 2.635709 Oct 04 20:52:52.521648 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1459/2887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:49 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1487 bytes in 2647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:52.563071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5f20940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:52.591650 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] Creating event network-vif-unplugged:fea51754-6700-468e-b053-4913538fbebf for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:52.614092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ea010b08-b1a5-4c41-bb77-4abca830d771 req-9ffda23b-0ab9-4aec-b033-b16ccf3c2cd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146435 Oct 04 20:52:52.632950 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1429/2888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:52.633146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.634165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.636880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.638021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:52.639077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:52.646914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:52.669986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.672420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.674485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.678695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.683920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.684611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.684772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.684948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.685111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.685267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.685267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.685267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.827818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.829834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.838904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.864459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.865830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.867337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.102738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:53.169584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff8f9a94-01cb-4c71-b9a4-489425740b54 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-1528029183" status: 201 len: 0 microversion: 2.26 time: 0.645936 Oct 04 20:52:53.173617 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1460/2889] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 4 20:52:52 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-1528029183 => generated 0 bytes in 651 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 20:52:53.201731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a2e9c7e-59e6-4739-acd1-3eedc04872ad", "tag": "40cd5a3d-ce14-4a96-8e61-34e80747498b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:53.240734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:53.241644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:53.247450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.305866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] Creating event network-changed:40cd5a3d-ce14-4a96-8e61-34e80747498b for instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad on n-h1-851029-13 Oct 04 20:52:53.330589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7524ef69-fc3e-421b-b4a9-240974093eab req-50ba2ea9-5b52-42e6-894f-1787f4061cc8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150610 Oct 04 20:52:53.336359 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1461/2890] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:53.365247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:53.367412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:53.415083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:53.418079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:53.422085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.426127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:53.426127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:53.426127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.774490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:53.812463 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0342e695-fd54-4699-9732-807c30acd91c tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1589 microversion: 2.1 time: 1.182802 Oct 04 20:52:53.813524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1430/2891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:52 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1589 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:53.847090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13ca445a-0d04-4a22-a0a1-178c3490b505 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Calling method '.version_select at 0x7f54f628b280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:53.920661 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-13ca445a-0d04-4a22-a0a1-178c3490b505 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] HTTP exception thrown: Image not found. Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13ca445a-0d04-4a22-a0a1-178c3490b505 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Request method failure captured: Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/3bcc2b18-35df-4c10-846f-e96caf9e33ej HTTP/1.1 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ0fFQfnAinXBhcZ5FG94Xh8p1SHntUDVvO2-426QzhwGLrbLWdpCoTBJpSjmmZ2vTwqUSq_gdewSve_aEn6Q8Y_2rsPxzRuV885T6GqBPW_wInwcWi9AjfWs19TZdTzl1a2F3rF148hNC5Zjr_khFkt1rxYPJc9rlT97OYYU97xUvc Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5ace2861d6694248ad0c9377755ee488 Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '3bcc2b18-35df-4c10-846f-e96caf9e33ej'} Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3bcc2b18-35df-4c10-846f-e96caf9e33ej to delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3bcc2b18-35df-4c10-846f-e96caf9e33ej could not be found. Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:53.930952 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13ca445a-0d04-4a22-a0a1-178c3490b505 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13ca445a-0d04-4a22-a0a1-178c3490b505 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/3bcc2b18-35df-4c10-846f-e96caf9e33ej" status: 404 len: 62 microversion: 2.1 time: 0.106908 Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1431/2892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:53 2022] DELETE /compute/v2.1/images/3bcc2b18-35df-4c10-846f-e96caf9e33ej => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:53.946750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: b1415286-bc50-4e97-bd46-46991817af7a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:53.956276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:53.957938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:53.958501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.959740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:53.961575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:53.962372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.995318 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] HTTP exception thrown: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Request method failure captured: Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a HTTP/1.1 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJxPkbrIl4ZbhV4fU3c4u_JGDWBiPmXwlTxGYwL5fjIuIItBnOhm7cGRLBG7GdwQ5zYPbvf6GKKh-kEdY-H0m4fYQ29QIDt6KyLY049SNyEu6VFy7u0AL5xHwe0jbLPwtkZvLqJzpLadosjcc0wmA4iqIWa6QF3d8wMdK_YqOnW1g60 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9aa22e4620dc4028b22512a283c561cd Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b1415286-bc50-4e97-bd46-46991817af7a'} Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:53.998558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Returning 404 to user: Instance b1415286-bc50-4e97-bd46-46991817af7a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-551fbad4-6910-4ad1-8668-57271f3e2a3b tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a" status: 404 len: 111 microversion: 2.1 time: 0.063453 Oct 04 20:52:54.009763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1432/2893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:53 2022] GET /compute/v2.1/servers/b1415286-bc50-4e97-bd46-46991817af7a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:54.016796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-71761072"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:54.020907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:54.035044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.036276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.044222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.049763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.049763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.049763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.568531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:54.602059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:54.607617 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cbc915b0-7885-431f-868b-afe216216258 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1611 microversion: 2.1 time: 1.264788 Oct 04 20:52:54.610555 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1462/2894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:53 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1611 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:54.649886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f5805430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:54.700015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.700957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.701732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.706983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:54.717037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.718967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.720290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.722044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.725404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.726876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.818827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.820873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.822080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.855046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.857317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.859020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.086500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:55.198492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0e830f44-5a53-4362-83b2-d6669b99e9dd tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-1650643818" status: 201 len: 0 microversion: 2.26 time: 0.585683 Oct 04 20:52:55.200000 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1463/2895] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 4 20:52:54 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags/tempest-tag-1650643818 => generated 0 bytes in 589 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 20:52:55.206944 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a754e264-036b-461e-9321-7d6caf700696 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "POST /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7/action" status: 202 len: 0 microversion: 2.1 time: 1.197437 Oct 04 20:52:55.218610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1433/2896] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:54 2022] POST /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:52:55.230350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:55.232517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:55.233336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33c9e80d-61f7-4c2a-896b-94019820bec9 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Calling method '.version_select at 0x7f54f654bee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:55.258727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:55.259776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:55.260521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.261877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:55.264935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:55.270512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.304692 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-33c9e80d-61f7-4c2a-896b-94019820bec9 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] HTTP exception thrown: Image not found. Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33c9e80d-61f7-4c2a-896b-94019820bec9 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Request method failure captured: Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/c4b0678c-dd1b-40b3-bca2-ed04c53c44811 HTTP/1.1 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ0fFQfnAinXBhcZ5FG94Xh8p1SHntUDVvO2-426QzhwGLrbLWdpCoTBJpSjmmZ2vTwqUSq_gdewSve_aEn6Q8Y_2rsPxzRuV885T6GqBPW_wInwcWi9AjfWs19TZdTzl1a2F3rF148hNC5Zjr_khFkt1rxYPJc9rlT97OYYU97xUvc Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5ace2861d6694248ad0c9377755ee488 Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c4b0678c-dd1b-40b3-bca2-ed04c53c44811'} Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c4b0678c-dd1b-40b3-bca2-ed04c53c44811 to delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4b0678c-dd1b-40b3-bca2-ed04c53c44811 could not be found. Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:55.309505 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33c9e80d-61f7-4c2a-896b-94019820bec9 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-33c9e80d-61f7-4c2a-896b-94019820bec9 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/c4b0678c-dd1b-40b3-bca2-ed04c53c44811" status: 404 len: 62 microversion: 2.1 time: 0.099459 Oct 04 20:52:55.318396 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1434/2897] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:55 2022] DELETE /compute/v2.1/images/c4b0678c-dd1b-40b3-bca2-ed04c53c44811 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:55.332996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:55.334419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:55.355697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:55.356344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:55.360643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.364802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:55.365806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:55.371944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.481326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:55.593839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:55.989728 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ec68593-4752-4140-a016-a023abdae617 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 204 len: 0 microversion: 2.1 time: 0.672805 Oct 04 20:52:55.993024 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1435/2898] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:55 2022] DELETE /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:56.008977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-deleted", "tag": "e51954d1-891b-4dd1-91e2-a94131d8bb6f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:56.052294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.053845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.055886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.115350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] Creating event network-vif-deleted:e51954d1-891b-4dd1-91e2-a94131d8bb6f for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:56.127410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-70174f5d-c9e0-4162-b0c5-f132247adbed req-f8fffd0e-0573-4663-ac9f-e28722a9ba4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131317 Oct 04 20:52:56.129215 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1436/2899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:56.142307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-unplugged", "status": "completed", "tag": "e51954d1-891b-4dd1-91e2-a94131d8bb6f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:56.168648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.169825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.170654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.239286 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] Creating event network-vif-unplugged:e51954d1-891b-4dd1-91e2-a94131d8bb6f for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:56.252874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-eec1ee15-9c1c-4152-adf5-2d338e97a232 req-57064829-8472-4d55-95f2-8453f5dbf626 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119367 Oct 04 20:52:56.255929 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1437/2900] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:56.274352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:56.300203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51f97e1e-4cb1-42aa-9d6d-9af2cc3a10ec tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.088685 Oct 04 20:52:56.308586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Action: 'update_all', calling method: .version_select at 0x7f54f6b33d30>, body: {"tags": ["tempest-tag-1856138196", "tempest-tag-2056469156"]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:56.311547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1464/2901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:55 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:56.329609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a5a7765-73eb-4833-8748-cec0dad71efb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f575e3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.361723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.372029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.372907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.374018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:56.396714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.397526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.398856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.399587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.400078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.400552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.491963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.492866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.493062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a5a7765-73eb-4833-8748-cec0dad71efb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275" status: 200 len: 1412 microversion: 2.1 time: 0.179094 Oct 04 20:52:56.493582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.494069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1465/2902] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:56 2022] GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 => generated 1412 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:56.513770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-642dfaad-4320-44d5-b10a-0e69d8057351 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Calling method '.version_select at 0x7f54f56cb160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.570195 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-642dfaad-4320-44d5-b10a-0e69d8057351 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] HTTP exception thrown: Image not found. Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-642dfaad-4320-44d5-b10a-0e69d8057351 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Request method failure captured: Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/tempest-invalid-1866597671 HTTP/1.1 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ0fFQfnAinXBhcZ5FG94Xh8p1SHntUDVvO2-426QzhwGLrbLWdpCoTBJpSjmmZ2vTwqUSq_gdewSve_aEn6Q8Y_2rsPxzRuV885T6GqBPW_wInwcWi9AjfWs19TZdTzl1a2F3rF148hNC5Zjr_khFkt1rxYPJc9rlT97OYYU97xUvc Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5ace2861d6694248ad0c9377755ee488 Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'tempest-invalid-1866597671'} Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1866597671 to delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1866597671 could not be found. Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.579241 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:56.590362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-642dfaad-4320-44d5-b10a-0e69d8057351 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:56.595354 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-642dfaad-4320-44d5-b10a-0e69d8057351 tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/tempest-invalid-1866597671" status: 404 len: 62 microversion: 2.1 time: 0.097461 Oct 04 20:52:56.596411 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1466/2903] 10.222.0.36 () {58 vars in 1206 bytes} [Tue Oct 4 20:52:56 2022] DELETE /compute/v2.1/images/tempest-invalid-1866597671 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:56.620567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1415286-bc50-4e97-bd46-46991817af7a", "name": "network-vif-deleted", "tag": "cc614f5e-fde6-4ee6-8987-6b66df0ca11c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:56.638244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.639211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.640127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.666102 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] Creating event network-vif-deleted:cc614f5e-fde6-4ee6-8987-6b66df0ca11c for instance b1415286-bc50-4e97-bd46-46991817af7a on n-h2-851029-13 Oct 04 20:52:56.681812 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a5160db2-ccf3-44ec-93e8-54e3d3a32542 req-d8e968e7-9902-4b39-bc7a-03b7fac8449d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065560 Oct 04 20:52:56.683215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1467/2904] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:56.706259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:56.731908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.736723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:56.762920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.763889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.765974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.768055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.769726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.774033 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecf0f116-51b4-4af3-af45-cd1fc6967212 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 62 microversion: 2.26 time: 0.512770 Oct 04 20:52:56.774033 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1438/2905] 10.222.0.36 () {62 vars in 1312 bytes} [Tue Oct 4 20:52:56 2022] PUT /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 62 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:56.779185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.779511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.780890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:56.797004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.798687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.799589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.803711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.805445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.806896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.986408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:57.005419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-726bf8ee-e093-491a-adf7-2f9f9da5a6d7 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1298 microversion: 2.1 time: 0.312490 Oct 04 20:52:57.006633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1468/2906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:56 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:57.019973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21a5e0b1-26e4-4e0e-b0bf-51d6b106251f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f56cb430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.133824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:57.140042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21a5e0b1-26e4-4e0e-b0bf-51d6b106251f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275" status: 200 len: 1412 microversion: 2.1 time: 0.128915 Oct 04 20:52:57.141063 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1469/2907] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:57 2022] GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:57.147285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1586acfe-000f-4712-b9a6-688f9bfb27e7 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1470 microversion: 2.1 time: 0.374358 Oct 04 20:52:57.150771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d2a577f-b994-4b11-8290-d299f3a62abe tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Calling method '.version_select at 0x7f54f56cb700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.151252 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1439/2908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:56 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:57.166208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b443eab-0127-4d79-b4cc-0e997669b948 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f6797700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.182705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b443eab-0127-4d79-b4cc-0e997669b948 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.183593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b443eab-0127-4d79-b4cc-0e997669b948 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.184836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b443eab-0127-4d79-b4cc-0e997669b948 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.191726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3d2a577f-b994-4b11-8290-d299f3a62abe tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] HTTP exception thrown: Image not found. Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d2a577f-b994-4b11-8290-d299f3a62abe tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Request method failure captured: Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/ea69d88a-6cc1-4b46-a884-764d682ef56b HTTP/1.1 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ0fFQfnAinXBhcZ5FG94Xh8p1SHntUDVvO2-426QzhwGLrbLWdpCoTBJpSjmmZ2vTwqUSq_gdewSve_aEn6Q8Y_2rsPxzRuV885T6GqBPW_wInwcWi9AjfWs19TZdTzl1a2F3rF148hNC5Zjr_khFkt1rxYPJc9rlT97OYYU97xUvc Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_17ef12a954514f0ab9fcd44a53918e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 17ef12a954514f0ab9fcd44a53918e79 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-502333550 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5ace2861d6694248ad0c9377755ee488 Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-502333550-project Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ea69d88a-6cc1-4b46-a884-764d682ef56b'} Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea69d88a-6cc1-4b46-a884-764d682ef56b to delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea69d88a-6cc1-4b46-a884-764d682ef56b could not be found. Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:57.196269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d2a577f-b994-4b11-8290-d299f3a62abe tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d2a577f-b994-4b11-8290-d299f3a62abe tempest-ImagesDeleteNegativeTestJSON-502333550 tempest-ImagesDeleteNegativeTestJSON-502333550-project] 10.222.0.36 "DELETE /compute/v2.1/images/ea69d88a-6cc1-4b46-a884-764d682ef56b" status: 404 len: 62 microversion: 2.1 time: 0.056296 Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1470/2909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:57 2022] DELETE /compute/v2.1/images/ea69d88a-6cc1-4b46-a884-764d682ef56b => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:57.275209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac85e811-09c5-447e-9093-5af885526f34 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f625c1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b443eab-0127-4d79-b4cc-0e997669b948 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 200 len: 62 microversion: 2.26 time: 0.057705 Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1440/2910] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 4 20:52:57 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 62 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '.version_select at 0x7f54f6b33b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.281866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:57.296514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.297404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.298191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.299537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.301830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.301830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.371138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.378881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.380201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.600370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'flavor' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:57.708303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e490227-2fe5-4302-a599-9d42e57e2691 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags" status: 204 len: 0 microversion: 2.26 time: 0.472901 Oct 04 20:52:57.709849 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1441/2911] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 4 20:52:57 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c/tags => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:57.744439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.745689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:57.779285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.780250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.781078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.782474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.783485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.784291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.934178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac85e811-09c5-447e-9093-5af885526f34 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275" status: 204 len: 0 microversion: 2.1 time: 0.730428 Oct 04 20:52:57.941964 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1471/2912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:57 2022] DELETE /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:57.985856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.987300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:58.055553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.072821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.073713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.101119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.101987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.120118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.253746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:58.656097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:58.689151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e87398b-c9c9-42ff-818a-f4bcb3134af7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.971611 Oct 04 20:52:58.694744 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1442/2913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:57 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:58.705521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-833cc7bd-8cb9-452f-8f89-fcd0ad15cc9b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f62c8b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:58.761379 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-833cc7bd-8cb9-452f-8f89-fcd0ad15cc9b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Image not found. Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-833cc7bd-8cb9-452f-8f89-fcd0ad15cc9b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 HTTP/1.1 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '90cd6b40-e9a0-47a7-94ac-9629df69b275'} Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 90cd6b40-e9a0-47a7-94ac-9629df69b275 Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:52:58.765558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90cd6b40-e9a0-47a7-94ac-9629df69b275 could not be found. Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-833cc7bd-8cb9-452f-8f89-fcd0ad15cc9b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-833cc7bd-8cb9-452f-8f89-fcd0ad15cc9b tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275" status: 404 len: 62 microversion: 2.1 time: 0.070479 Oct 04 20:52:58.776355 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1443/2914] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:52:58 2022] GET /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:58.803542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:58.804716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:58.833698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.838160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.850506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.850506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.850506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.850506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.932399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.933462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.934370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.935296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lazy-loading 'fault' on Instance uuid fa91b801-ecd7-4900-8c42-ca4127cf1059 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:58.999742 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a85b6311-c23d-48a9-94bc-7570290b83c0 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 204 len: 0 microversion: 2.26 time: 1.051515 Oct 04 20:52:59.006828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1472/2915] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 20:52:57 2022] DELETE /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:52:59.044548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:59.048671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:59.076593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.077506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.078339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.079676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.080753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.081889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.198041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:59.234854 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8be4f43d-d8a3-4431-8adc-4b99c654ec9b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 200 len: 1303 microversion: 2.1 time: 0.446741 Oct 04 20:52:59.252593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1444/2916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:58 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 1303 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:59.282728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91b801-ecd7-4900-8c42-ca4127cf1059", "name": "network-vif-deleted", "tag": "fea51754-6700-468e-b053-4913538fbebf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:59.328938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.330546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.332310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.363736 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] Creating event network-vif-deleted:fea51754-6700-468e-b053-4913538fbebf for instance fa91b801-ecd7-4900-8c42-ca4127cf1059 on n-h1-851029-13 Oct 04 20:52:59.372126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:59.376238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-94dc62e5-2efb-435a-a5eb-1ad344bfad07 req-22b6e6e2-52c8-4396-9777-f76d8b719ef2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121852 Oct 04 20:52:59.379159 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1445/2917] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:59.391527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:59.394475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:59.398942 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a82c496-d91e-480e-a73f-6dc7d7eeb355 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1428 microversion: 2.1 time: 0.386024 Oct 04 20:52:59.404131 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1473/2918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:59 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1428 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:59.430981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:59.432612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:59.455993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.462103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.465674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.467427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.474035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.474035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.480074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.480074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.480074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.482652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.484866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.509848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.462874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:00.471435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:00.483970 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c09bdf6-e4ee-47a3-950a-2e43d57395b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1505 microversion: 2.1 time: 1.101785 Oct 04 20:53:00.485770 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1446/2919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:59 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1505 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:00.497255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:00.503322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9822b8f-5142-4cf3-8970-f0636192a233", "name": "network-vif-deleted", "tag": "f666bde8-d8f1-4e8a-9be4-aa14d774c487"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:00.512398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:00.518008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11c29c4c-6cc9-49b0-8def-53f84e3cd532 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1553 microversion: 2.26 time: 1.111663 Oct 04 20:53:00.526028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1474/2920] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:59 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1553 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:00.533343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.533343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.533343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.588188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:00.591732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:00.629437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] Creating event network-vif-deleted:f666bde8-d8f1-4e8a-9be4-aa14d774c487 for instance c9822b8f-5142-4cf3-8970-f0636192a233 on n-h2-851029-13 Oct 04 20:53:00.664798 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d71a3c95-e6ba-4e42-9483-fe5050aa85f3 req-3e1d8368-8716-4659-a725-1b6530fe042c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173649 Oct 04 20:53:00.667278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.668743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.674623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1447/2921] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:00.675932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.677901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.680206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.681416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.700693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:00.707866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:00.735169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.737217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.742008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.748483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.749546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.750592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.818996 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 HTTP/1.1 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fa91b801-ecd7-4900-8c42-ca4127cf1059'} Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:00.826275 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:53:00.837502 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:00.839482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:00.841505 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0409253d-1240-4e90-a407-52e1f6eb8866 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 404 len: 111 microversion: 2.1 time: 0.161682 Oct 04 20:53:00.843681 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1448/2922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:00 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:00.867696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:00.871011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:00.885978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.887929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.889252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.891251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.892617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.896090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.977032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.978134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.979184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.980475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lazy-loading 'fault' on Instance uuid c9822b8f-5142-4cf3-8970-f0636192a233 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:01.200409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:01.269469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16b77e58-18a5-4a42-8755-51e29942c7a0 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 200 len: 1304 microversion: 2.1 time: 0.414066 Oct 04 20:53:01.295982 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1449/2923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:00 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 1304 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:01.540184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:01.543544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:01.611756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:01.613466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:01.614702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:01.616499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:01.617890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:01.619136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:01.810210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:01.842486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46f54782-9df2-4edc-a11b-b657d4852853 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.314331 Oct 04 20:53:01.848987 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1475/2924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:00 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:01.873100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:01.878333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:01.903780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:01.907992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:01.910742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:01.914773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:01.916305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:01.920204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.666108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:02.722815 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fabb60e-6574-433c-8757-454921661ab9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1505 microversion: 2.1 time: 1.200074 Oct 04 20:53:02.747101 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1450/2925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:01 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:02.747101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:02.747101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: c9822b8f-5142-4cf3-8970-f0636192a233] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:02.776441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.782689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.782689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.783925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.784981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.785788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.873742 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] HTTP exception thrown: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Request method failure captured: Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 HTTP/1.1 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJxPkbrIl4ZbhV4fU3c4u_JGDWBiPmXwlTxGYwL5fjIuIItBnOhm7cGRLBG7GdwQ5zYPbvf6GKKh-kEdY-H0m4fYQ29QIDt6KyLY049SNyEu6VFy7u0AL5xHwe0jbLPwtkZvLqJzpLadosjcc0wmA4iqIWa6QF3d8wMdK_YqOnW1g60 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9aa22e4620dc4028b22512a283c561cd Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c9822b8f-5142-4cf3-8970-f0636192a233'} Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:02.887353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. Oct 04 20:53:02.899799 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:02.900767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:02.903866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Returning 404 to user: Instance c9822b8f-5142-4cf3-8970-f0636192a233 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:02.905218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c3e4314-3803-4d17-92b4-4721e2dc719e tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233" status: 404 len: 111 microversion: 2.1 time: 0.167951 Oct 04 20:53:02.912058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1451/2926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:02 2022] GET /compute/v2.1/servers/c9822b8f-5142-4cf3-8970-f0636192a233 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:02.925255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:02.931499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:02.941577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:02.944035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:02.950148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62038329-b6e3-422c-9dae-2d93b6425256 tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1553 microversion: 2.26 time: 1.097600 Oct 04 20:53:02.966109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1476/2927] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:01 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1553 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:02.970509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.971870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.973613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.975829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.980038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.981190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.000249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:03.001156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:03.036688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:03.037727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:03.038562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.050293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:03.051314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:03.052116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.160458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:03.772668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:03.825938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c4aaae7-b165-4194-a515-c17a3a8460c1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.905493 Oct 04 20:53:03.845411 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1452/2928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:02 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:03.875717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1539bee5-b35f-412f-be7a-8371e24ea03c", "name": "network-vif-deleted", "tag": "95750b97-010d-4656-8ea2-ee5ddcc5728f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:03.933822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:03.936653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:03.937894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.969156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] Creating event network-vif-deleted:95750b97-010d-4656-8ea2-ee5ddcc5728f for instance 1539bee5-b35f-412f-be7a-8371e24ea03c on n-h1-851029-13 Oct 04 20:53:03.988218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7642ec2e-4fc3-41fd-ae87-8e2f2ed16f08 req-c4436269-7fb4-4bd5-9b04-0e9f334c3a21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139945 Oct 04 20:53:03.990784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1453/2929] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:04.023373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:04.033260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:04.053213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.055103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.056322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.060221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.075173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53c94c0b-9aee-4783-b714-edc21b841616 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 204 len: 0 microversion: 2.1 time: 1.101243 Oct 04 20:53:04.077697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1477/2930] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:02 2022] DELETE /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:53:04.083606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.091856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.105889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:04.108734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:04.137570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.139425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.140831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.142637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.146195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.147445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.299815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.306907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.308044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.309191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lazy-loading 'fault' on Instance uuid 1539bee5-b35f-412f-be7a-8371e24ea03c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:04.610275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:04.652906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:04.655929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58e361704c50409c89bdefa7f9ee39ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6b7cfd72a94805b60a6b73ef1668ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:04.683541 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ffe11da-5007-43c5-ae9e-e4478ec840ea tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 200 len: 1352 microversion: 2.26 time: 0.598515 Oct 04 20:53:04.688923 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1478/2931] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:04 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 1352 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:04.740804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:04.748450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:04.768579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.769741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.779223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.779223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.779223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.779223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.098072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:05.152035 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2462c785-e0ba-48dd-af29-819bb3c265a7 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1500 microversion: 2.1 time: 1.157871 Oct 04 20:53:05.157772 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1454/2932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:03 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1500 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:05.219813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:05.224091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:05.263497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.275103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.276725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.279022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.288084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.289659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.667021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:05.671859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:05.707170 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fb9d3a6-ad8c-4749-bbb0-ab1dc57abe7f tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1470 microversion: 2.1 time: 0.974673 Oct 04 20:53:05.709608 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1479/2933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:04 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1470 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:05.733827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454b444d-e131-4d4d-bca9-1d4849cac8a7", "name": "network-vif-plugged", "status": "completed", "tag": "a451742e-7377-4f45-9199-344c3e0f5e50"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:05.778742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.786235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.786235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.836750 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] Creating event network-vif-plugged:a451742e-7377-4f45-9199-344c3e0f5e50 for instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 on n-h1-851029-13 Oct 04 20:53:05.858225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7686d7a6-a4db-4f1f-bceb-b373906ded77 req-72d2ab3b-436e-45d9-a954-90e8026a5a04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140914 Oct 04 20:53:05.861032 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1480/2934] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:05.873952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:05.875797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] [instance: 1539bee5-b35f-412f-be7a-8371e24ea03c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:05.905544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.911845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.912765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.914126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.917206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.918031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.963119 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] HTTP exception thrown: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Request method failure captured: Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c HTTP/1.1 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJzfAjUFeFtktRdBtmJLHlpE3tGjEqBYm5Fdh0DTBaVhNYVKzIRmOsPDNC50MiuaQ7yHFW4gEC-7xUd-dpv_yGZd_bB3nDYmCo80-qZdvRQ49PupzRFU1rrTNH34uSIv1Oi8uevztdtQNs0JOrD7Wtr_tg2cTAxdeafBUkGvsh1K2x8 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ad6b7cfd72a94805b60a6b73ef1668ee Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerTagsTestJSON-1334577702 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad6b7cfd72a94805b60a6b73ef1668ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad6b7cfd72a94805b60a6b73ef1668ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad6b7cfd72a94805b60a6b73ef1668ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad6b7cfd72a94805b60a6b73ef1668ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerTagsTestJSON-1334577702 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ad6b7cfd72a94805b60a6b73ef1668ee Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerTagsTestJSON-1334577702 Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerTagsTestJSON-1334577702-project Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 58e361704c50409c89bdefa7f9ee39ad Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerTagsTestJSON-1334577702-project Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1539bee5-b35f-412f-be7a-8371e24ea03c'} Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:05.966843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] Returning 404 to user: Instance 1539bee5-b35f-412f-be7a-8371e24ea03c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:05.974968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13012b86-83ec-466e-8371-bd56ae5ac5da tempest-ServerTagsTestJSON-1334577702 tempest-ServerTagsTestJSON-1334577702-project] 10.222.0.36 "GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c" status: 404 len: 111 microversion: 2.26 time: 0.106821 Oct 04 20:53:05.981267 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1481/2935] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:05 2022] GET /compute/v2.1/servers/1539bee5-b35f-412f-be7a-8371e24ea03c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:53:06.213069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:06.226571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:06.263100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.264596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.265761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.274320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.280690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.296936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.428477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:06.447493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:DELETE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:06.471428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c5044b3-c492-41a1-a6c0-6f1b7251dfa5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.311317 Oct 04 20:53:06.476319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1455/2936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:05 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:06.763668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:06.764938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:06.798100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.799134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.800000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.801443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.802341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.803185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:07.741062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:07.812125 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-832bee63-9f44-4b06-b027-f5bc76c3adf5 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1470 microversion: 2.1 time: 1.056957 Oct 04 20:53:07.827394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1456/2937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:06 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1470 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:07.854958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:07.856803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:07.873009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:07.877893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:07.877893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:07.877893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:07.877893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:07.880754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:07.943065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:07.976770 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0758f96-852a-4a80-98b7-cf3c426ac534 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1487 microversion: 2.1 time: 1.782446 Oct 04 20:53:07.979327 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1482/2938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:06 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1487 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:08.022806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:08.025907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:08.042122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.043797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.045110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.047020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.052676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.054729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.164442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:08.496361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:08.522279 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d722f31-6600-47dd-96b7-f401554bd5de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 0.692511 Oct 04 20:53:08.548189 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1457/2939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:07 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:08.586324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454b444d-e131-4d4d-bca9-1d4849cac8a7", "name": "network-vif-unplugged", "status": "completed", "tag": "a451742e-7377-4f45-9199-344c3e0f5e50"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:08.624429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.625225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.626035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.685087 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] Creating event network-vif-unplugged:a451742e-7377-4f45-9199-344c3e0f5e50 for instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 on n-h1-851029-13 Oct 04 20:53:08.705332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:08.736858 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-debbb58d-ea27-45bd-81d3-b9d35f14abdf req-01112c8e-b4ce-45a2-b416-6be8c6e5999c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181692 Oct 04 20:53:08.740252 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1458/2940] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:08.761232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2310d4-398a-4ac8-92be-ba2fc037716e", "name": "network-vif-deleted", "tag": "e9072eee-4b7c-4fd4-96f4-a2aac0fab353"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:08.805582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.806885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.808909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.852464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ba26f05-bc9e-4ddb-bed9-a432cc36e2b6 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 204 len: 0 microversion: 2.1 time: 0.832513 Oct 04 20:53:08.857709 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1483/2941] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:08 2022] DELETE /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:53:08.869925 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] Creating event network-vif-deleted:e9072eee-4b7c-4fd4-96f4-a2aac0fab353 for instance 7c2310d4-398a-4ac8-92be-ba2fc037716e on n-h2-851029-13 Oct 04 20:53:08.885805 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5dbc5c7d-737e-414a-8715-4c9eeb6fbc66 req-b0a17845-8d63-4ceb-98d8-641c55252411 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137677 Oct 04 20:53:08.895211 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1459/2942] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:08.907417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f1a6a6b-26bb-4b0d-8eae-e203cc2c191c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f6b33e50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:08.917495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:08.924199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:08.945473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.951659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.952658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.958217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.963238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.963420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.020333 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4f1a6a6b-26bb-4b0d-8eae-e203cc2c191c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Image not found. Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f1a6a6b-26bb-4b0d-8eae-e203cc2c191c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 HTTP/1.1 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '90cd6b40-e9a0-47a7-94ac-9629df69b275'} Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 90cd6b40-e9a0-47a7-94ac-9629df69b275 to delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90cd6b40-e9a0-47a7-94ac-9629df69b275 could not be found. Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.027060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f1a6a6b-26bb-4b0d-8eae-e203cc2c191c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:09.040524 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f1a6a6b-26bb-4b0d-8eae-e203cc2c191c tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275" status: 404 len: 62 microversion: 2.1 time: 0.132730 Oct 04 20:53:09.046229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1460/2943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:08 2022] DELETE /compute/v2.1/images/90cd6b40-e9a0-47a7-94ac-9629df69b275 => generated 62 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:53:09.099435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.108319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:09.137937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.141043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.144411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.149676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.151393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.154886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.236373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:09.456184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Instance is already in deleting state, ignoring this request Oct 04 20:53:09.466522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b38228c2-6bc1-45e1-abf2-33ad40d76eef tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 204 len: 0 microversion: 2.1 time: 0.410798 Oct 04 20:53:09.482975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1461/2944] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:09 2022] DELETE /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:53:09.503402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.504542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:09.525303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.530070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.531429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.533134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.534218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.535253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.736963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa22e4620dc4028b22512a283c561cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea8b8d405e24994a0cac2296982a738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:09.775206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e02b96ee-a99c-4961-b54c-c655b739053a tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 200 len: 1428 microversion: 2.1 time: 0.912443 Oct 04 20:53:09.810381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1484/2945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:08 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 1428 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:09.873482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.881707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:09.933540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.937561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.939637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.941046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.968773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.969722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.767245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:11.799005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37f9ee40-ed95-4353-b4b3-75c7c3b3b1de tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.985954 Oct 04 20:53:11.814699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1485/2946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:09 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:11.821376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:11.825638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] [instance: 7c2310d4-398a-4ac8-92be-ba2fc037716e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:11.849160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.886940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.886940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.886940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.886940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.886940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.933780 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] HTTP exception thrown: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Request method failure captured: Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e HTTP/1.1 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJxPkbrIl4ZbhV4fU3c4u_JGDWBiPmXwlTxGYwL5fjIuIItBnOhm7cGRLBG7GdwQ5zYPbvf6GKKh-kEdY-H0m4fYQ29QIDt6KyLY049SNyEu6VFy7u0AL5xHwe0jbLPwtkZvLqJzpLadosjcc0wmA4iqIWa6QF3d8wMdK_YqOnW1g60 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ea8b8d405e24994a0cac2296982a738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8ea8b8d405e24994a0cac2296982a738 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminTestJSON-1837274637 Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9aa22e4620dc4028b22512a283c561cd Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminTestJSON-1837274637-project Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7c2310d4-398a-4ac8-92be-ba2fc037716e'} Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:11.945159 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] Returning 404 to user: Instance 7c2310d4-398a-4ac8-92be-ba2fc037716e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:11.958211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8b185b3-7ed7-4f9b-b3d4-b2e1399b4661 tempest-ServersAdminTestJSON-1837274637 tempest-ServersAdminTestJSON-1837274637-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e" status: 404 len: 111 microversion: 2.1 time: 0.153324 Oct 04 20:53:11.965393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1486/2947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:11 2022] GET /compute/v2.1/servers/7c2310d4-398a-4ac8-92be-ba2fc037716e => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:12.157540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:12.212428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3239949c-2134-4a4b-a243-23bec351dafe tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1493 microversion: 2.1 time: 2.721824 Oct 04 20:53:12.218812 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1462/2948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:09 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1493 bytes in 2731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:12.851998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:12.853255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:12.907466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:12.914900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:12.916529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:12.918313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:12.924173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:12.925570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.272237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:13.275736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:13.306890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.312945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.320853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.323263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.324767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.326117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.754739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:13.881541 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f944d97-9965-4a86-9dcc-bf8121f7094f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1451 microversion: 2.1 time: 0.562750 Oct 04 20:53:13.881541 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1463/2949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:13 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1451 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:14.425916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454b444d-e131-4d4d-bca9-1d4849cac8a7", "name": "network-vif-deleted", "tag": "a451742e-7377-4f45-9199-344c3e0f5e50"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:14.455333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:14.456558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:14.457663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:14.478853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] Creating event network-vif-deleted:a451742e-7377-4f45-9199-344c3e0f5e50 for instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 on n-h1-851029-13 Oct 04 20:53:14.489262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-064f0996-7394-4089-9229-000ee4afb7cc req-259092cf-e70c-41cb-b3fe-697ecf17277d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069431 Oct 04 20:53:14.494173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1464/2950] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:14.754794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:14.754794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f8f9e57-1c7d-473a-93f1-326010bf9927 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1525 microversion: 2.1 time: 1.820965 Oct 04 20:53:14.754794 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1487/2951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:12 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1525 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:14.871814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:14.872924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:14.894539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:14.898231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:14.899356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:14.901555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:14.902866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:14.919881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:15.303040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:15.329954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-87e5e1e7-1b19-4569-ab21-456cf833c050 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1292 microversion: 2.1 time: 0.464020 Oct 04 20:53:15.349470 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1465/2952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:14 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1292 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:15.794248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:15.795163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:15.808680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:15.810334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:15.810584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:15.811962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:15.812870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:15.813682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.385450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:16.387783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:16.414488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:16.418001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:16.422232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.423372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:16.427480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:16.427989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.547039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:16.559980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:16.559980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:16.561076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:16.562344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.566514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lazy-loading 'fault' on Instance uuid 454b444d-e131-4d4d-bca9-1d4849cac8a7 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:16.586651 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82c9401b-0f1b-442d-9b03-9f9d589f0766 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1507 microversion: 2.1 time: 0.800929 Oct 04 20:53:16.594975 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1488/2953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:15 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1507 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:17.085189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9265d783835047bb8377fccd36c1fdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1d1403475041c0b5bc1c99e019b785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:17.108934 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73a5478e-c297-4590-8a18-0be6d96b5fc9 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 200 len: 1297 microversion: 2.1 time: 0.730885 Oct 04 20:53:17.111151 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1466/2954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:16 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 1297 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:17.655826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:17.657970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:17.699386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:17.700427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:17.701887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:17.703415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:17.704726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:17.705905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.149374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "name": "network-vif-unplugged", "status": "completed", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:18.198558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.199785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.200662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.243895 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] Creating event network-vif-unplugged:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:53:18.256387 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ca95e0b7-b932-430e-b57b-4b0351f68533 req-550c8803-f0ef-400f-8500-8af1dabcb656 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114382 Oct 04 20:53:18.257782 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1467/2955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:18.275292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.303384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 454b444d-e131-4d4d-bca9-1d4849cac8a7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:18.345222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.346307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.347066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.348449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.354645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.355645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.369476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:18.395865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b8ef2ea-430a-46f9-b3c4-45d497c56ba9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1507 microversion: 2.1 time: 0.750242 Oct 04 20:53:18.404806 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1489/2956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:17 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:18.439643 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 HTTP/1.1 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '454b444d-e131-4d4d-bca9-1d4849cac8a7'} Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.451559 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.462885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 454b444d-e131-4d4d-bca9-1d4849cac8a7 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.466231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b14ada3-ed69-4a92-aabd-017533ee0443 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7" status: 404 len: 111 microversion: 2.1 time: 0.192658 Oct 04 20:53:18.470412 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1468/2957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:18 2022] GET /compute/v2.1/servers/454b444d-e131-4d4d-bca9-1d4849cac8a7 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:18.481998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c088af57-dc16-4131-9c0c-c22c383b480f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5698310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.554735 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c088af57-dc16-4131-9c0c-c22c383b480f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Image not found. Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c088af57-dc16-4131-9c0c-c22c383b480f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf HTTP/1.1 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3cab5b9a-f69b-4fc7-8e45-cfb2860476bf'} Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3cab5b9a-f69b-4fc7-8e45-cfb2860476bf to delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3cab5b9a-f69b-4fc7-8e45-cfb2860476bf could not be found. Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.559660 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:53:18.568139 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.577353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c088af57-dc16-4131-9c0c-c22c383b480f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.577353 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c088af57-dc16-4131-9c0c-c22c383b480f tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf" status: 404 len: 62 microversion: 2.1 time: 0.100175 Oct 04 20:53:18.584465 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1490/2958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:18 2022] DELETE /compute/v2.1/images/3cab5b9a-f69b-4fc7-8e45-cfb2860476bf => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:53:18.593399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.599227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:18.620409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.621519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.623005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.624617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.625781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.626694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.677165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 HTTP/1.1 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1a52fd52-0e35-4524-b566-14f5d58ca116'} Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:18.681606 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.689820 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.695285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.696892 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-869912bd-b33f-420c-82a0-9861c5deb1c2 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 404 len: 111 microversion: 2.1 time: 0.110147 Oct 04 20:53:18.699001 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1469/2959] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:18 2022] DELETE /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:18.717864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.726374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 1a52fd52-0e35-4524-b566-14f5d58ca116] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:18.736836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.739185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.740728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.743719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.745229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.746591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.818723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 HTTP/1.1 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1a52fd52-0e35-4524-b566-14f5d58ca116'} Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.824323 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.841224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 1a52fd52-0e35-4524-b566-14f5d58ca116 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.849177 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfb23c77-10d5-470b-b874-428faf705bcb tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116" status: 404 len: 111 microversion: 2.1 time: 0.140220 Oct 04 20:53:18.849959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1491/2960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:18 2022] GET /compute/v2.1/servers/1a52fd52-0e35-4524-b566-14f5d58ca116 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:18.863536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5ef066a-ceb0-4428-a0e8-ac697a9c38ae tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f61aca60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b5ef066a-ceb0-4428-a0e8-ac697a9c38ae tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Image not found. Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5ef066a-ceb0-4428-a0e8-ac697a9c38ae tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b HTTP/1.1 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fb48203b-c421-4948-a511-502548d8ce0b'} Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb48203b-c421-4948-a511-502548d8ce0b to delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb48203b-c421-4948-a511-502548d8ce0b could not be found. Oct 04 20:53:18.993085 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5ef066a-ceb0-4428-a0e8-ac697a9c38ae tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.001004 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5ef066a-ceb0-4428-a0e8-ac697a9c38ae tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b" status: 404 len: 62 microversion: 2.1 time: 0.140344 Oct 04 20:53:19.005482 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1470/2961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:18 2022] DELETE /compute/v2.1/images/fb48203b-c421-4948-a511-502548d8ce0b => generated 62 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:53:19.021507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.025367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.056552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.062860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.065823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.071993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.073652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.078212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.157136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 HTTP/1.1 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4564d918-b93f-4ae3-b899-0d33f505dfc5'} Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:19.167921 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.179957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.183522 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65d20abf-6843-4e2e-9bfb-378e88d7b3df tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 404 len: 111 microversion: 2.1 time: 0.169194 Oct 04 20:53:19.185058 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1492/2962] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:19 2022] DELETE /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:19.214018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.215334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 4564d918-b93f-4ae3-b899-0d33f505dfc5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.233942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.234892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.235628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.236888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.243623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.244812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.306259 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 HTTP/1.1 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4564d918-b93f-4ae3-b899-0d33f505dfc5'} Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.310297 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.330388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 4564d918-b93f-4ae3-b899-0d33f505dfc5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.336657 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab459a62-bb86-49ba-97ea-07ebbca3f688 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5" status: 404 len: 111 microversion: 2.1 time: 0.143160 Oct 04 20:53:19.339507 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1471/2963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:19 2022] GET /compute/v2.1/servers/4564d918-b93f-4ae3-b899-0d33f505dfc5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:19.356309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b33c7bfb-0f04-4e7d-9d94-3164a2a10442 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '.version_select at 0x7f54f5698310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.450496 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b33c7bfb-0f04-4e7d-9d94-3164a2a10442 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Image not found. Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b33c7bfb-0f04-4e7d-9d94-3164a2a10442 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c HTTP/1.1 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '46dffc1e-8676-491f-8ed2-7c42ef5ef26c'} Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 46dffc1e-8676-491f-8ed2-7c42ef5ef26c to delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46dffc1e-8676-491f-8ed2-7c42ef5ef26c could not be found. Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.462960 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.479472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b33c7bfb-0f04-4e7d-9d94-3164a2a10442 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.485425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.489529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.490494 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b33c7bfb-0f04-4e7d-9d94-3164a2a10442 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c" status: 404 len: 62 microversion: 2.1 time: 0.131636 Oct 04 20:53:19.499177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1493/2964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:19 2022] DELETE /compute/v2.1/images/46dffc1e-8676-491f-8ed2-7c42ef5ef26c => generated 62 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:53:19.532298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.536172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.539862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.548314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.549806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.568489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.586324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.587376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.613906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.619990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.621325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.627343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.631095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.633203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.756497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 HTTP/1.1 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9f4fd6fd-bf2b-4756-aa13-0efeaeb92491'} Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:19.762477 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.780710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.784296 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d045a1d6-2f00-4e15-bd58-9646bd39c77a tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 404 len: 111 microversion: 2.1 time: 0.273728 Oct 04 20:53:19.786494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1494/2965] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:19 2022] DELETE /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:19.815708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.821585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] [instance: 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.857162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.862131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.863563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.865919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.871207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.873524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.943384 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] HTTP exception thrown: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Request method failure captured: Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 HTTP/1.1 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJtUHoAfbR_mbifsk7Ugzbk5S-AJBRLnWBPp3NtaZK2HBt_6CZS10GqSAlxKOVLNYEqYJ-V6Y0bT5UURVboqEdkIcZ5fvnwLkgRGeb1Ti8lrmjliQDo8U8babcpVAQunpdb6ISvd24cPCIZR5hChEx14xIbzDK5Z0H2x0QBQEqorRB8 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a1d1403475041c0b5bc1c99e019b785"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7a1d1403475041c0b5bc1c99e019b785 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesTestJSON-1239528683 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9265d783835047bb8377fccd36c1fdb8 Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesTestJSON-1239528683-project Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9f4fd6fd-bf2b-4756-aa13-0efeaeb92491'} Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.948214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. Oct 04 20:53:19.956143 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.957749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] Returning 404 to user: Instance 9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.963504 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51330fc8-2888-46af-ae7f-13b65f3181b4 tempest-ImagesTestJSON-1239528683 tempest-ImagesTestJSON-1239528683-project] 10.222.0.36 "GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491" status: 404 len: 111 microversion: 2.1 time: 0.164981 Oct 04 20:53:19.970263 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1495/2966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:19 2022] GET /compute/v2.1/servers/9f4fd6fd-bf2b-4756-aa13-0efeaeb92491 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:21.940432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:21.972942 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-324a7793-5a2a-4cde-839f-5b68f7bfb04f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1507 microversion: 2.1 time: 2.529014 Oct 04 20:53:21.975113 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1472/2967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:19 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1507 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:23.026347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:23.028367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:23.073291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.074509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.075765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.081064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.083060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.084309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:24.520702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:24.560073 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18835d07-b03e-43fd-a218-09341443c26e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1450 microversion: 2.1 time: 1.541957 Oct 04 20:53:24.577776 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1496/2968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:23 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1450 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:24.630898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:24.634511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:24.678087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:24.679255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:24.679926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:24.681371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:24.682194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:24.682988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:26.158594 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f7dbc04-5d87-414f-8c7f-11b6ae850e49 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A53%3A25.655843&end=2022-10-05T20%3A53%3A25.655843" status: 404 len: 112 microversion: - time: 0.496079 Oct 04 20:53:26.171813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1497/2969] 10.222.0.36 () {58 vars in 1316 bytes} [Tue Oct 4 20:53:25 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A53%3A25.655843&end=2022-10-05T20%3A53%3A25.655843 => generated 112 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 20:53:26.217043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e86e0ba8-e494-463c-ba8d-722566448f41 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] Calling method '.version_select at 0x7f54f56bea60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:26.235685 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e86e0ba8-e494-463c-ba8d-722566448f41 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e86e0ba8-e494-463c-ba8d-722566448f41 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] Request method failure captured: Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-simple-tenant-usage/eaf09f8a00ad4e008989140cbcbfcfb2?start=2022-10-05T20%3A53%3A25.655843&end=2022-10-03T20%3A53%3A25.655843 HTTP/1.1 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1FkcFHjrAooZmbPEvUmJdVX8zzsqkoqtrOMXAjN_anKYxnodfE4vXF2yZ-RySh4aww5cw-Yf0R4AUZd3mpHIBw1Ogeu8pUX6kUb_XLEaPUT2uMZbTXl7POPEzFPbdZixd9m59RcjsGDVFwLcqI_MX5g9O-wD8hwr9bKBsS8VYdx8w Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 15d236d1272e46e2aa1701b32e8a36ca Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-471134745 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/15d236d1272e46e2aa1701b32e8a36ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/15d236d1272e46e2aa1701b32e8a36ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/15d236d1272e46e2aa1701b32e8a36ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_15d236d1272e46e2aa1701b32e8a36ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-471134745 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 15d236d1272e46e2aa1701b32e8a36ca Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-471134745 Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TenantUsagesNegativeTestJSON-471134745-project-admin Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e2d6e073d3224e4580ec5e9377429c7d Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-471134745-project-admin Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'eaf09f8a00ad4e008989140cbcbfcfb2'} Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 20:53:26.248520 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.260773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e86e0ba8-e494-463c-ba8d-722566448f41 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:26.260773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e86e0ba8-e494-463c-ba8d-722566448f41 tempest-TenantUsagesNegativeTestJSON-471134745 tempest-TenantUsagesNegativeTestJSON-471134745-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/eaf09f8a00ad4e008989140cbcbfcfb2?start=2022-10-05T20%3A53%3A25.655843&end=2022-10-03T20%3A53%3A25.655843" status: 400 len: 111 microversion: 2.1 time: 0.073034 Oct 04 20:53:26.264498 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1498/2970] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 4 20:53:26 2022] GET /compute/v2.1/os-simple-tenant-usage/eaf09f8a00ad4e008989140cbcbfcfb2?start=2022-10-05T20%3A53%3A25.655843&end=2022-10-03T20%3A53%3A25.655843 => generated 111 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:53:26.613890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:26.642100 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f1fc613-937e-47cf-86bb-9f965ecc7878 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1450 microversion: 2.1 time: 2.036508 Oct 04 20:53:26.648993 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1473/2971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:24 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1450 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:26.741728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0d647de-edd4-4b05-8835-a87b055ea8d4 tempest-TenantUsagesNegativeTestJSON-1654928029 tempest-TenantUsagesNegativeTestJSON-1654928029-project] Calling method '.version_select at 0x7f54f56bee50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:26.753671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0d647de-edd4-4b05-8835-a87b055ea8d4 tempest-TenantUsagesNegativeTestJSON-1654928029 tempest-TenantUsagesNegativeTestJSON-1654928029-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '39023f80a82c4b84b756b528716aafd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf09f8a00ad4e008989140cbcbfcfb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0d647de-edd4-4b05-8835-a87b055ea8d4 tempest-TenantUsagesNegativeTestJSON-1654928029 tempest-TenantUsagesNegativeTestJSON-1654928029-project] Request method failure captured: Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A53%3A25.655843&end=2022-10-05T20%3A53%3A25.655843&detailed=1 HTTP/1.1 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1C7apsB35M6yiNyBHTfKrExT8bzro5J3sw2T3cQBlZgKy0K0owwM3D_AZ83nRNgfh-qGmkL3wa0DwlWqFMYXBPwdcK7gQGW6_6AC6Hz-L_5FYOktIC_MrXftCvs5OZImsXEI2oG3vX-0E6N4snZTkn3Vif1vCmsfIysHriroyBzEs Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: eaf09f8a00ad4e008989140cbcbfcfb2 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1654928029 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf09f8a00ad4e008989140cbcbfcfb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf09f8a00ad4e008989140cbcbfcfb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eaf09f8a00ad4e008989140cbcbfcfb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eaf09f8a00ad4e008989140cbcbfcfb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1654928029 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: eaf09f8a00ad4e008989140cbcbfcfb2 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1654928029 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TenantUsagesNegativeTestJSON-1654928029-project Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 39023f80a82c4b84b756b528716aafd6 Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1654928029-project Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: action_args: {} Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:53:26.770117 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0d647de-edd4-4b05-8835-a87b055ea8d4 tempest-TenantUsagesNegativeTestJSON-1654928029 tempest-TenantUsagesNegativeTestJSON-1654928029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0d647de-edd4-4b05-8835-a87b055ea8d4 tempest-TenantUsagesNegativeTestJSON-1654928029 tempest-TenantUsagesNegativeTestJSON-1654928029-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A53%3A25.655843&end=2022-10-05T20%3A53%3A25.655843&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.506338 Oct 04 20:53:26.780406 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1499/2972] 10.222.0.36 () {58 vars in 1335 bytes} [Tue Oct 4 20:53:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A53%3A25.655843&end=2022-10-05T20%3A53%3A25.655843&detailed=1 => generated 123 bytes in 509 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:26.892557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:26.893737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:26.915365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:26.915365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:26.917150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:26.919706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:26.921015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:26.921987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:27.032253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'flavor' on Instance uuid e348ea2c-51f3-4cd7-aa1b-3beed529f909 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:27.079940 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'shelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state shelved_offloaded Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 14 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: {"shelve": {}} Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'shelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state shelved_offloaded Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'shelve': {}}} Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:53:27.103755 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state shelved_offloaded Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state shelved_offloaded Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'shelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state shelved_offloaded {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:27.115780 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc37be59-617f-46b7-9726-ec5f0e08edd9 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 155 microversion: 2.1 time: 0.225218 Oct 04 20:53:27.122056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:27.126729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:27.136475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1474/2973] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:53:26 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 155 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:53:27.151942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:27.156098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:27.159876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:27.162650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:27.166566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:27.167866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:27.904179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123541) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:53:28.034265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1909193217", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "ad120f21-404b-411d-9099-73e5afb38026"}, {"uuid": "23caefdc-c13b-473c-b190-b8081ae619dd"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:28.282410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] validate_networks() for [('ad120f21-404b-411d-9099-73e5afb38026', None, None, None, None, None), ('23caefdc-c13b-473c-b190-b8081ae619dd', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:28.971596 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13431523-9f50-4b5c-96a8-a3852ad9f1aa tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 1.855068 Oct 04 20:53:28.981893 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1500/2974] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:53:27 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 1868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:53:28.997756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:29.000254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:29.070589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:29.078268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:29.089838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:29.099607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:29.099848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:29.114393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:29.858348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:29.902148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-983b6e0f-cdf9-4049-9fff-d6256e6bddfd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1458 microversion: 2.1 time: 0.907302 Oct 04 20:53:29.902148 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1501/2975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:28 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1458 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:30.949649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:30.955499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:30.974051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:30.975641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:30.976985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:30.988773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:30.992974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:30.997196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:32.069865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:32.096221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1a9da4e-846e-4706-bec4-b91763783997 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1458 microversion: 2.1 time: 1.157193 Oct 04 20:53:32.104599 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1502/2976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:30 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1458 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:32.610203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:32.612671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:32.614487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:32.618109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:32.618109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:32.676953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:32.680816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:32.681831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:32.697812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:32.709210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:32.709210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:32.820343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Getting quotas for project 5f8548060d5c4b84bd8e3b7565884306. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:32.864215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Getting quotas for user 4df2155d4ba740d897b901567be94516 and project 5f8548060d5c4b84bd8e3b7565884306. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:32.976833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:53:32.991824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:53:33.146181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:33.159600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:33.211820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.225689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.228103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.232637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.235067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.238829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.410251 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.383312 Oct 04 20:53:33.423865 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1475/2977] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:53:33.434284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:33.437813 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88c3e177-0aa6-4618-bcde-1f05bc28b65c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003728 Oct 04 20:53:33.440474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1476/2978] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 4 20:53:33 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:53:33.470202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6057ffd7-3a2a-46af-9ec5-3c31c224a35f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:33.472233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6057ffd7-3a2a-46af-9ec5-3c31c224a35f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:33.579227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:33.984463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6057ffd7-3a2a-46af-9ec5-3c31c224a35f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:34.018275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6057ffd7-3a2a-46af-9ec5-3c31c224a35f tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1213 microversion: 2.1 time: 0.575295 Oct 04 20:53:34.024028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1477/2979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:33 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1213 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:34.613465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:34.636455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d361ad0-5184-4545-8072-a79e78df240e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1458 microversion: 2.1 time: 1.497360 Oct 04 20:53:34.646130 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1503/2980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:33 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1458 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:35.075532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22347c4d-279e-4420-9e14-934225f5b658 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:35.080382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22347c4d-279e-4420-9e14-934225f5b658 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:35.539674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22347c4d-279e-4420-9e14-934225f5b658 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:35.594059 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22347c4d-279e-4420-9e14-934225f5b658 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1213 microversion: 2.1 time: 0.530357 Oct 04 20:53:35.600158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1478/2981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:35 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1213 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:35.698579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:35.710477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:35.764808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.768468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.778159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:35.780074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.787222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.815607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:36.653972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:36.657272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:36.721123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:36.722764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:36.727133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:36.736709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:36.741703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:36.750954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:37.438347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:37.477224 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-117ab816-5765-4490-b2aa-6df52d5b0458 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1217 microversion: 2.1 time: 0.836396 Oct 04 20:53:37.482145 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1479/2982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:36 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1217 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:38.092141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:38.136074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4bd19d7-1ce3-4b24-915b-d6656c0823af tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 2.447266 Oct 04 20:53:38.141256 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1504/2983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:35 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:38.535626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:38.545592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:38.593708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:38.600820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:38.609472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:38.645093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:38.645093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:38.645093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.197738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:39.202592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:39.237424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.243035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.248276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.264840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.271202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.273193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.825411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.874621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:39.893109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e9b6df9-d586-4b71-8a52-8acf1d9e53dd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1265 microversion: 2.1 time: 1.369878 Oct 04 20:53:39.895374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1480/2984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:38 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1265 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:40.954832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:40.961945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:40.994069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:40.999903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.004295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.011331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.014552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.015961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.447399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:41.520876 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ea79973-a061-4b23-8c13-d207e0de4e39 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1271 microversion: 2.1 time: 0.574936 Oct 04 20:53:41.528091 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1481/2985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:40 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1271 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:41.815895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:41.863869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-402a9834-6ec4-4764-9c77-dc2c444c1202 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 2.680538 Oct 04 20:53:41.876878 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1505/2986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:42.585411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:42.592126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:42.616317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:42.619549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:42.621406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:42.622833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.624620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:42.625901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:42.626988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.764898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:42.809485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-227493385", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a7ce42c5-968b-4bb1-b61d-8d020d6b1fd3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:42.994158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] validate_networks() for [('a7ce42c5-968b-4bb1-b61d-8d020d6b1fd3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:43.045110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:43.092063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fba2061e-16a5-48f5-9472-a204f7df993b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1271 microversion: 2.1 time: 0.514934 Oct 04 20:53:43.133367 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1506/2987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:42 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1271 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:43.161567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:43.169619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:43.194568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.195343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.196181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:43.197594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.198461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.210991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.352103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:45.378931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac6c3299-4d16-4d56-977a-380b10872c0b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 2.240117 Oct 04 20:53:45.386080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1507/2988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:43 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:45.407255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:45.412315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:45.436896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.437898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.455293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.457295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.458527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.464125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.580536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:45.879453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:45.923618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bf42efc-88fe-4b1c-a0ff-84f888bfbc5c tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1271 microversion: 2.1 time: 0.535717 Oct 04 20:53:45.993036 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1508/2989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:45 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1271 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:46.464652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:46.467397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:46.492256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:46.494395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:46.495784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:46.530898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:46.533820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:46.540438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.030099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:49.031009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:49.031342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:49.031789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:49.032291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:49.056305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:49.085918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.087642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.092683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.094652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.123337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.130850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.338119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Getting quotas for project a6d5e4af6b4741d08a69557bbe3aee6c. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:49.376012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Getting quotas for user 7b9ca25535054532994a262f71798f04 and project a6d5e4af6b4741d08a69557bbe3aee6c. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:49.457218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:53:49.463659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:53:49.709748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.745403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89bc9603-f05c-4406-ac18-afaf061c8a8d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 3.313960 Oct 04 20:53:49.768088 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1509/2990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:46 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 3340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:49.802448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:49.806893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:49.833247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.837686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.852987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.862099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.863618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.865650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.916384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5fb8073-0073-424f-ac57-8349336186f1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.377429 Oct 04 20:53:49.936584 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1482/2991] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 8406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:53:49.978103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf2ea95a-753a-48d5-947f-0a76513ce320 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:49.978399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf2ea95a-753a-48d5-947f-0a76513ce320 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:50.638475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf2ea95a-753a-48d5-947f-0a76513ce320 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.697126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf2ea95a-753a-48d5-947f-0a76513ce320 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1215 microversion: 2.1 time: 0.752092 Oct 04 20:53:50.701480 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1483/2992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:49 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1215 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:50.842537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:50.842537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:50.884717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.888142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.893017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.903979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.908241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.909333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.145595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:51.170985 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d55c49b5-cdb2-4cfc-b66e-1326a9c22508 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1313 microversion: 2.1 time: 1.395499 Oct 04 20:53:51.210136 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1510/2993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:49 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1313 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:51.693073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:51.746449 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e02cdd7-5374-432d-a651-bbbbca9bdc1e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 0.926065 Oct 04 20:53:51.747846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1484/2994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:50 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:51.782545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e188c1e-c6ab-4983-ba41-b863ca2e2d6c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:51.783789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e188c1e-c6ab-4983-ba41-b863ca2e2d6c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:52.223189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:52.224480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:52.284536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.285256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.292562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.292562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.292562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.292562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.418655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e188c1e-c6ab-4983-ba41-b863ca2e2d6c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.471768 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e188c1e-c6ab-4983-ba41-b863ca2e2d6c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1215 microversion: 2.1 time: 0.721444 Oct 04 20:53:52.496362 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1511/2995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:51 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1215 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:52.792078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:52.796332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:52.825949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.828645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.831130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.837013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.838277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.842515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.194316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:53.220219 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b9de2c5-581c-4c38-a495-4c153f790d85 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.008710 Oct 04 20:53:53.226878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1485/2996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:52 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:53.544596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:53.545718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:53.639116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.641067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.646519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.651951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.655523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.659621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.687630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:53.728370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43698874-f744-4d28-8053-0d54e8d3c46b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 0.936181 Oct 04 20:53:53.730041 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1512/2997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:52 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:53.863077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:53.901913 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73034913-64af-48f0-9ab9-adb61bcccdc1 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1219 microversion: 2.1 time: 0.366566 Oct 04 20:53:53.911206 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1486/2998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:53 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1219 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:54.276781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:54.290297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:54.327210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.369982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.369982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.376894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.384305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.392008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.774727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:54.776797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:54.837194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.840019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.844426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.847573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.854615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.867386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.242618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.290267 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7556b0d8-cfcf-4a66-96e2-78dda503c4e6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.021766 Oct 04 20:53:55.311450 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1513/2999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:54 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:55.342487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:55.345074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:55.368303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.369808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.371165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.373066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.374572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.375735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.081551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:56.138199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6081730-75ef-4b77-9ed6-e3783238dffc tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1267 microversion: 2.1 time: 0.824075 Oct 04 20:53:56.139882 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1514/3000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:55 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1267 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:56.202054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:56.219547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:56.221928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Searching by: {'deleted': False, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:53:56.234653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.236150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.237451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.239583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.241573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.242763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.328955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:53:56.567850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60983ff8-46b0-4266-93ad-cadf7d28e7ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.381135 Oct 04 20:53:56.588171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1515/3001] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:53:56 2022] GET /compute/v2.1/servers => generated 339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:56.600297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:56.602592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:56.636790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.642834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.645970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.652681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.655497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.656471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.730346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:56.754034 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9cfba487-8cec-4e77-8550-6b7a438ae74c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.986686 Oct 04 20:53:56.786466 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1487/3002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:54 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:56.806272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:56.822020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:56.824693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Searching by: {'deleted': False, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:53:56.844103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.845446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.846742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.849052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.850186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.851301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.965131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:53:57.094407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.148069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:57.153015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:57.154637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.452539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:58.475254 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-69ed202e-a969-4642-9c88-0585c8df7368 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.885569 Oct 04 20:53:58.490648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9002cb9b-924d-48f6-ac35-6f6e3caf26ac tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.701734 Oct 04 20:53:58.502918 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1516/3003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:56 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:58.503403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1488/3004] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:53:56 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:58.544626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:58.545870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:58.558234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:58.559800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:58.573983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.592189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.592189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.592189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.592946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.596976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.598016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.599635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.600678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.606845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.608249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.608465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.943956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:58.988558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cedfc797-06c5-4dc3-b26b-8fa3db12a36b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1273 microversion: 2.1 time: 0.478646 Oct 04 20:53:58.994064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1517/3005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:58 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1273 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:59.020735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bb34e05-324d-4fea-b897-cf70519082d9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:59.073323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bb34e05-324d-4fea-b897-cf70519082d9 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060170 Oct 04 20:53:59.074678 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1518/3006] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:53:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:59.421967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:59.431030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:59.457539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:59.458572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:59.459780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:59.482766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:59.482766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:59.482766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:59.678344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:00.256142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:00.341874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c6f50d8-fb35-45fe-a310-271618539664 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.826894 Oct 04 20:54:00.351115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1489/3007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:58 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:00.423231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:00.426482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:00.478168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.482032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.490234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc293ca7-cf1a-4f70-8c01-bdc4fcd5a369 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 204 len: 0 microversion: 2.1 time: 1.079573 Oct 04 20:54:00.491184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.491394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1519/3008] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:59 2022] DELETE /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:00.495264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.497188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.500284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.561769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:00.575587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:00.623725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.632298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.635261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.635261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.644986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.665127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.696033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:01.340799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.362256 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7042ad9-5a2c-498a-be9f-5ae380c0f947 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1273 microversion: 2.1 time: 0.874615 Oct 04 20:54:01.373313 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1520/3009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:00 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1273 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:01.402246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:01.409067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:01.450833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.458533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.465823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.468632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.469835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.474231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.470527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:02.531126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:02.575659 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fef1a79c-f635-4200-a28a-06958498e016 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 2.217366 Oct 04 20:54:02.582630 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1490/3010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:00 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:02.605178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "tag": "39d49647-5e80-4c9e-a91a-969be034cf1c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:02.661886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.666291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.670647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.737604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] Creating event network-changed:39d49647-5e80-4c9e-a91a-969be034cf1c for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:02.788862 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-327c3abe-0315-4101-b53a-357597c7ad90 req-d21c6f8e-a773-46fb-90ca-6fb89fc5b78c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201253 Oct 04 20:54:02.795961 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1491/3011] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:02.828462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.831479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.872957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.875995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.878215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.883232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.884486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.888443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.877017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.924286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f93bd3d1-c372-4aa4-ba7a-d030753b3656 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1714 microversion: 2.1 time: 2.547798 Oct 04 20:54:03.940052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1521/3012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:01 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1714 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:03.966574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:03.970813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:03.998360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.000250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.001767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.003334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.004429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.069697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.587489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:05.633633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2607aeb4-092d-4b72-8e75-aa703207378a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 2.834988 Oct 04 20:54:05.651461 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1492/3013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:02 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:06.100673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.144282 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cbfe241b-8b3e-4103-8940-a5622054f617 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 2.198754 Oct 04 20:54:06.162451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1522/3014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:03 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:06.204106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:06.206976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:06.256524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.263357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.267709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.292032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.300545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.312291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.312291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:06.815395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf2c7e13-923c-4f2f-b41b-33569769461d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f60161f0>, body: {"keypair": {"name": "tempest-keypair-622402860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNKBigWxqTBr4Wp/RA7xjzurnH4xUpipxPd+rr952cwhdFr73xeK3w340d5ln9ZBotckGqSm4VkVeUdWGY9jMatsuwJ3vqWAzhgWtZOjZnFVo8mooBwluCcKDYnw126VA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:06.882044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:06.922832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bf2c7e13-923c-4f2f-b41b-33569769461d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:06.955056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bf2c7e13-923c-4f2f-b41b-33569769461d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:07.167623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf2c7e13-923c-4f2f-b41b-33569769461d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.511436 Oct 04 20:54:07.172868 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1493/3015] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:07.198706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:07.204256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:07.233813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.235360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.236681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.238557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.240099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.242057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.991473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.027261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-191997af-f00c-40dc-a97a-ca1b57670666 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 3.861606 Oct 04 20:54:10.042947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1523/3016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:06 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:10.075594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.077536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.079733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.100615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.102082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.104482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.108374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.113263 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f0b2889-c85a-4214-8be0-e40b3c2136fe tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1714 microversion: 2.1 time: 2.929903 Oct 04 20:54:10.115768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.117664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.117937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1494/3017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:07 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1714 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:10.145852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2e9c7e-59e6-4739-acd1-3eedc04872ad", "name": "network-vif-unplugged", "status": "completed", "tag": "40cd5a3d-ce14-4a96-8e61-34e80747498b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:10.195493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.200061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.204338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.250410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] Creating event network-vif-unplugged:40cd5a3d-ce14-4a96-8e61-34e80747498b for instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad on n-h1-851029-13 Oct 04 20:54:10.264171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e0ac48fa-a7ad-46cd-9a0f-e8dfd4899b51 req-e9a3ffed-a282-4915-8926-262e42149a51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141275 Oct 04 20:54:10.271499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1495/3018] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:10.293918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02233040-2338-404f-8d85-a8697445bcb3 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f5f911f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.349098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02233040-2338-404f-8d85-a8697445bcb3 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-622402860" status: 200 len: 497 microversion: 2.1 time: 0.071798 Oct 04 20:54:10.351187 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1496/3019] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-622402860 => generated 497 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:10.357712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.358632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.371956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.372838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.373624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.375007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.375896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.376663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.330588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.359385 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e894742b-52d7-4cee-b5de-35f386f61ea6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.313824 Oct 04 20:54:11.375271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1524/3020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:11.408069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9665995-55f7-4021-b602-fc4cce306ecc tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f5805430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.629880 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9665995-55f7-4021-b602-fc4cce306ecc tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622402860" status: 202 len: 0 microversion: 2.1 time: 0.252545 Oct 04 20:54:11.631882 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1525/3021] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622402860 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:11.641127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.648576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:11.659104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.660396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.661156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.663523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.665005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.666578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.670336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.676116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=76 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:11.707758 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef5d7aaf-cef5-4a04-9d32-63674daed61c tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 1.354556 Oct 04 20:54:11.714397 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1497/3022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:11.734496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.745970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:11.767348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.769428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.769428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.770785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.772692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.773501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.719000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:12.784515 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dcd49f1c-6d07-4201-8bd8-1afe6decc516 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1714 microversion: 2.1 time: 1.067829 Oct 04 20:54:12.806228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1498/3023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:11 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1714 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:12.834982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f61d0310>, body: {"keypair": {"name": "tempest-keypair-481330473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHvfzsnNrgF8VkLVMt6NHp3eEmPJtNQR8pPCJtrniMWkJNqlNyQaT1x+FDCC//DIMqZ1nskaOayj63LBQBe2E7qCg3P1mLFVwJ7Y3yfBXYLzldYK/SLKNgeW8Yg4qp46g=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:12.916170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:12.949273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:13.174401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.359933 Oct 04 20:54:13.181045 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1499/3024] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:13.181045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.184473 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98b11198-3c0b-4738-b99f-cddac7f9fc01 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003443 Oct 04 20:54:13.200441 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1500/3025] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/ => generated 377 bytes in 24 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:54:13.213734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.215737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:13.238033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.239566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.249968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.249968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.249968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.251508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.411343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.465312 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fb5f589-1350-4a4f-835d-61de4f35255b tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.830934 Oct 04 20:54:13.477519 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1526/3026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:11 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:13.515892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.522632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:13.531159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:13.547255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.549398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.554639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.556662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.558072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.559235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.897178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.937180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38adff4f-0c4a-473f-8a15-cd1fa8ea1d06 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.733013 Oct 04 20:54:14.938689 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1501/3027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:14.967540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "tag": "5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:14.993008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.996619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.000152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.042193 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] Creating event network-changed:5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:15.061456 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-18a84f06-06f6-4e00-8a01-c3a91382e856 req-84021f60-67bd-4495-b0b1-7f3bafcc8fad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118782 Oct 04 20:54:15.063314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1502/3028] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:15.078787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:15.079695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74144ce6-6591-4f8a-b473-3bd0d1f31016 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f6082dc0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.117607 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77bf5b4a-1d20-4d63-9c59-17b515ce9ddd tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 1.630509 Oct 04 20:54:15.122324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1527/3029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:15.134928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.138932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.177110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.182964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.184444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.186757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.188108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.191977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.347851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74144ce6-6591-4f8a-b473-3bd0d1f31016 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481330473" status: 202 len: 0 microversion: 2.1 time: 0.278731 Oct 04 20:54:15.347851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1503/3030] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 20:54:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481330473 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:15.388502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:15.430969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.435018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.439492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.533034 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] Creating event network-vif-plugged:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:54:15.566905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-37dda804-d361-4d3a-b54f-a698cf6c0daf req-49e685d5-3e32-4e8b-9299-61a5ed280f89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204967 Oct 04 20:54:15.585014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2e7c905c0e4eaea92e962086799213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3bb2a48b24347c28d987418dedca0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:15.585357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1504/3031] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:15.611799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.620084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.641887 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd284936-c46e-403d-ae1d-5e9a8bae50e5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 200 len: 1647 microversion: 2.1 time: 0.508390 Oct 04 20:54:15.645961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.647691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.648573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.650592 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1528/3032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 1647 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:15.661111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.662589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.663611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.682738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c9c1971-a812-481a-9864-9cc6a6d5ed72 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f56885e0>, body: {"keypair": {"name": "tempest-keypair-1689298172", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:15.746902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8c9c1971-a812-481a-9864-9cc6a6d5ed72 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:15.771840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8c9c1971-a812-481a-9864-9cc6a6d5ed72 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:15.997515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c9c1971-a812-481a-9864-9cc6a6d5ed72 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.338145 Oct 04 20:54:15.997515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1529/3033] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:15 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:16.011220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:16.015694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:16.042127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:16.043542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:16.044382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:16.045749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:16.054882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:16.056069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:16.963070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.991542 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-677a5a93-0fb4-43b0-93c2-f1a72980e4b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.400915 Oct 04 20:54:16.993863 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1505/3034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:17.027945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdf26541-09e6-482b-aa2c-67a2d34fa790 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f60163a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.181987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bdf26541-09e6-482b-aa2c-67a2d34fa790 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689298172" status: 202 len: 0 microversion: 2.1 time: 0.185484 Oct 04 20:54:17.183614 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1506/3035] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689298172 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:17.227389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.228604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:17.269737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.270630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.281937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.285585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:17.287893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.295545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.296634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.324110 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7df69849-6857-49dc-83c5-5d25d00525ea tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.324578 Oct 04 20:54:17.327330 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1530/3036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:17.343217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.347451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] [instance: 4a2e9c7e-59e6-4739-acd1-3eedc04872ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:17.377691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.379025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.380216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.381976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.383401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.387613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.434406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] HTTP exception thrown: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Request method failure captured: Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad HTTP/1.1 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJzpkZbcqRk2TKSt9guExGthrpX1plSXdPGx9CpmbWAVRltdR3cOi7QrZHQfnQV37ROv0nlOfd1bMkNsConSBiDfspXHClxiRgYt8X5-2ZjgAe1CrBtYbRMuhoitSdgwDNs0cvFtCEvUTSAIaVm2afPi_9HV6KrZzcod6Mll2MhjBA0 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c3bb2a48b24347c28d987418dedca0d8 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestManualDisk-1525972290 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3bb2a48b24347c28d987418dedca0d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3bb2a48b24347c28d987418dedca0d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c3bb2a48b24347c28d987418dedca0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c3bb2a48b24347c28d987418dedca0d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestManualDisk-1525972290 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c3bb2a48b24347c28d987418dedca0d8 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestManualDisk-1525972290 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestManualDisk-1525972290-project Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3e2e7c905c0e4eaea92e962086799213 Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestManualDisk-1525972290-project Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4a2e9c7e-59e6-4739-acd1-3eedc04872ad'} Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:17.439548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. Oct 04 20:54:17.450428 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:17.455122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Returning 404 to user: Instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:17.457655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c6ae100-caef-4a94-82e5-b04ee56d3cf3 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad" status: 404 len: 111 microversion: 2.1 time: 0.127265 Oct 04 20:54:17.460634 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1531/3037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:17 2022] GET /compute/v2.1/servers/4a2e9c7e-59e6-4739-acd1-3eedc04872ad => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:17.480056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2e9c7e-59e6-4739-acd1-3eedc04872ad", "name": "network-vif-deleted", "tag": "40cd5a3d-ce14-4a96-8e61-34e80747498b"}, {"name": "network-changed", "server_uuid": "34ba6037-d155-4cc2-aebc-686fae04ea1c", "tag": "bfd16516-6832-410e-b7db-b204792e6bcf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:17.516937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.517917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.518778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.550123 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Creating event network-vif-deleted:40cd5a3d-ce14-4a96-8e61-34e80747498b for instance 4a2e9c7e-59e6-4739-acd1-3eedc04872ad on n-h1-851029-13 Oct 04 20:54:17.551329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] Creating event network-changed:bfd16516-6832-410e-b7db-b204792e6bcf for instance 34ba6037-d155-4cc2-aebc-686fae04ea1c on n-h1-851029-13 Oct 04 20:54:17.600910 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-133f727a-19a1-45c9-8903-b52001541eb3 req-0462706c-70a8-4afc-935a-5028ecf67053 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.133193 Oct 04 20:54:17.602964 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1532/3038] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:17.614033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d64f5b73-23cc-41f8-bf83-9dec29d33b10 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f56a90d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1587783019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEq0X3XdEpNWdV60iCqjDuURc1AdhpHLT1/lfLlSfM+RvHB+9BZvyclDpZNaDYI/9s00CpvfWO/cn4+cJTvdpfs19jTYyi+G95ektmm2ImDwgqOKKJ6TjDD87eQh0iMyw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:17.685734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d64f5b73-23cc-41f8-bf83-9dec29d33b10 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:17.712412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d64f5b73-23cc-41f8-bf83-9dec29d33b10 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:18.015620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d64f5b73-23cc-41f8-bf83-9dec29d33b10 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.409881 Oct 04 20:54:18.025828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1533/3039] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:18.050205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3c526b3-ed18-4825-a150-ef68f6dac0d5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] Calling method '.version_select at 0x7f54f56cb820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:18.340387 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3c526b3-ed18-4825-a150-ef68f6dac0d5 tempest-ServersTestManualDisk-1525972290 tempest-ServersTestManualDisk-1525972290-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325409756" status: 202 len: 0 microversion: 2.1 time: 0.319232 Oct 04 20:54:18.359299 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1534/3040] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325409756 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:18.386342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6876d8cc-ef6f-4d87-90f3-a2a65abc2007 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f55f8310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-846271911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkn6B+MIzaFKCL5cnXYe3scveJ8WrokWi3f3ojMRp/hJ15dv2piEwSkZ+BCJnqj9J985IDowywWobJ+A/zv047NztV6AsIqwxVyit18uNWLQnliOiArgW4vW5iZql7uhw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:18.470644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6876d8cc-ef6f-4d87-90f3-a2a65abc2007 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:18.491012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6876d8cc-ef6f-4d87-90f3-a2a65abc2007 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:18.616251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:18.662179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fcedcea4-dd30-4b40-a66d-a5d2858e0990 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 1.475547 Oct 04 20:54:18.665580 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1507/3041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:17 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:18.694122 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6876d8cc-ef6f-4d87-90f3-a2a65abc2007 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.330060 Oct 04 20:54:18.706200 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1535/3042] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:18.718087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:18.723297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:18.725544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:18.729772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:18.764395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.765334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.766167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.770553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.773417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.774026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.783482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.790155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.796030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.800382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.802284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.806087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.756237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:19.783306 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e05d303f-bde4-453e-9cb6-128a5889ffa5 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.094800 Oct 04 20:54:19.784912 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1508/3043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:18 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:19.807687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fca82396-3ac2-4d87-a031-8f6f9ff18beb tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Action: 'create', calling method: .version_select at 0x7f54f5fcfdc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1197097426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOeP3SdDQNL/usTQ2D8VviNsWveI5HlrnsDDJJxRLYVpNgxP0dq9gd1eBRwcgEkmdyArFsyCFNGdHTPefGVP7q36iVCiaSAthy0I7Vr2mBQMxaMg/0QQcXY7UnD6vrtAA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:19.832580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:19.841067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:19.859963 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8a0ca60-6260-442a-b732-d1a48725f406 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 1.162400 Oct 04 20:54:19.879415 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1536/3044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:18 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:19.905169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=19 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:19.917130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:19.918127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:19.921634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fca82396-3ac2-4d87-a031-8f6f9ff18beb tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:19.965429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fca82396-3ac2-4d87-a031-8f6f9ff18beb tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Getting quotas for user fe852bb636494365b8a7291002668bac and project 3a5e032a8b7f4d08b895395358bb9741. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:19.970488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.971455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.972846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.974538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.975829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.977113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.202066 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fca82396-3ac2-4d87-a031-8f6f9ff18beb tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.415139 Oct 04 20:54:20.214953 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1509/3045] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:54:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:20.254005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b00e96d2-857c-4d26-acd4-3bfda494945f tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f6016ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.289690 n-d-851029-13 devstack@n-api.service[123542]: WARNING oslo_db.sqlalchemy.utils [None req-b00e96d2-857c-4d26-acd4-3bfda494945f tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:54:20.334230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b00e96d2-857c-4d26-acd4-3bfda494945f tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.106717 Oct 04 20:54:20.342716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1510/3046] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 20:54:20 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:20.376855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80534156-cae1-4c6f-aaaa-7bf19fd6e8ce tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f6411430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.459068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:20.490581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-072db975-be80-4c63-acd0-3271a2b0df55 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 0.592890 Oct 04 20:54:20.513176 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1537/3047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:19 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:20.615900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80534156-cae1-4c6f-aaaa-7bf19fd6e8ce tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1197097426" status: 202 len: 0 microversion: 2.1 time: 0.264404 Oct 04 20:54:20.623212 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1511/3048] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 20:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1197097426 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:20.634008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68836bde-f06e-4137-a61b-98d1e7e11822 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f575e5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.842145 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68836bde-f06e-4137-a61b-98d1e7e11822 tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-846271911" status: 202 len: 0 microversion: 2.1 time: 0.215369 Oct 04 20:54:20.860655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1538/3049] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-846271911 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:20.862201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.863368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:20.866206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-defcbef3-28db-4ca5-bed1-eaacf97d664d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] Calling method '.version_select at 0x7f54f56a9430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.905400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:20.906728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:20.918161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.919723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:20.920725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:20.921630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.098713 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-defcbef3-28db-4ca5-bed1-eaacf97d664d tempest-KeyPairsV2TestJSON-851512230 tempest-KeyPairsV2TestJSON-851512230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1587783019" status: 202 len: 0 microversion: 2.1 time: 0.246242 Oct 04 20:54:21.110612 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1539/3050] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 20:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1587783019 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:21.126496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:21.129019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:21.153673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.155365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.163942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.163942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.163942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.163942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.889654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:21.957382 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0631224e-b876-4892-85fc-25a5587d959e tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.109991 Oct 04 20:54:21.982067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1512/3051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:20 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:22.006121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.009355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.024184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.025994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.027767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.030865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.032189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.033440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:23.197698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:23.227180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2b6a7da-fa10-43f4-bcb4-b9fe9e61d6dc tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1516 microversion: 2.1 time: 2.110122 Oct 04 20:54:23.228273 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1540/3052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:21 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1516 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:23.245772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:23.252701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:23.276990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:23.277720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:23.278402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:23.284291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:23.287177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:23.287177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.117341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:24.128744 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-828a8559-9697-44b5-a1d2-2460b23549e9 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 2.144132 Oct 04 20:54:24.141716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1513/3053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:21 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:24.289636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:24.290891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:24.322604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.328791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.329635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.331042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.331909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.332714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.879196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:24.932115 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b011a325-f3b7-487d-a1ac-af88a22795c2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.698460 Oct 04 20:54:24.943117 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1541/3054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:23 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:25.197216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:25.200431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:25.237217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.242943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.245081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.247598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.251858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.256120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.217985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:26.264755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9fa36f6-191c-4b45-9ce9-8ea578db9362 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.983355 Oct 04 20:54:26.265837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1514/3055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:24 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:26.293523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:26.298132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:26.329114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.333491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.336403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.347718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.355568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.356854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.724410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:26.758493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37164ce0-bf8b-4924-ba7d-00f1de5d6b99 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 1.571143 Oct 04 20:54:26.763271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1542/3056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:25 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:26.806154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ba6037-d155-4cc2-aebc-686fae04ea1c", "name": "network-vif-plugged", "status": "completed", "tag": "bfd16516-6832-410e-b7db-b204792e6bcf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:26.871745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.874972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.876324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.911871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:26.932727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] Creating event network-vif-plugged:bfd16516-6832-410e-b7db-b204792e6bcf for instance 34ba6037-d155-4cc2-aebc-686fae04ea1c on n-h1-851029-13 Oct 04 20:54:26.940899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e727b4c6-9e96-4d76-8ac4-316c72906df6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 0.669493 Oct 04 20:54:26.949325 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1515/3057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:26 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:26.953065 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-bb7bdd5b-ecd8-4372-b71e-4ec1f86856f6 req-3e5d461a-4d51-4136-badb-db8b1ac630e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186463 Oct 04 20:54:26.955780 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1543/3058] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:26.974550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:26.975670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:26.994147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.995199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.997067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.999260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:27.015779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:27.016935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:27.621900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:27.652448 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3454c438-c70c-44c2-8ada-c999d0847ac5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.698872 Oct 04 20:54:27.683296 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1516/3059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:26 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:27.720370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:27.722091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:27.733645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:27.734903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:27.735754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:27.742542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:27.744195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:27.745557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.215547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:28.248507 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ff28946-3f9b-4fe1-9b15-5d6942ac5b68 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.535350 Oct 04 20:54:28.269693 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1517/3060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:27 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:28.307694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:28.309592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:28.325940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.327755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.328987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.330905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.332296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.335249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.516594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9df08427-4019-4ad1-9923-f9975e80d35a tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Action: 'create', calling method: .version_select at 0x7f54f56400d0>, body: {"pool": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:28.545399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:28.836819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:28.864118 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf3c70e4-6436-4a77-9a85-da898762bdad tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1315 microversion: 2.1 time: 0.569952 Oct 04 20:54:28.872651 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1518/3061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:28 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:28.897737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:28.901035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:28.936707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.940530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.941796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.949462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.951053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.952374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:29.748890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:29.795664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cea05476-3ef0-43f8-bb61-1bb2b3a666bd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 0.919003 Oct 04 20:54:29.799139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1519/3062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:28 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:29.820086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85434725-0849-471b-b1e5-ceb32ea1e1a6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:29.846766 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-85434725-0849-471b-b1e5-ceb32ea1e1a6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85434725-0849-471b-b1e5-ceb32ea1e1a6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/cc89fc01-d38e-4a6c-8e84-3778ac113b66/action HTTP/1.1 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 15 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: {"os-stop": {}} Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'cc89fc01-d38e-4a6c-8e84-3778ac113b66', 'body': {'os-stop': {}}} Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:29.862018 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. Oct 04 20:54:29.871570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:29.876870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85434725-0849-471b-b1e5-ceb32ea1e1a6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance cc89fc01-d38e-4a6c-8e84-3778ac113b66 has no mapping to a cell. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:29.882029 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85434725-0849-471b-b1e5-ceb32ea1e1a6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/cc89fc01-d38e-4a6c-8e84-3778ac113b66/action" status: 404 len: 117 microversion: 2.1 time: 0.077731 Oct 04 20:54:29.889082 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1520/3063] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:29 2022] POST /compute/v2.1/servers/cc89fc01-d38e-4a6c-8e84-3778ac113b66/action => generated 117 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:29.909066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "name": "network-vif-plugged", "status": "completed", "tag": "39d49647-5e80-4c9e-a91a-969be034cf1c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:29.944339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:29.945306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:29.946231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:29.989233 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] Creating event network-vif-plugged:39d49647-5e80-4c9e-a91a-969be034cf1c for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:30.009847 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-24994b85-beaf-48e7-8272-0210232707eb req-c144b73f-75c5-44e2-a7d2-f4fc934200f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120077 Oct 04 20:54:30.017698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1521/3064] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:30.038478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:30.052937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:30.078768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.079670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.080519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:30.081880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.082838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.083660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:30.874192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:30.926214 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6f0d0bd-c8c6-44d7-bb1b-1209e32a2237 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.906371 Oct 04 20:54:30.932811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1522/3065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:30 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:30.987907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:30.989839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.006706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:31.011785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.014367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.016540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.018854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.020158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.022232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.813914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.854155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a12754ed-0e27-44b8-9426-022698dbf742 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1504 microversion: 2.1 time: 0.903605 Oct 04 20:54:31.856086 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1523/3066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:30 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1504 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:31.878078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:31.884411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.918877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.921283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.922210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.927866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.931179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.932867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:32.055213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:33.756119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:33.812082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9558541c-463d-48f8-9d70-5b468acf9fff tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 1.950357 Oct 04 20:54:33.822215 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1524/3067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:31 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:33.905625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:33.913757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:33.981164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:33.996873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.005115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.012932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.017248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.022540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.981388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:36.010614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65d3bba6-4379-439d-9aa6-bcd84d866cb8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.189009 Oct 04 20:54:36.012267 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1525/3068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:33 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:36.031916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:36.033415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:36.048543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.049463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.050269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.051675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.053391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.054175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.134794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:36.755307 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-24067730-e1d9-4a49-a834-c38850f914c0 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 204 len: 0 microversion: 2.1 time: 0.740502 Oct 04 20:54:36.756907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1526/3069] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:36 2022] DELETE /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:36.778327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "name": "network-vif-plugged", "status": "completed", "tag": "5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:36.811761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.812734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.814026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.839597 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] Creating event network-vif-plugged:5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:36.851739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fede7022-7bd2-46df-aadd-0f3ce891bc45 req-e4071955-beb5-4fa3-a0c7-4c6b3c26e625 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091927 Oct 04 20:54:36.853347 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1527/3070] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:36.866405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:36.869065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:36.883596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:36.901102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.903527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.904399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.905355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=89 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:36.906518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.907742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.910492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.674070 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9df08427-4019-4ad1-9923-f9975e80d35a tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 10.063946 Oct 04 20:54:37.677616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1544/3071] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:54:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 10071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:37.698296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:37.702255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 3b886d91-06ec-4564-894d-b1d420bfbe36] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.739588 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/3b886d91-06ec-4564-894d-b1d420bfbe36/action HTTP/1.1 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: {"suspend": {}} Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3b886d91-06ec-4564-894d-b1d420bfbe36', 'body': {'suspend': {}}} Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.747809 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.756275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.756275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.756275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. Oct 04 20:54:37.756275 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.763598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 3b886d91-06ec-4564-894d-b1d420bfbe36 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.764581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d18fc1b-37bd-4946-bb0e-d444dc78c162 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/3b886d91-06ec-4564-894d-b1d420bfbe36/action" status: 404 len: 111 microversion: 2.1 time: 0.080822 Oct 04 20:54:37.766015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1545/3072] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:37 2022] POST /compute/v2.1/servers/3b886d91-06ec-4564-894d-b1d420bfbe36/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.781319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.783060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.799145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.800086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.800944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.807313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.810748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.811555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.813242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.820866 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c3e30250-6e8c-4308-b4ad-e631bfe0a0b6 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1334 microversion: 2.1 time: 0.964575 Oct 04 20:54:37.822099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1528/3073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:36 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1334 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:37.834305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74d6d704-6164-4c7f-a197-c9d2ed90d102 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Action: 'create', calling method: .version_select at 0x7f54f60164c0>, body: {"pool": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:38.839503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:38.883039 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2559960c-2206-4fc0-b4c1-db1dff3ce6ec tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1510 microversion: 2.1 time: 1.113531 Oct 04 20:54:38.885082 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1546/3074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1510 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:38.905970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.914158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.937323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.938865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.940050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.944082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.946025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.947103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:39.800272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:39.816331 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66685160-b2f1-4ea1-8588-2ecb71f4d50d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.928616 Oct 04 20:54:39.841006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1547/3075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:38 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:39.884713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:39.891817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:39.909215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:39.909933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:39.913142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:39.914590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:39.918075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:39.918992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.663419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:40.706067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c884eb4a-7274-45f3-836b-17e0d1a30e86 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1669 microversion: 2.1 time: 0.842914 Oct 04 20:54:40.712164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1548/3076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:39 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1669 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:40.722783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:40.724801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:40.751543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.753518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.761738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.770996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.772434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.773662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:41.529495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.544441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8815c5c-2c5d-4aa0-8856-135bbc38c66a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.830081 Oct 04 20:54:41.545575 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1549/3077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:40 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:41.555471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:41.557058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:41.572996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.574352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.575508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:41.577183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.578495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.579655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.028440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9ca25535054532994a262f71798f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d5e4af6b4741d08a69557bbe3aee6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:42.055149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0db0adfc-0254-466a-82dd-58cf23a65b62 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 200 len: 1300 microversion: 2.1 time: 0.507517 Oct 04 20:54:42.056311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1550/3078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:41 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 1300 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:42.066794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:42.068070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:42.082023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.084029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.085893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.087818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.089202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.090392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.155822 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f54e7402-dbec-414a-92a7-bad96c31c277 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95/ips" status: 200 len: 179 microversion: 2.1 time: 0.096968 Oct 04 20:54:42.157515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1551/3079] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 20:54:42 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95/ips => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:42.167620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ba6037-d155-4cc2-aebc-686fae04ea1c", "name": "network-vif-deleted", "tag": "bfd16516-6832-410e-b7db-b204792e6bcf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:42.187503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.188867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.189672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.248078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] Creating event network-vif-deleted:bfd16516-6832-410e-b7db-b204792e6bcf for instance 34ba6037-d155-4cc2-aebc-686fae04ea1c on n-h1-851029-13 Oct 04 20:54:42.267133 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1f5dae23-b3cf-433c-9a34-c9f6087e948c req-87afdfb3-aae2-4bbe-a145-bc30ea683ad1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105066 Oct 04 20:54:42.271096 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1552/3080] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:42.306852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:42.311345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:42.331351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.333951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.337803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.341906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.344021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.345443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.449804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'flavor' on Instance uuid e348ea2c-51f3-4cd7-aa1b-3beed529f909 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:43.144461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a25843d-04c1-40d1-87b5-a81fe1292df4 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 0.869866 Oct 04 20:54:43.172200 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1553/3081] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:42 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:43.199038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:43.200319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:43.243800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.250446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.253582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.257821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.265918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.273945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.384001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:44.069921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5e0d3de-c883-4c18-bac3-76c1508b0b99 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 204 len: 0 microversion: 2.1 time: 0.895139 Oct 04 20:54:44.071295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1554/3082] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:43 2022] DELETE /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:44.107026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.108479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.150214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.151349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.152219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.163404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.169577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.170616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.280803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c HTTP/1.1 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '34ba6037-d155-4cc2-aebc-686fae04ea1c'} Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.292230 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:44.302277 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb54451d-63d6-4baa-b305-560bc094633b tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 404 len: 111 microversion: 2.1 time: 0.224379 Oct 04 20:54:44.309180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1555/3083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:44.332621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.336677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.362712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.364096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.365217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.368703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.371168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.375054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.726899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.773133 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-545fc2fc-ca7c-4ce0-a41a-f6ad4a38e19c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1511 microversion: 2.1 time: 1.457186 Oct 04 20:54:45.794703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1556/3084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1511 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:45.794703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:45.796073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.830532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.647539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.679849 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ba02d72-fb0d-4e18-82e0-4375c7a723b2 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1675 microversion: 2.1 time: 0.898651 Oct 04 20:54:46.682468 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1557/3085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:45 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1675 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:46.708803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-358324463", "metadata": {"image_type": "test"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:46.739707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:46.761654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.763806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.767903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.769526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.771033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.772090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.837728 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c/action HTTP/1.1 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 111 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-358324463", "metadata": {"image_type": "test"}}} Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '34ba6037-d155-4cc2-aebc-686fae04ea1c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-358324463', 'metadata': {'image_type': 'test'}}}} Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:54:46.844425 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9c85cc3-6746-4ccd-806f-2bb6a7d0c8ee tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "POST /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c/action" status: 404 len: 111 microversion: 2.1 time: 0.163892 Oct 04 20:54:46.864935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1558/3086] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 4 20:54:46 2022] POST /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c/action => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:46.879079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:46.880188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:46.890740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:46.898801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.899862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.901358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.904207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.906007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.907342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:47.729284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74d6d704-6164-4c7f-a197-c9d2ed90d102 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.905049 Oct 04 20:54:47.730407 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1529/3087] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:54:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:47.749532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:47.762495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1065607890", "metadata": {"image_type": "test"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:47.773886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Failed to fetch instance by id tempest-invalid-1257221951 {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:54:47.777274 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance tempest-invalid-1257221951 could not be found. Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/tempest-invalid-1257221951/action HTTP/1.1 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 112 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1065607890", "metadata": {"image_type": "test"}}} Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance tempest-invalid-1257221951 could not be found. Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'tempest-invalid-1257221951', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1065607890', 'metadata': {'image_type': 'test'}}}} Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1257221951 could not be found. Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:47.783891 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1257221951 could not be found. Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1257221951 could not be found. Oct 04 20:54:47.793525 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:54:47.798239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d91525f-3bf9-445e-b319-2586e7f5d361 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1494 microversion: 2.1 time: 0.943786 Oct 04 20:54:47.802839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance tempest-invalid-1257221951 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:47.804659 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16372b5f-6770-4c74-86cb-a8a0ba4df463 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "POST /compute/v2.1/servers/tempest-invalid-1257221951/action" status: 404 len: 101 microversion: 2.1 time: 0.063268 Oct 04 20:54:47.807632 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1559/3088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:46 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1494 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:47.819067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1530/3089] 10.222.0.36 () {60 vars in 1249 bytes} [Tue Oct 4 20:54:47 2022] POST /compute/v2.1/servers/tempest-invalid-1257221951/action => generated 101 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:47.848907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:47.850244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e09f750-7b0b-471b-8af7-583f368bc613 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Action: 'create', calling method: .version_select at 0x7f54f6082e50>, body: {"pool": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:47.854840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:47.884837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:47.899513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:47.904791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:47.919232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:47.920647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:47.921364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:47.922002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.041564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.070018 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a378fccd-761c-44a4-9da8-fe883f050707 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1675 microversion: 2.1 time: 1.257605 Oct 04 20:54:49.087312 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1560/3090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:47 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1675 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:49.116531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1606674630"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.123936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:54:49.123936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 57 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: {"createImage": {"name": "tempest-test-snap-1606674630"}} Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1606674630'}}} Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.125865 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.137101 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.141802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:49.143872 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a283d07a-1a08-4db7-a50b-cf74f2d77890 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.054230 Oct 04 20:54:49.154376 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1561/3091] 10.222.0.36 () {60 vars in 1275 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:49.191095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.196117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:49.224732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.228319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.231309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.236822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.238704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.240722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.294913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:49.310548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'flavor' on Instance uuid e348ea2c-51f3-4cd7-aa1b-3beed529f909 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:49.344625 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'suspend' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state suspended Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: {"suspend": {}} Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'suspend' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state suspended Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'suspend': {}}} Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 20:54:49.351296 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state suspended Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state suspended Oct 04 20:54:49.372408 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.380660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'suspend' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state suspended {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:49.380660 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d60d95e-e8cb-4df5-9830-26c09d05ca91 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 148 microversion: 2.1 time: 0.219412 Oct 04 20:54:49.387340 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1562/3092] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 148 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:54:49.401161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "name": "network-vif-unplugged", "status": "completed", "tag": "39d49647-5e80-4c9e-a91a-969be034cf1c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.432410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.434386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.436064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.469091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] Creating event network-vif-unplugged:39d49647-5e80-4c9e-a91a-969be034cf1c for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:49.479431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a1695ee8-6c12-4b68-b66a-6789ea8f886d req-b93a1615-c37b-4433-9219-1398b8c4b7fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089111 Oct 04 20:54:49.481837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1563/3093] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-43824231"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 55 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: {"createImage": {"name": "tempest-test-snap-43824231"}} Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-43824231'}}} Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:49.505798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:49.511750 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dd6017c-1103-4645-86f1-b3ed416bc3eb tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020006 Oct 04 20:54:49.518721 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1564/3094] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:49.526412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.528148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:49.549519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.553338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.558829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.563310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.568409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.569755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.193395 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91914d91-c8cd-44db-bca0-a3371a02c12c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 202 len: 0 microversion: 2.1 time: 0.673906 Oct 04 20:54:50.205306 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1565/3095] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:50.239857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:50.244054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:50.283297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.284893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.289310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.292726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.296579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.297538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.425468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c HTTP/1.1 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '34ba6037-d155-4cc2-aebc-686fae04ea1c'} Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:50.440178 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:50.451747 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7340055c-01df-4580-a38c-de110202c0c7 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 404 len: 111 microversion: 2.1 time: 0.234621 Oct 04 20:54:50.456644 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1566/3096] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:50 2022] DELETE /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:50.508314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "name": "network-vif-deleted", "tag": "5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:50.542197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.543364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.544441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.568927 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] Creating event network-vif-deleted:5da4fd4f-5d03-4a3c-94e1-3ea3c0774a6d for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:50.581178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d6eeb4ab-1966-4e0a-ab13-47a0b0d5b7ca req-5d10a8ba-8166-4f6b-ba4e-47994656ee7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101849 Oct 04 20:54:50.583760 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1567/3097] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:50.595053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:50.597745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:50.615798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.617195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.618522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.620575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.622316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.623502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.110297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.131881 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a1a055a-fbb0-494a-a904-df9ea2d6d6e1 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1654 microversion: 2.1 time: 1.545684 Oct 04 20:54:52.134802 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1568/3098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:50 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1654 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:52.147966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:52.149747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.172414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.894518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.917414 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-736c71f6-eaa2-4204-a2a2-2c4d24e2dbbd tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1500 microversion: 2.1 time: 0.777765 Oct 04 20:54:52.919576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1569/3099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:52 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1500 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:52.933033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:52.935465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] [instance: 34ba6037-d155-4cc2-aebc-686fae04ea1c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:52.951087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.952976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.953862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.956139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.959380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.960699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.998287 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] HTTP exception thrown: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Request method failure captured: Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c HTTP/1.1 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ1UBktoHkQ64BrrLKyjs5YsoOXGBq1m4vK_tMvgvgVa9_fS05AL97tk3OcxVMg4zydleM5Qu_05r6ZS_EaMAxXmtDVxiDFNHni573q9D70pLK68nHdgzzLdXstghtszmB0ZJ9lk_g6bi_rTLBM7iZ06ApLEVo1mcqwsN6cdmfWrlNk Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a6d5e4af6b4741d08a69557bbe3aee6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a6d5e4af6b4741d08a69557bbe3aee6c Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-937870381 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7b9ca25535054532994a262f71798f04 Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesNegativeTestJSON-937870381-project Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '34ba6037-d155-4cc2-aebc-686fae04ea1c'} Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:53.002407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] Returning 404 to user: Instance 34ba6037-d155-4cc2-aebc-686fae04ea1c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:53.011823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0fc9364a-56bc-49b9-b98a-c57dbd854a45 tempest-ImagesNegativeTestJSON-937870381 tempest-ImagesNegativeTestJSON-937870381-project] 10.222.0.36 "GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c" status: 404 len: 111 microversion: 2.1 time: 0.083194 Oct 04 20:54:53.013091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1570/3100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:52 2022] GET /compute/v2.1/servers/34ba6037-d155-4cc2-aebc-686fae04ea1c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:53.196603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:53.198654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:53.216264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.217104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.218178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.220154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.221484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.221843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.497388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:53.518718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6ffbd28-b851-4bc8-8bb3-1dd34910c97d tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1454 microversion: 2.1 time: 0.337478 Oct 04 20:54:53.531703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1571/3101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:53 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1454 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:53.779069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698a201-ec21-4d08-915a-42ebbae04a95", "name": "network-vif-deleted", "tag": "39d49647-5e80-4c9e-a91a-969be034cf1c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:53.799953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.801026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.804214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.845264 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] Creating event network-vif-deleted:39d49647-5e80-4c9e-a91a-969be034cf1c for instance e698a201-ec21-4d08-915a-42ebbae04a95 on n-h2-851029-13 Oct 04 20:54:53.871643 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a13f2754-9dec-4427-9b0a-f2c65165b2ec req-36a4d459-bcb8-475c-8582-a426eeab662e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100250 Oct 04 20:54:53.877872 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1572/3102] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:53.965220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:53.967182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:53.982534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.984199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.985601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.987433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.988634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.990593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.856852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.915965 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aaef1826-22c9-4bf3-a184-b8254017f30f tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.939743 Oct 04 20:54:54.915965 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1573/3103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:53 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:54.929622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:54.931393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:54.977753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.980146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.982805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.986416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.992911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.999084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.255281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.256402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.257250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.258289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lazy-loading 'fault' on Instance uuid e698a201-ec21-4d08-915a-42ebbae04a95 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:55.632676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df2155d4ba740d897b901567be94516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8548060d5c4b84bd8e3b7565884306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:55.666946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc5d9c82-861c-41e3-bbb7-ca3a3d6be293 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 200 len: 1303 microversion: 2.1 time: 0.748782 Oct 04 20:54:55.668943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1574/3104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:54 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 1303 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:55.689018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:55.690756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:55.734792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.739970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.749652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.758119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.759295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.765326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:56.575279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:56.613934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c00216d6-b5ed-4a10-b5d5-c40f145d451b tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.942699 Oct 04 20:54:56.623173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1575/3105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:55 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:56.682140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:56.686494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 088bbb6e-ff06-4702-a402-6492525b885a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:56.713946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/088bbb6e-ff06-4702-a402-6492525b885a/action HTTP/1.1 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: {"unpause": {}} Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '088bbb6e-ff06-4702-a402-6492525b885a', 'body': {'unpause': {}}} Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:56.717677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 088bbb6e-ff06-4702-a402-6492525b885a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba865159-9810-4b39-b10e-82c48f117426 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/088bbb6e-ff06-4702-a402-6492525b885a/action" status: 404 len: 111 microversion: 2.1 time: 0.051761 Oct 04 20:54:56.728560 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1576/3106] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:56 2022] POST /compute/v2.1/servers/088bbb6e-ff06-4702-a402-6492525b885a/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:56.739525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:56.746406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.384840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.388495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.392187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.398184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.400597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.403845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.446416 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 HTTP/1.1 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e698a201-ec21-4d08-915a-42ebbae04a95'} Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.451359 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:54:57.461158 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.464884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:57.467344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dd9962f-3670-4c01-8c81-c4cdb1058755 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 404 len: 111 microversion: 2.1 time: 0.738775 Oct 04 20:54:57.471717 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1577/3107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:56 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 111 bytes in 745 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:57.483272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.485312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.509754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.647005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.688796 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8599e3c7-ad28-4c86-ad4f-76a4cb700040 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.214667 Oct 04 20:54:58.705930 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1578/3108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:57 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:58.752131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.754336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.772210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.775498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.780425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.783554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.784388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.785085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.564457 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e09f750-7b0b-471b-8af7-583f368bc613 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 11.748455 Oct 04 20:54:59.577406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1531/3109] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:54:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 11752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:59.591833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f402bd2e-c0ee-4dde-8507-d8a1bf2356f3 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Action: 'create', calling method: .version_select at 0x7f54f5ffaa60>, body: {"pool": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:00.058911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.077597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3f4a7b0-dd54-4627-af73-0c9e854501cf tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.336589 Oct 04 20:55:00.098600 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1579/3110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:00.141388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:00.142393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:00.174059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.176031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.177520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.178965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.179863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.180683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.312103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'unpause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: {"unpause": {}} Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'unpause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'unpause': {}}} Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:00.316114 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:00.326034 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:00.326034 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:00.326034 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:00.326034 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:00.326034 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:00.331124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'unpause' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:00.334488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e116793-2041-44c2-af58-4502cf2f844a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 145 microversion: 2.1 time: 0.211383 Oct 04 20:55:00.344532 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1580/3111] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:55:00 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 145 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:55:00.357233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:00.358602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:00.373420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.375122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.375960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.377682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.378936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.380629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:02.375188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:02.408619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0fff959-898c-4599-989d-200fb7d2c224 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 2.061760 Oct 04 20:55:02.413290 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1581/3112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:00 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:02.467015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:02.468673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:02.483699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.484969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.486049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:02.487823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.489093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.490200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.776167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.802739 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f5450809-88eb-449b-b4cb-dd67c2dd70a1 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.343567 Oct 04 20:55:03.816912 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1582/3113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:02 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:04.468729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1925206940", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:04.766882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:07.785799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:07.791252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:07.800058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:07.800058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:07.800058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:07.841181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.842243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.842999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.848519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.849652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.850438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.935133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:07.962088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:08.090947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:08.108267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:08.843881 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f12581bf-4837-4d71-9505-4923a775037c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.004297 Oct 04 20:55:08.848416 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1583/3114] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:55:08.876486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:08.877607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: f0ce48b5-5faa-47a4-bae2-7c86feb31e8e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:08.906505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:08.909383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/f0ce48b5-5faa-47a4-bae2-7c86feb31e8e/action HTTP/1.1 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 18 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: {"unshelve": null} Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'f0ce48b5-5faa-47a4-bae2-7c86feb31e8e', 'body': {'unshelve': None}} Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:08.919228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance f0ce48b5-5faa-47a4-bae2-7c86feb31e8e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-beff1175-5769-4955-91bf-1e17d49fe4b6 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/f0ce48b5-5faa-47a4-bae2-7c86feb31e8e/action" status: 404 len: 111 microversion: 2.1 time: 0.073107 Oct 04 20:55:08.938391 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1584/3115] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:55:08 2022] POST /compute/v2.1/servers/f0ce48b5-5faa-47a4-bae2-7c86feb31e8e/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:10.107290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d68ff47-9989-492c-a199-8e0065a86e9c tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f585dd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1295966830", "description": "tempest-description-1392385883"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:11.389153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f402bd2e-c0ee-4dde-8507-d8a1bf2356f3 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 11.804841 Oct 04 20:55:11.402094 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1532/3116] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 20:54:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 11824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:11.427227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdf967e1-caab-4a48-94fb-69d15ba8c43d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:11.445364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fdf967e1-caab-4a48-94fb-69d15ba8c43d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:11.870194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fdf967e1-caab-4a48-94fb-69d15ba8c43d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:11.894350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdf967e1-caab-4a48-94fb-69d15ba8c43d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1215 microversion: 2.1 time: 0.489960 Oct 04 20:55:11.899566 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1533/3117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:11 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:11.910642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:11.912311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:11.933127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.936740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.937729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:11.942529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.952250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.953084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:12.287035 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d68ff47-9989-492c-a199-8e0065a86e9c tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 3.356308 Oct 04 20:55:12.290775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1585/3118] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:08 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 3362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:12.335597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1e478a3-4c57-45ce-be42-1ec8faa43e49 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f5688310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.042285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:13.120230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53325374-f732-481c-bf83-a1ea20b8af3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.210531 Oct 04 20:55:13.126688 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1534/3119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:11 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:13.178163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.189751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:13.240314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.248885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.249894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.272435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.272435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.272435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.359851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 HTTP/1.1 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e698a201-ec21-4d08-915a-42ebbae04a95'} Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:13.363371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:13.380748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:13.389632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa955f0d-6707-4820-b5ef-3d91c176ab12 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 404 len: 111 microversion: 2.1 time: 0.257879 Oct 04 20:55:13.393753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1535/3120] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:13 2022] DELETE /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:13.419995 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b1e478a3-4c57-45ce-be42-1ec8faa43e49 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/15ddeb8b-d393-473a-9bd9-0329a3a5edea" status: 200 len: 141 microversion: 2.1 time: 1.124688 Oct 04 20:55:13.434908 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1586/3121] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 20:55:12 2022] GET /compute/v2.1/os-floating-ips/15ddeb8b-d393-473a-9bd9-0329a3a5edea => generated 141 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:13.435512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9eae717-4ddf-4dd1-ba60-6127166a5f66 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5e21790>, body: {"security_group_rule": {"parent_group_id": "36c95912-ceff-4e43-ba92-2175eb7f021f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:13.443104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.446604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:13.498066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.501200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.521615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.523803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.536769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.543938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.873202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:13.880424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:13.918196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6e2fb0b-72ab-4215-958f-6e3cb4e00b7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1211 microversion: 2.1 time: 0.494190 Oct 04 20:55:13.933728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1587/3122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:13 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1211 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:13.971297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.976176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:14.033277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:14.041286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:14.046442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:14.048473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:14.052414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:14.060322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.638518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9eae717-4ddf-4dd1-ba60-6127166a5f66 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.241845 Oct 04 20:55:15.652675 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1536/3123] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:15.690935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:15.698073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: e698a201-ec21-4d08-915a-42ebbae04a95] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:15.721139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.722768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.724007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.726903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.730187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.738270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.762823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:15.805004 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 HTTP/1.1 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e698a201-ec21-4d08-915a-42ebbae04a95'} Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:15.809657 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance e698a201-ec21-4d08-915a-42ebbae04a95 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f77d598-7561-41a7-8c6f-0d9b9395f0ae tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95" status: 404 len: 111 microversion: 2.1 time: 0.157364 Oct 04 20:55:15.830224 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1537/3124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:15 2022] GET /compute/v2.1/servers/e698a201-ec21-4d08-915a-42ebbae04a95 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:15.831598 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45aaccdd-84e5-49cb-a93e-eb059e0546fe tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.877864 Oct 04 20:55:15.831598 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1588/3125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:13 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:15.831934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e55e3f3-00a8-4ee0-a3c5-d374bf243dd0 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f5e21ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:15.868286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:15.879770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:15.896951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.898550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.899866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.901722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.903191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.904503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.278331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.324380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4eda4d8f-73d9-415a-8cd0-a14f6cc4d035 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1273 microversion: 2.1 time: 0.481291 Oct 04 20:55:16.332515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1589/3126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:15 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1273 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:16.349191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da66b00e-ab00-4807-84a1-5897f51732fd tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f585df70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-762758158", "description": "tempest-description-213629690"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:17.653148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da66b00e-ab00-4807-84a1-5897f51732fd tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.317389 Oct 04 20:55:17.655090 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1590/3127] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:17.670862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.670862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.682551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.683441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.684126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.685083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.685754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.686470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.719247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 HTTP/1.1 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fa91b801-ecd7-4900-8c42-ca4127cf1059'} Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:17.721791 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10a94073-e8b6-4195-a2c7-e56f35b02141 tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 404 len: 111 microversion: 2.1 time: 0.067097 Oct 04 20:55:17.732342 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1591/3128] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:17 2022] DELETE /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:17.742139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:17.743434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.767961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.768561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.769160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.778963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.780633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.782501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.884700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Cannot 'unshelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action HTTP/1.1 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 18 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: {"unshelve": null} Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: exception: Cannot 'unshelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'unshelve': None}} Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:55:17.889187 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:17.902263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 409 to user: Cannot 'unshelve' instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 while it is in vm_state active {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:17.905026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-740b3cfc-1526-41f4-a4fb-34b9f21b2e72 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action" status: 409 len: 146 microversion: 2.1 time: 0.175349 Oct 04 20:55:17.906264 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1592/3129] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:55:17 2022] POST /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909/action => generated 146 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:55:17.915781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.916740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.921141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:17.928726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.929477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.934513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.934513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.934513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.934513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:18.011806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:18.175270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:18.194126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31fd640d-6393-470f-aac6-e96b7ffe58b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1273 microversion: 2.1 time: 0.285488 Oct 04 20:55:18.210708 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1593/3130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:18.210708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11004247-c2b9-4baa-8e29-f7af2836ca2b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5698ee0>, body: {"security_group_rule": {"parent_group_id": "99ee7066-c9cb-4196-ae60-93a0f3e26210", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:19.331293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e55e3f3-00a8-4ee0-a3c5-d374bf243dd0 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/15ddeb8b-d393-473a-9bd9-0329a3a5edea" status: 202 len: 0 microversion: 2.1 time: 3.513533 Oct 04 20:55:19.333158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1538/3131] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:55:15 2022] DELETE /compute/v2.1/os-floating-ips/15ddeb8b-d393-473a-9bd9-0329a3a5edea => generated 0 bytes in 3518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:19.361888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.363833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] [instance: fa91b801-ecd7-4900-8c42-ca4127cf1059] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.381636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.383101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.385440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.387789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.389919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.391114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.432192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] HTTP exception thrown: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Request method failure captured: Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 HTTP/1.1 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJyzuWKvoVEz-cLpDMfZxuJ4yslwijtllhO-eRvMB_0XiK-Y6BaPPnwsJHzz0JbgVw8HSyLYvOXenYetCkyDa1Q4AZxJXpIFIoe2g62IKiiapFiE8D6IS0lsjj074lZLpTrTypjGszVkXa8yqoCjU5mmP4ZI2pZ8SKfYx6l5xxyzQ0o Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8548060d5c4b84bd8e3b7565884306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 5f8548060d5c4b84bd8e3b7565884306 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestMultiNic-333319900 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4df2155d4ba740d897b901567be94516 Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestMultiNic-333319900-project Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fa91b801-ecd7-4900-8c42-ca4127cf1059'} Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:19.436663 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] Returning 404 to user: Instance fa91b801-ecd7-4900-8c42-ca4127cf1059 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b093b1e3-25e1-4d94-873b-6a9fcbb2b5fd tempest-ServersTestMultiNic-333319900 tempest-ServersTestMultiNic-333319900-project] 10.222.0.36 "GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059" status: 404 len: 111 microversion: 2.1 time: 0.103668 Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1539/3132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:19 2022] GET /compute/v2.1/servers/fa91b801-ecd7-4900-8c42-ca4127cf1059 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:19.451989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.455205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.467826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.471709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.475031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.476770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.477605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.480386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.669606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11004247-c2b9-4baa-8e29-f7af2836ca2b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.471873 Oct 04 20:55:19.682867 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1594/3133] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:18 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:19.708962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.718493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.741847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.745697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.755028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.755028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.755028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.755028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.546239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.562097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-881dd705-3cdb-4e75-808c-8991cc44c535 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 0.866028 Oct 04 20:55:20.563715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1595/3134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:19 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:20.575075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1279a878-903d-41e6-8f12-9fa4a35f8593 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f5698040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.616632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.640031 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0e9b566-9ef4-4bac-993e-98300e084c4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.194932 Oct 04 20:55:20.658041 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1540/3135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:19 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:20.696154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a51ebce9-7325-4afb-b60d-1a60ba0419b0 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5e9f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1574120298", "description": "tempest-description-1934816033"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:21.878596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:21.955045 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1279a878-903d-41e6-8f12-9fa4a35f8593 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.388613 Oct 04 20:55:21.956084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1596/3136] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:55:21.967437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:21.968645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:21.985733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.987354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.988901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:21.990509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.991720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.992725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.748671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.770469 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06618d12-33c7-4bbe-8e21-b57a2e151711 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.812258 Oct 04 20:55:22.772433 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1597/3137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:21 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:22.837586 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a51ebce9-7325-4afb-b60d-1a60ba0419b0 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.176912 Oct 04 20:55:22.838796 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1541/3138] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:22.852742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:22.855217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:22.868532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.869418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.870228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.871592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.872447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.873141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.292002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9b073c5-b72c-4752-9ece-d512af335ba2 tempest-ListImageFiltersNegativeTestJSON-1791120553 tempest-ListImageFiltersNegativeTestJSON-1791120553-project] Calling method '.version_select at 0x7f54f575ed30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.338368 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c9b073c5-b72c-4752-9ece-d512af335ba2 tempest-ListImageFiltersNegativeTestJSON-1791120553 tempest-ListImageFiltersNegativeTestJSON-1791120553-project] HTTP exception thrown: Image not found. Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9b073c5-b72c-4752-9ece-d512af335ba2 tempest-ListImageFiltersNegativeTestJSON-1791120553 tempest-ListImageFiltersNegativeTestJSON-1791120553-project] Request method failure captured: Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/images/524468e6-7a10-47a4-abc1-8c368a024be0 HTTP/1.1 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ24pwfxYkYoeeWiBdlZuEo4bX5tFHC6GIl7lGAVj4smzblYGKaDrXFijz864V5hvI8ey-WEyhh0FkxEkzacaCt_lNfrj5kTbb1-A4B1HEU0lXkYz6QY70UYEfJBHaOSx99EoO64aU2k4eDpzFG9Zt2M7qDCt-TC_Hq0PqbdU6WMvbs Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ec9f9d850cba4d6396931d688e0aed11 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1791120553 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec9f9d850cba4d6396931d688e0aed11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec9f9d850cba4d6396931d688e0aed11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec9f9d850cba4d6396931d688e0aed11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec9f9d850cba4d6396931d688e0aed11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1791120553 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ec9f9d850cba4d6396931d688e0aed11 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1791120553 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListImageFiltersNegativeTestJSON-1791120553-project Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 02cec8291c494dd39bf37bb79c915b33 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1791120553-project Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '524468e6-7a10-47a4-abc1-8c368a024be0'} Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 524468e6-7a10-47a4-abc1-8c368a024be0 Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:55:23.342858 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 524468e6-7a10-47a4-abc1-8c368a024be0 could not be found. Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9b073c5-b72c-4752-9ece-d512af335ba2 tempest-ListImageFiltersNegativeTestJSON-1791120553 tempest-ListImageFiltersNegativeTestJSON-1791120553-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9b073c5-b72c-4752-9ece-d512af335ba2 tempest-ListImageFiltersNegativeTestJSON-1791120553 tempest-ListImageFiltersNegativeTestJSON-1791120553-project] 10.222.0.36 "GET /compute/v2.1/images/524468e6-7a10-47a4-abc1-8c368a024be0" status: 404 len: 62 microversion: 2.1 time: 0.571091 Oct 04 20:55:23.354456 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1598/3139] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:55:22 2022] GET /compute/v2.1/images/524468e6-7a10-47a4-abc1-8c368a024be0 => generated 62 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:55:23.368048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-310d5aa3-4096-43c3-b44b-7c4229e8aab4 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f5869670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.740664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:23.774503 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e994dd7-4d1c-4854-9f9d-37f102157907 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 0.932568 Oct 04 20:55:23.776370 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1542/3140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:22 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:23.786350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1565302720_updated"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:23.791988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: a8c69be1-291f-4052-a4ca-23868ca71838] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:23.806446 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/servers/a8c69be1-291f-4052-a4ca-23868ca71838 HTTP/1.1 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 81 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1565302720_updated"}} Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a8c69be1-291f-4052-a4ca-23868ca71838', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1565302720_updated'}}} Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 20:55:23.811334 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. Oct 04 20:55:23.820351 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:23.824319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance a8c69be1-291f-4052-a4ca-23868ca71838 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:23.827108 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73d76efb-8b98-4a80-b003-ee9eed1377e7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "PUT /compute/v2.1/servers/a8c69be1-291f-4052-a4ca-23868ca71838" status: 404 len: 111 microversion: 2.1 time: 0.047937 Oct 04 20:55:23.829998 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1543/3141] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 20:55:23 2022] PUT /compute/v2.1/servers/a8c69be1-291f-4052-a4ca-23868ca71838 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:23.841951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20188644-3e61-41fb-86c8-ddb2c0186e8b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f605b550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1836722954", "description": "tempest-description-1570330685"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:24.339412 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-310d5aa3-4096-43c3-b44b-7c4229e8aab4 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.989137 Oct 04 20:55:24.340572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1599/3142] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 20:55:23 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:24.351096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:24.351325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:24.366051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.367352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.368287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.369844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.370949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.371848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.967247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.986927 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1614d97-5678-4770-9cd9-0081f97b699e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.644554 Oct 04 20:55:25.013349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1600/3143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:24 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:25.030223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8499a638-7999-41db-bb64-5a04ce7043bd tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f56a9dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:25.272622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20188644-3e61-41fb-86c8-ddb2c0186e8b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.440124 Oct 04 20:55:25.274439 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1544/3144] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:25.291513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:25.297535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:25.315584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.316093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.322092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.323960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.325185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.326785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.693714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.713165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fd149c5-b9d6-468b-99a5-ab17fed58172 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 1.436316 Oct 04 20:55:26.732096 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1545/3145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:25 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:26.747690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:26.752448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:26.765909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.767015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.768058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.770165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.771156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.775768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.721521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:27.739588 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d693a18d-0913-42b0-9df2-0a63a8ba310a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.010078 Oct 04 20:55:27.741181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1546/3146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:26 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:27.764024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b4398d-3a41-470e-a1e2-33f059982dea", "tag": "793fda49-19b7-4b73-8c9d-b312eb7c9c8c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:27.789154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.790182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.791235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.815009 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] Creating event network-changed:793fda49-19b7-4b73-8c9d-b312eb7c9c8c for instance 27b4398d-3a41-470e-a1e2-33f059982dea on n-h1-851029-13 Oct 04 20:55:27.825484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8852c61f-a157-41af-9565-057ed6828e9a req-14957d11-6fc0-4c80-a3d8-b0ce60fda563 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081975 Oct 04 20:55:27.827028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1547/3147] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:27.836431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b8887f2d-128b-4ad8-8139-2c08ac0ecca2 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5fcfca0>, body: {"security_group_rule": {"parent_group_id": "e9c55d21-3d27-4673-9033-98cdb035e1d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9230e11a-106f-4aea-81c6-da55032d68b6"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:29.484103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8499a638-7999-41db-bb64-5a04ce7043bd tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/c4df6394-2c61-4f94-b12d-cfdc6239cdc2" status: 202 len: 0 microversion: 2.1 time: 4.468632 Oct 04 20:55:29.485104 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1601/3148] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:55:25 2022] DELETE /compute/v2.1/os-floating-ips/c4df6394-2c61-4f94-b12d-cfdc6239cdc2 => generated 0 bytes in 4471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:29.493677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:29.494981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:29.507059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.515405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.515405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.515405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.515983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b8887f2d-128b-4ad8-8139-2c08ac0ecca2 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.681414 Oct 04 20:55:29.516704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.516704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.517009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1548/3149] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:27 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:29.539871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b99de63-6820-4bca-8b8e-4ec261c9fa3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b99de63-6820-4bca-8b8e-4ec261c9fa3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: request: PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 HTTP/1.1 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 280 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.548753 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:55:29.556226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:29.575077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b99de63-6820-4bca-8b8e-4ec261c9fa3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:29.577378 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b99de63-6820-4bca-8b8e-4ec261c9fa3e tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 400 len: 619 microversion: 2.1 time: 0.062999 Oct 04 20:55:29.579171 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1549/3150] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Oct 4 20:55:29 2022] PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 619 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:29.859306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:29.897540 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43e58755-1715-4318-8545-41c5a41d0a2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 0.410477 Oct 04 20:55:29.899694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1602/3151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:29 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:29.910016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e51c83b4-e21f-4b5a-9d1b-2c370c34aff5 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f6105820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:30.437187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-540df322-2bce-4944-9097-f992bd22f4e0 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f6450dc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUrZqlbJVWCfaf1GzRPTJ2axEjo7ParyLBPStgahu9Dy51a73aFXQE83pmjny/cCS0ik48qBMxqM23V1npX+6i5xgdzQvf3NLFXrvMTYYOdw0NY58RRSwI485CuMWjz8g=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-540df322-2bce-4944-9097-f992bd22f4e0 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 257 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUrZqlbJVWCfaf1GzRPTJ2axEjo7ParyLBPStgahu9Dy51a73aFXQE83pmjny/cCS0ik48qBMxqM23V1npX+6i5xgdzQvf3NLFXrvMTYYOdw0NY58RRSwI485CuMWjz8g=="}} Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUrZqlbJVWCfaf1GzRPTJ2axEjo7ParyLBPStgahu9Dy51a73aFXQE83pmjny/cCS0ik48qBMxqM23V1npX+6i5xgdzQvf3NLFXrvMTYYOdw0NY58RRSwI485CuMWjz8g=='}}} Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 20:55:30.476604 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-540df322-2bce-4944-9097-f992bd22f4e0 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-540df322-2bce-4944-9097-f992bd22f4e0 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.877337 Oct 04 20:55:30.498310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1550/3152] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:29 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 899 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:30.506266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8ca7353-37a0-4783-9190-255336309e8b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5e21ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-629632235", "description": "tempest-description-1976835376"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:32.214688 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8ca7353-37a0-4783-9190-255336309e8b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.728220 Oct 04 20:55:32.220391 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1551/3153] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:32.288381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:32.288381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:32.329001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.339584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.339584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.339584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.342606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.344751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.394821 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e51c83b4-e21f-4b5a-9d1b-2c370c34aff5 tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/0283c488-997e-4208-8f53-22bfe2abb7e5" status: 202 len: 0 microversion: 2.1 time: 3.492389 Oct 04 20:55:33.396247 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1603/3154] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:55:29 2022] DELETE /compute/v2.1/os-floating-ips/0283c488-997e-4208-8f53-22bfe2abb7e5 => generated 0 bytes in 3495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:33.422026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f58718b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2029202571", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:33.424835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:33.457030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:33.457891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-492a27ac-c0d6-497a-9acd-339048ba201d tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.222610 Oct 04 20:55:33.468625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1552/3155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:32 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:33.471120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for user f31fe40af5ce44dd939e458227722f47 and project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:33.475611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:33.477006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:33.522164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:33.523638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.526031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.527500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.529313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.530685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.532677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 2167 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2029202571", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:55:33.548484 n-d-851029-13 devstack@n-api.service[123541]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2029202571', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:33.555489 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eaf5cfa0-7a60-48d4-9a95-02f6c9417607 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.151207 Oct 04 20:55:33.568915 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1604/3156] 10.222.0.36 () {60 vars in 1160 bytes} [Tue Oct 4 20:55:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:33.590427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bda1bbca-0790-40ad-8bd2-92415de9fee6 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5767280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-258446172", "description": "tempest-description-1837991791"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:34.332032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.355620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa5e0067-bf47-4eee-ad0b-fd8a1a9741c3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 0.890014 Oct 04 20:55:34.357411 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1553/3157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:33 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:34.417426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8dc738e4-7495-406f-9666-2ef928c6862b tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] Calling method '.version_select at 0x7f54f6016550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:34.954086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bda1bbca-0790-40ad-8bd2-92415de9fee6 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.375049 Oct 04 20:55:34.954086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1605/3158] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:34.954086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:34.954086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:34.966890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.972435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.974901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.976994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.978015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.978996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.177526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.187231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8646478e-08c6-4a51-9b2b-0fba7f5d4ec7 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 1.247225 Oct 04 20:55:36.189901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1606/3159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:34 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:36.202995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71e3d623-8e2a-4f49-9faa-92c0fb318b28 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f5698940>, body: {"keypair": {"name": "tempest-keypair-38002744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1cbMHafzqR4a6awjz0afe9wpmpjCPWfcDIof5jkA87fOq//Cf2sslwnKwlMYD/ZuX2vwNEyEcaquUwH8LAPLoO1kpBs8oSMQS0Iop7FRYnSmqts/WmcNhQ7fdK7Pwm4g=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:36.239096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-71e3d623-8e2a-4f49-9faa-92c0fb318b28 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:36.259224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-71e3d623-8e2a-4f49-9faa-92c0fb318b28 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for user f31fe40af5ce44dd939e458227722f47 and project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:36.488927 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71e3d623-8e2a-4f49-9faa-92c0fb318b28 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.296431 Oct 04 20:55:36.490094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1607/3160] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:36.501424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-529f2e6e-de74-4b8d-baf2-202a3cc6c108 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f60be160>, body: {"security_group_rule": {"parent_group_id": "a36c8137-adba-4465-bb8c-8ce93cde032b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1cef48e6-f21b-4b66-af99-0207f028010f"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:38.187570 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8dc738e4-7495-406f-9666-2ef928c6862b tempest-FloatingIPDetailsTestJSON-879836588 tempest-FloatingIPDetailsTestJSON-879836588-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/40427596-4557-4312-8146-8603e8a0094a" status: 202 len: 0 microversion: 2.1 time: 3.807909 Oct 04 20:55:38.190639 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1554/3161] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 20:55:34 2022] DELETE /compute/v2.1/os-floating-ips/40427596-4557-4312-8146-8603e8a0094a => generated 0 bytes in 3814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:38.206707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:38.209553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:38.236582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.239125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.245854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.245854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.245854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.245854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.692224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-529f2e6e-de74-4b8d-baf2-202a3cc6c108 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.199329 Oct 04 20:55:38.695694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1608/3162] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:36 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:38.712168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0a43182-49a1-4143-bf93-0b139e6df5e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0a43182-49a1-4143-bf93-0b139e6df5e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 HTTP/1.1 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 24 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": ""}} Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909', 'body': {'server': {'name': ''}}} Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '' Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:55:38.725997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0a43182-49a1-4143-bf93-0b139e6df5e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:38.736383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0a43182-49a1-4143-bf93-0b139e6df5e8 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 400 len: 108 microversion: 2.1 time: 0.032753 Oct 04 20:55:38.743171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1609/3163] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 20:55:38 2022] PUT /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:38.752131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b4398d-3a41-470e-a1e2-33f059982dea", "name": "network-vif-plugged", "status": "completed", "tag": "793fda49-19b7-4b73-8c9d-b312eb7c9c8c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:38.773372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.774571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.775580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.804326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] Creating event network-vif-plugged:793fda49-19b7-4b73-8c9d-b312eb7c9c8c for instance 27b4398d-3a41-470e-a1e2-33f059982dea on n-h1-851029-13 Oct 04 20:55:38.814978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9b733831-b07d-4b01-9932-f169a1c87dbe req-0fd4b065-1682-40f4-a642-7d304e0899ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070688 Oct 04 20:55:38.822215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1610/3164] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:38.834074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f60be9d0>, body: {"keypair": {"name": "tempest-keypair-38002744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFSji6GtlRDIYkwL+SLy+8Np7OcYVbymDvWK7WUeuetJdhm32sNspfPVEOCKKB1XSWfGChn5kHK1cjNkjF0t7z7MaMHBT7arxtpGDc2M8266jR4iseLhAmwFeez0+FRzw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:38.871629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:38.884230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for user f31fe40af5ce44dd939e458227722f47 and project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:38.990518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] HTTP exception thrown: Key pair 'tempest-keypair-38002744' already exists. Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 271 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: {"keypair": {"name": "tempest-keypair-38002744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFSji6GtlRDIYkwL+SLy+8Np7OcYVbymDvWK7WUeuetJdhm32sNspfPVEOCKKB1XSWfGChn5kHK1cjNkjF0t7z7MaMHBT7arxtpGDc2M8266jR4iseLhAmwFeez0+FRzw=="}} Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: exception: Key pair 'tempest-keypair-38002744' already exists. Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-38002744', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFSji6GtlRDIYkwL+SLy+8Np7OcYVbymDvWK7WUeuetJdhm32sNspfPVEOCKKB1XSWfGChn5kHK1cjNkjF0t7z7MaMHBT7arxtpGDc2M8266jR4iseLhAmwFeez0+FRzw=='}}} Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f31fe40af5ce44dd939e458227722f47-tempest-keypair-38002744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:55:38.996916 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:55:39.010036 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f31fe40af5ce44dd939e458227722f47-tempest-keypair-38002744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 55, 38, 919510), 'updated_at': None, 'name': 'tempest-keypair-38002744', 'user_id': 'f31fe40af5ce44dd939e458227722f47', 'fingerprint': '6c:d4:b5:6c:0a:b7:4c:c5:0b:4d:84:af:2d:b4:b5:bb', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFSji6GtlRDIYkwL+SLy+8Np7OcYVbymDvWK7WUeuetJdhm32sNspfPVEOCKKB1XSWfGChn5kHK1cjNkjF0t7z7MaMHBT7arxtpGDc2M8266jR4iseLhAmwFeez0+FRzw==', 'type': 'ssh'}] Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._create() Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-38002744' already exists. Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 20:55:39.024375 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-38002744' already exists. Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-38002744' already exists. Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 409 to user: Key pair 'tempest-keypair-38002744' already exists. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13df1560-e384-43f5-9bdc-c044191c8672 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.176542 Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1611/3165] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:38 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:55:39.038460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-baf03029-58b6-4b57-bb36-3780fe3bc602 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f6325a60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:39.634102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:39.653672 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-073ae170-8cb9-4ebe-b077-1aa6b6ef532b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 1.459145 Oct 04 20:55:39.656357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1555/3166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:38 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:39.669020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:39.670321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:39.682012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:39.683426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:39.684215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:39.685870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:39.687038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:39.687808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.190911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:40.214513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cacb45a1-cef8-4592-a864-ba68854c125c tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1503 microversion: 2.1 time: 0.555721 Oct 04 20:55:40.215581 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1556/3167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:39 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:40.231749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b77de06f-5efe-46e4-8e79-a4ec7b24de9b tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Calling method '.version_select at 0x7f54f6016310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.390962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b77de06f-5efe-46e4-8e79-a4ec7b24de9b tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38002744" status: 202 len: 0 microversion: 2.1 time: 0.173415 Oct 04 20:55:40.401057 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1557/3168] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 4 20:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38002744 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:40.416613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-baf03029-58b6-4b57-bb36-3780fe3bc602 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1cef48e6-f21b-4b66-af99-0207f028010f" status: 202 len: 0 microversion: 2.1 time: 1.408324 Oct 04 20:55:40.426083 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1612/3169] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:39 2022] DELETE /compute/v2.1/os-security-groups/1cef48e6-f21b-4b66-af99-0207f028010f => generated 0 bytes in 1412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:40.426478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11b4136a-884f-42fd-935a-b28072ee22de tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f5e9f670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQKd2yst7ITK+IvI7HqG7mWGUAopMo1G/gNIeH2+t5j2jQol7F1/aeMEr8+jhEUKjdq2Xx028KZW1uVDouRY/EUy9j/Rg5d96SvSHz/C8tTEcP5mxW+Me6SOzzZcn+Yww=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:40.435454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36ae6851-ebe0-4308-a65a-d2c862060e14 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5871670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11b4136a-884f-42fd-935a-b28072ee22de tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 247 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQKd2yst7ITK+IvI7HqG7mWGUAopMo1G/gNIeH2+t5j2jQol7F1/aeMEr8+jhEUKjdq2Xx028KZW1uVDouRY/EUy9j/Rg5d96SvSHz/C8tTEcP5mxW+Me6SOzzZcn+Yww=="}} Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQKd2yst7ITK+IvI7HqG7mWGUAopMo1G/gNIeH2+t5j2jQol7F1/aeMEr8+jhEUKjdq2Xx028KZW1uVDouRY/EUy9j/Rg5d96SvSHz/C8tTEcP5mxW+Me6SOzzZcn+Yww=='}}} Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi '' Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:55:40.446267 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:55:40.460883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.465195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11b4136a-884f-42fd-935a-b28072ee22de tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:40.468325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11b4136a-884f-42fd-935a-b28072ee22de tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.056040 Oct 04 20:55:40.469660 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1558/3170] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:40.492546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f643c040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-130294867", "public_key": " "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:40.551191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:40.561624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for user f31fe40af5ce44dd939e458227722f47 and project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:40.612131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36ae6851-ebe0-4308-a65a-d2c862060e14 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/a36c8137-adba-4465-bb8c-8ce93cde032b" status: 200 len: 247 microversion: 2.1 time: 0.183671 Oct 04 20:55:40.614194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1613/3171] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:55:40 2022] GET /compute/v2.1/os-security-groups/a36c8137-adba-4465-bb8c-8ce93cde032b => generated 247 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:40.625250 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 94 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-130294867", "public_key": " "}} Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-130294867', 'public_key': ' '}}} Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.634263 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:40.648705 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.654852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea17dc37-b395-4a95-a8af-e3a27d936e4d tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f62c9af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-204467793", "description": "tempest-description-1095621151"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:40.655936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:40.655936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-945c6d65-8541-4c3f-8d6b-a4c4eb9b6950 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.165715 Oct 04 20:55:40.657907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1559/3172] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Oct 4 20:55:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:55:40.680828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01ee7119-46de-433e-b347-c304805e5cca tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f5f9a940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDiegtieYCc6TyLazFdtWnl89pebyFsDh5EOsOhtZPA7HS0PdC5w+HVaiexs08WCGe70Si6BB2RpDHEsAZvRj8GOOFQOvOVYeXMlWOoPlJlq95Zku0VhMC8Yi5weLELw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01ee7119-46de-433e-b347-c304805e5cca tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 507 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDiegtieYCc6TyLazFdtWnl89pebyFsDh5EOsOhtZPA7HS0PdC5w+HVaiexs08WCGe70Si6BB2RpDHEsAZvRj8GOOFQOvOVYeXMlWOoPlJlq95Zku0VhMC8Yi5weLELw=="}} Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDiegtieYCc6TyLazFdtWnl89pebyFsDh5EOsOhtZPA7HS0PdC5w+HVaiexs08WCGe70Si6BB2RpDHEsAZvRj8GOOFQOvOVYeXMlWOoPlJlq95Zku0VhMC8Yi5weLELw=='}}} Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:55:40.714932 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01ee7119-46de-433e-b347-c304805e5cca tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-01ee7119-46de-433e-b347-c304805e5cca tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.048014 Oct 04 20:55:40.728353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1560/3173] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:40 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:40.747135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.748407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.788020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.789077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.789901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.801666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.802324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.808175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:41.752945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.752945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=67 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:41.752945 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d88fa2c9-8bd6-4a59-b7da-c6c874380c52 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1315 microversion: 2.1 time: 1.004481 Oct 04 20:55:41.752945 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1561/3174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:40 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:41.756417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Action: 'create', calling method: .version_select at 0x7f54f5fe78b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1718920233", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:41.785117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:41.825923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:41.840968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Getting quotas for user f31fe40af5ce44dd939e458227722f47 and project c21a079367c24f318bf7cdc5ae548ca1. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:41.879625 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 118 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1718920233", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1718920233', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:55:41.884501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-104c079f-7c1c-4034-bfa9-62719572f603 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.153578 Oct 04 20:55:41.898219 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1562/3175] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:55:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:55:41.916547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdfd6404-ffa2-4678-9330-d9537b39b4e9 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Calling method '.version_select at 0x7f54f5f9aa60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:41.933199 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-bdfd6404-ffa2-4678-9330-d9537b39b4e9 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdfd6404-ffa2-4678-9330-d9537b39b4e9 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Request method failure captured: Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958059090 HTTP/1.1 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3AihmrkEX4IptX2W2d-bPkrl1YbHab_4vz1kbLPPRWXkiLDql9tFxR4KqqBnOse5t-3ME2dH0ahVySkm1gNnemkBx-KWbj49l1tQijIyn60NJRMgWqTetqAF7HzHckx5v_SkqxPNN-0073Y0ska2XoD6l-iaDjDlfIjTEn8PzbRi8 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c21a079367c24f318bf7cdc5ae548ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c21a079367c24f318bf7cdc5ae548ca1 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1083266502 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1083266502-project Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: exception: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'tempest-keypair-non-existent-958059090'} Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.937119 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdfd6404-ffa2-4678-9330-d9537b39b4e9 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] Returning 404 to user: Keypair tempest-keypair-non-existent-958059090 not found for user f31fe40af5ce44dd939e458227722f47 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bdfd6404-ffa2-4678-9330-d9537b39b4e9 tempest-KeyPairsNegativeTestJSON-1083266502 tempest-KeyPairsNegativeTestJSON-1083266502-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958059090" status: 404 len: 144 microversion: 2.1 time: 0.039999 Oct 04 20:55:41.950950 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1563/3176] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 20:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-958059090 => generated 144 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:42.793411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea17dc37-b395-4a95-a8af-e3a27d936e4d tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.158620 Oct 04 20:55:42.794277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:42.795812 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1614/3177] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:55:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:42.799805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:42.825297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3bf07a22-77d7-447e-a190-176df384f292 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f6135a60>, body: {"security_group_rule": {"parent_group_id": "95eadc06-a9ce-4111-b482-2796c272d3fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:42.847100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:42.850648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:42.850648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:42.851080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:42.851652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:42.853589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.586946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.614221 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c9e2845-880a-4bf9-b52c-546af3330ce8 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1503 microversion: 2.1 time: 0.837264 Oct 04 20:55:43.628068 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1564/3178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:42 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1503 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:43.685301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:43.687040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:43.700746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.710935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.710935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.710935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.710935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.710935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.822833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:44.697361 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7dbb26b0-336b-4ae8-a68b-a81433ffd636 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 204 len: 0 microversion: 2.1 time: 1.019202 Oct 04 20:55:44.701152 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1565/3179] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:43 2022] DELETE /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:55:44.726801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:44.730692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:44.762385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.763353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.772042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.772042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.772042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.772042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.998230 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3bf07a22-77d7-447e-a190-176df384f292 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.180404 Oct 04 20:55:44.999313 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1615/3180] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:45.032976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2892e87-9e37-45f0-9108-ab13ab04fe44 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Action: 'create', calling method: .version_select at 0x7f54f5fbd280>, body: {"security_group_rule": {"parent_group_id": "95eadc06-a9ce-4111-b482-2796c272d3fb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:45.464408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.536479 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3586b1ab-d88c-4c01-9fe7-a93031985928 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1509 microversion: 2.1 time: 0.829365 Oct 04 20:55:45.547410 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1566/3181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:44 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1509 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:46.594545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:46.604342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:46.623733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.631353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.632700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.634445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.638628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.640030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.727987 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2892e87-9e37-45f0-9108-ab13ab04fe44 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.710038 Oct 04 20:55:46.730303 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1616/3182] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:55:45 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:46.766417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2c5a70c-b051-447b-bef2-aa56a465084b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f56983a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:48.009211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2c5a70c-b051-447b-bef2-aa56a465084b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/95eadc06-a9ce-4111-b482-2796c272d3fb" status: 200 len: 664 microversion: 2.1 time: 1.258732 Oct 04 20:55:48.010907 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1617/3183] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:55:46 2022] GET /compute/v2.1/os-security-groups/95eadc06-a9ce-4111-b482-2796c272d3fb => generated 664 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:48.046404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a2566d6-d04c-4996-b6ac-1356ed0313c5 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5fbdb80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:48.355916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:48.401991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ce78873-6619-4859-adc8-eae0a3751e48 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1509 microversion: 2.1 time: 1.814667 Oct 04 20:55:48.406220 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1567/3184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:46 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1509 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:48.789472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=56 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:48.900116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:48.923862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:49.458245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:49.463539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:49.498160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.501845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.503126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.506918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.513262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.514483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.086502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a2566d6-d04c-4996-b6ac-1356ed0313c5 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/1088e03d-8702-43b6-bda8-57f9e32a298b" status: 202 len: 0 microversion: 2.1 time: 2.049979 Oct 04 20:55:50.087974 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1618/3185] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 4 20:55:48 2022] DELETE /compute/v2.1/os-security-group-rules/1088e03d-8702-43b6-bda8-57f9e32a298b => generated 0 bytes in 2054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:50.110397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0bc12cc2-2eea-4296-80d3-ee238152fa67 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f62c99d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:50.544479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:50.569983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6d02b23-b2e6-4a97-b209-d1aa4dbe4285 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1467 microversion: 2.1 time: 1.122576 Oct 04 20:55:50.590911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1568/3186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:49 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1467 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:50.613992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b4398d-3a41-470e-a1e2-33f059982dea", "name": "network-vif-deleted", "tag": "793fda49-19b7-4b73-8c9d-b312eb7c9c8c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:50.653138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.654571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.656263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.732539 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] Creating event network-vif-deleted:793fda49-19b7-4b73-8c9d-b312eb7c9c8c for instance 27b4398d-3a41-470e-a1e2-33f059982dea on n-h1-851029-13 Oct 04 20:55:50.779024 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4c48ffb9-b0ca-452e-9b51-04a9cb576549 req-971086ba-91b9-4d1a-8b32-fb6f7d8cbf74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185423 Oct 04 20:55:50.790164 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1569/3187] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:51.630021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:51.636764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:51.686265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:51.689966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:51.692696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:51.704093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:51.704093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:51.704093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:51.861587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:51.916043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:51.918258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:51.925739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:51.927604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'fault' on Instance uuid 27b4398d-3a41-470e-a1e2-33f059982dea {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:52.130747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:52.203047 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af709e6b-f814-476a-81ba-69b028c7747f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 200 len: 1305 microversion: 2.1 time: 0.585656 Oct 04 20:55:52.226789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1570/3188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:51 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 1305 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:52.747044 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0bc12cc2-2eea-4296-80d3-ee238152fa67 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/95eadc06-a9ce-4111-b482-2796c272d3fb" status: 202 len: 0 microversion: 2.1 time: 2.645794 Oct 04 20:55:52.748080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1619/3189] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:50 2022] DELETE /compute/v2.1/os-security-groups/95eadc06-a9ce-4111-b482-2796c272d3fb => generated 0 bytes in 2648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:52.767923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5e210d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:53.261923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:53.266904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:53.320723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.327671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.328444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.332823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.339881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.349559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.446238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea HTTP/1.1 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '27b4398d-3a41-470e-a1e2-33f059982dea'} Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:53.459686 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f30c5d8a-072f-4374-9508-89e8d3ebd141 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 404 len: 111 microversion: 2.1 time: 0.207634 Oct 04 20:55:53.467210 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1620/3190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:53 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:54.054176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-113419233", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:54.055301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:55:54.055980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Neutron security group 1cef48e6-f21b-4b66-af99-0207f028010f not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:55:54.057279 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] HTTP exception thrown: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.057279 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Request method failure captured: Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/1cef48e6-f21b-4b66-af99-0207f028010f HTTP/1.1 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2qtfAj5PcM7wWV4dEMtMt5hRnKapnEDf-X47sNAcBKtiXcAn36SdbxTqycTriXShrVzQZy-u-GvOJBg6OefnPeXSBqCoN_pdfsKsOAxH0bzQzMpuwk5xEq3EU_64_Pp6qw6C1NZFJmBC9UNkOyOrHpBVyfpaFBL73YT5xFOlPloaQ Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: d3ce94c261674beaaebad36684a5b670 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1877372096 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3ce94c261674beaaebad36684a5b670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d3ce94c261674beaaebad36684a5b670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d3ce94c261674beaaebad36684a5b670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d3ce94c261674beaaebad36684a5b670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1877372096 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: d3ce94c261674beaaebad36684a5b670 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1877372096 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupRulesTestJSON-1877372096-project Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 45b3f1ccd2814613abc5695f381d17bd Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1877372096-project Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1cef48e6-f21b-4b66-af99-0207f028010f'} Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:55:54.062518 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Returning 404 to user: Security group 1cef48e6-f21b-4b66-af99-0207f028010f does not exist Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-49467d26-fd1e-408d-b46a-e8c15806582c'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:54.076590 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1faf67c-b1df-4461-9972-2eef9a057a1e tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1cef48e6-f21b-4b66-af99-0207f028010f" status: 404 len: 194 microversion: 2.1 time: 1.309324 Oct 04 20:55:54.087339 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1571/3191] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:52 2022] DELETE /compute/v2.1/os-security-groups/1cef48e6-f21b-4b66-af99-0207f028010f => generated 194 bytes in 1326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:54.140996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5066895f-c735-41da-8cac-9bcb22ecb8c5 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f64f5ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:54.217343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:56.919266 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5066895f-c735-41da-8cac-9bcb22ecb8c5 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a36c8137-adba-4465-bb8c-8ce93cde032b" status: 202 len: 0 microversion: 2.1 time: 2.837232 Oct 04 20:55:56.920829 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1572/3192] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:54 2022] DELETE /compute/v2.1/os-security-groups/a36c8137-adba-4465-bb8c-8ce93cde032b => generated 0 bytes in 2840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:56.941438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:56.949957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:56.991687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.992634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.993488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:57.010612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:57.011704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:57.012532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:57.077736 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 HTTP/1.1 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499'} Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:57.081202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:57.089694 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:55:57.101292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:57.101292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0b77715-4234-4ca6-8cb5-2dd5cbe13d26 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 404 len: 111 microversion: 2.1 time: 0.170274 Oct 04 20:55:57.101292 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1573/3193] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:56 2022] DELETE /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:57.124333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13cf04d2-0215-42ad-ad38-ea4cfcee0f06 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f604d1f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:57.978467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:57.980748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:57.990733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:57.990733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:57.990733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:58.037664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.043363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.053819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.059861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.059861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.059861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.236215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:58.261773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:58.319672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:58.326088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:58.650709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49f328ac-f9ed-4ac2-b48b-2c7443a0de29 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.605282 Oct 04 20:55:58.654513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1621/3194] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:55:58.677877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:58.681769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.710297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.711647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.712155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13cf04d2-0215-42ad-ad38-ea4cfcee0f06 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9230e11a-106f-4aea-81c6-da55032d68b6" status: 202 len: 0 microversion: 2.1 time: 1.607771 Oct 04 20:55:58.713372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1574/3195] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:57 2022] DELETE /compute/v2.1/os-security-groups/9230e11a-106f-4aea-81c6-da55032d68b6 => generated 0 bytes in 1612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:55:58.719883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.722186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.723473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.725090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.731867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-419ff6c5-e077-4f69-be88-a5999844e327 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:58.735806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-419ff6c5-e077-4f69-be88-a5999844e327 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.842323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 HTTP/1.1 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499'} Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:58.847702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. Oct 04 20:55:58.857538 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:55:58.862994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance 23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:58.865515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00fccf9c-a860-41e6-82cc-7617c7c568e5 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499" status: 404 len: 111 microversion: 2.1 time: 0.208674 Oct 04 20:55:58.869000 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1622/3196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:58 2022] GET /compute/v2.1/servers/23d07cf5-dfff-4b65-b7d1-c6d7a7ff3499 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:58.882642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c713372-9b23-45fe-8dbe-439c14720af0 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5fbdd30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:59.066286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-419ff6c5-e077-4f69-be88-a5999844e327 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.092122 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-419ff6c5-e077-4f69-be88-a5999844e327 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1214 microversion: 2.1 time: 0.376132 Oct 04 20:55:59.095988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1575/3197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:58 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:59.141522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:59.144440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:59.184030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.185519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.186621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.194176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.198064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.202593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.368434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:00.014241 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c713372-9b23-45fe-8dbe-439c14720af0 tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e9c55d21-3d27-4673-9033-98cdb035e1d7" status: 202 len: 0 microversion: 2.1 time: 1.142832 Oct 04 20:56:00.015950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1623/3198] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:55:58 2022] DELETE /compute/v2.1/os-security-groups/e9c55d21-3d27-4673-9033-98cdb035e1d7 => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:56:00.038446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd3a042d-ad4e-4c49-b3ff-571908a7ce2b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5fbd430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:00.244246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74896d1a-75b0-45f6-89b4-374d193d03a0 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 204 len: 0 microversion: 2.1 time: 1.129337 Oct 04 20:56:00.260620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1576/3199] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:59 2022] DELETE /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:56:00.273401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99ab9676-4ed8-477f-ab16-2559f76b5cb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:00.282914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99ab9676-4ed8-477f-ab16-2559f76b5cb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:00.437713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99ab9676-4ed8-477f-ab16-2559f76b5cb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.469307 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99ab9676-4ed8-477f-ab16-2559f76b5cb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1214 microversion: 2.1 time: 0.210115 Oct 04 20:56:00.483390 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1577/3200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:00 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:00.521775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:00.523160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:00.538088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.539635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.540817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.543129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.544447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.547807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.062915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:01.083600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-221a54cf-4345-421b-b32f-574681e4d899 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 0.598295 Oct 04 20:56:01.085362 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1578/3201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:00 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:01.144197 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd3a042d-ad4e-4c49-b3ff-571908a7ce2b tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/99ee7066-c9cb-4196-ae60-93a0f3e26210" status: 202 len: 0 microversion: 2.1 time: 1.119503 Oct 04 20:56:01.147473 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1624/3202] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:56:00 2022] DELETE /compute/v2.1/os-security-groups/99ee7066-c9cb-4196-ae60-93a0f3e26210 => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:56:01.162382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e91afd52-c514-46f5-a6b1-17503ab073bf tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] Calling method '.version_select at 0x7f54f5e9f790>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:01.526438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:01.533634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:01.572661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.573517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.581951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.583835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.586103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.590275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.905128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:01.973512 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-407f1db2-7f77-4959-bc55-57cdd6b25308 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1218 microversion: 2.1 time: 0.450408 Oct 04 20:56:01.973512 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1625/3203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:01 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1218 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:02.155196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:02.156730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:02.205591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.216926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.224502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.227516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.235602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.239747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.507064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e91afd52-c514-46f5-a6b1-17503ab073bf tempest-SecurityGroupRulesTestJSON-1877372096 tempest-SecurityGroupRulesTestJSON-1877372096-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/36c95912-ceff-4e43-ba92-2175eb7f021f" status: 202 len: 0 microversion: 2.1 time: 1.352483 Oct 04 20:56:02.508210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1579/3204] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:56:01 2022] DELETE /compute/v2.1/os-security-groups/36c95912-ceff-4e43-ba92-2175eb7f021f => generated 0 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:56:03.020218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:03.024973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:03.093361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.097664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.110027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.115845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.115845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.115845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.627055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.655532 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07f37d85-16bc-496f-b582-b20ad7c64e4a tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 1.527511 Oct 04 20:56:03.658031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1626/3205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:02 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:03.809644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.850500 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52a95676-5cf3-48f7-a8af-1977bdf35392 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1266 microversion: 2.1 time: 0.842252 Oct 04 20:56:03.881338 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1580/3206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:03 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1266 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:04.718920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:04.721193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:04.747728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.750979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.753367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.754486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.759299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.762119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.902159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:04.907629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:04.942647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.944183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.945341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.947308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.951942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.953462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:05.608486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:05.696914 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d432716-4709-4e01-8a8c-1003fbbbadad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1272 microversion: 2.1 time: 0.788049 Oct 04 20:56:05.699200 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1581/3207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:04 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1272 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:06.581964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-655283286", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "1406f499-3505-4983-a862-508d1a230066"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:06.688271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.716234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c51a0e0-58fb-40f0-8589-59acb75ca024 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1509 microversion: 2.1 time: 2.004424 Oct 04 20:56:06.718903 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1627/3208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:04 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1509 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:06.795267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:06.796988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:06.824541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] validate_networks() for [('1406f499-3505-4983-a862-508d1a230066', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:06.877064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.878102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.882636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.891806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.897669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.903008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:07.877171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:07.929043 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-511f2b53-0ba7-494f-b19a-db911f253e82 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1272 microversion: 2.1 time: 1.175920 Oct 04 20:56:07.930788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1628/3209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:06 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1272 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:07.943288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e348ea2c-51f3-4cd7-aa1b-3beed529f909", "name": "network-vif-deleted", "tag": "0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:07.983322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:07.984557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:07.989744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.052928 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] Creating event network-vif-deleted:0fbdbb81-2a0b-45fb-8afd-1bda7b75a18c for instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 on n-h2-851029-13 Oct 04 20:56:08.066785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-60365aa2-f1f1-4011-92c4-150ffa17ba83 req-95f169f2-154b-4e94-b188-d24699f0dc97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129382 Oct 04 20:56:08.071418 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1629/3210] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:08.089810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.096913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:08.130504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.131457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.135715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.146448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.147430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.148345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.149398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.245538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.247040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.250341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.252180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lazy-loading 'fault' on Instance uuid e348ea2c-51f3-4cd7-aa1b-3beed529f909 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:08.296160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.558654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dad81a0d0e7483faca4215294efb6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35f87b9aeb584936b843faaae144921d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.634410 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fecc25a3-0d10-48ba-85e2-198f3e11be14 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 200 len: 1306 microversion: 2.1 time: 0.554431 Oct 04 20:56:08.638156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1630/3211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 1306 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:08.980652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.984032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.017184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.024892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.026732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.044374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.045275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.053300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.519486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:09.545416 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58844701-5e9e-483a-831c-e78425910fff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1272 microversion: 2.1 time: 0.572548 Oct 04 20:56:09.559364 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1631/3212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1272 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:09.680478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:09.681359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] [instance: e348ea2c-51f3-4cd7-aa1b-3beed529f909] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.688732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.689620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.690379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.691195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.691886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.692585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.710363 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] HTTP exception thrown: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Request method failure captured: Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 HTTP/1.1 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJvRJOPSNescgEpUpr8oDeP22QmnMC9x00L9WHUWqtsI7PBVfNLvGsLMmrMagdYaEJrsS0ESWQ26NxUmtnggiVP8vIz12K5nzr7Kg3NE_-_vxqkYyLgPZ9NacDsfErxuRDjk1IchElK5-8D0l4_NNjCFzyqzvLR2KDKZH4ySe_5GCZk Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/35f87b9aeb584936b843faaae144921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/35f87b9aeb584936b843faaae144921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_35f87b9aeb584936b843faaae144921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 35f87b9aeb584936b843faaae144921d Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1217382235 Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9dad81a0d0e7483faca4215294efb6bb Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-1217382235-project Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e348ea2c-51f3-4cd7-aa1b-3beed529f909'} Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:09.713048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] Returning 404 to user: Instance e348ea2c-51f3-4cd7-aa1b-3beed529f909 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3381b367-7cae-4a0f-8649-ca559e820228 tempest-ServersNegativeTestJSON-1217382235 tempest-ServersNegativeTestJSON-1217382235-project] 10.222.0.36 "GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909" status: 404 len: 111 microversion: 2.1 time: 0.041100 Oct 04 20:56:09.727577 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1632/3213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:09 2022] GET /compute/v2.1/servers/e348ea2c-51f3-4cd7-aa1b-3beed529f909 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:56:10.467748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:10.613591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:10.620733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:10.670713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:10.673867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:10.677927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:10.680970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:10.684802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:10.688821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.104478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.150459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2014f996-1558-4b4e-833b-268d33f283a7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1272 microversion: 2.1 time: 0.551594 Oct 04 20:56:11.155147 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1633/3214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:10 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1272 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:12.205122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.211932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.243168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.247277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.251252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.253464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.259634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.261060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.566783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:12.603454 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f74d4a6-5cd3-4f21-9f73-c21fcb1e4aab tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1272 microversion: 2.1 time: 0.406280 Oct 04 20:56:12.630708 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1634/3215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1272 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:13.120994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:56:13.123893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:56:13.125740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:56:13.127314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:56:13.129819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:56:13.153097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:13.181647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.183223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.184465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.187634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.189027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.191224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.237373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:13.274768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Getting quotas for project 7781a80404734a5194371c87eb7e10f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:56:13.307707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Getting quotas for user 8db37092b92c4c43863e58af33e206a0 and project 7781a80404734a5194371c87eb7e10f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:56:13.396605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:56:13.402181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:13.667616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:13.673797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:13.718998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.730478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.732055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.733422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.734265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.735063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.756710 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e13cf985-4ec1-4d7b-90d0-dd975f517270 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.023920 Oct 04 20:56:13.770207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1582/3216] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 8039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:56:13.799232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5ad21f5-542c-4cde-8b2b-4b0a0d83cd0b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:13.803057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5ad21f5-542c-4cde-8b2b-4b0a0d83cd0b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:14.805779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5ad21f5-542c-4cde-8b2b-4b0a0d83cd0b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.858406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5ad21f5-542c-4cde-8b2b-4b0a0d83cd0b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1224 microversion: 2.1 time: 1.079639 Oct 04 20:56:14.861161 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1583/3217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:13 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1224 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:15.240257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:15.289785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd376486-91f3-435c-8058-d90783030555 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 1.634361 Oct 04 20:56:15.291464 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1635/3218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:13 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:15.907551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d20c54a-ddf7-430e-b0fd-6c3a18f5885f tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:15.912097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4d20c54a-ddf7-430e-b0fd-6c3a18f5885f tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:16.341893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:16.344579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:16.346526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4d20c54a-ddf7-430e-b0fd-6c3a18f5885f tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.362124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d20c54a-ddf7-430e-b0fd-6c3a18f5885f tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1224 microversion: 2.1 time: 0.465044 Oct 04 20:56:16.364181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1584/3219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:15 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1224 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:16.379902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.380954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.381819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.383151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.388627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.389517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.418217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:17.443463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:17.470389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.472981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.474403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.478364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.479708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.482215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.873356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:17.901564 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-000849fb-b6ac-4a3c-8103-bd4e66dfc5d8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1228 microversion: 2.1 time: 0.495838 Oct 04 20:56:17.903591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1585/3220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:17 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1228 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:18.021159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.062067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4329007-7ac2-4d0c-b155-98c40f62334c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 1.731068 Oct 04 20:56:18.063607 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1636/3221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:16 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:18.949768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:18.953339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:18.969835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.971156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.974246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:18.976272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.978175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.983218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.108439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.110749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.124646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.126318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.127200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.128946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.137645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.141389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.536250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:19.555332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5532698c-2fb5-4ab2-8e9e-57c5b8335078 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1276 microversion: 2.1 time: 0.615972 Oct 04 20:56:19.573143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1586/3222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:18 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1276 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:20.617074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.621364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:20.654042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.662095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.663552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.669106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.673904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.675343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:21.125149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.161109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8673e47f-92c5-4c1b-8f4d-747caeeb4158 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1282 microversion: 2.1 time: 0.565049 Oct 04 20:56:21.162237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1587/3223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:20 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1282 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:21.387616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.394732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=77 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:21.422015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31aed261-a409-4d42-8b2a-eaa92a422f2b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 2.320613 Oct 04 20:56:21.457479 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1637/3224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:22.217841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:22.226035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:22.252300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.258849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.265867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.265867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.265867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.265867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.483688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:22.486335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:22.527205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:22.534600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.536422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.537910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.540224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.545890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.545890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.752735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:22.789109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51cf04be-1690-4c71-b441-5b9dee51e12c tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1282 microversion: 2.1 time: 0.576215 Oct 04 20:56:22.795032 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1588/3225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:22 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1282 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:23.846897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:23.861042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:23.866374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:23.879795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:23.889216 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a9a48fb-5acb-4246-bbb6-5b5badcec61e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 1.418143 Oct 04 20:56:23.890606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1638/3226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:22 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:23.912802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:23.913893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:23.916900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:23.920637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:23.921713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:23.923238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.805948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:24.871346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2bc1e27-56f6-4622-bb48-782c470a1534 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1282 microversion: 2.1 time: 1.021100 Oct 04 20:56:24.872559 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1589/3227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:23 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1282 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:24.951243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:24.968839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:25.019111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.019111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.019111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.027850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.039567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.040991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.922530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:25.927859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:25.965250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.965928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.966634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.977648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.979232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.986381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.363012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:26.822328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:26.855679 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7d8de61-0d7c-46ef-82a6-11709c51a91b tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1282 microversion: 2.1 time: 0.942179 Oct 04 20:56:26.863797 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1590/3228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:25 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1282 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:26.876822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609aafb9-0bb6-4033-b54f-20b7448f7eb9", "tag": "c392142f-02df-4a9a-b394-3be1a6b85b98"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:26.916633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.916633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.916633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.943556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] Creating event network-changed:c392142f-02df-4a9a-b394-3be1a6b85b98 for instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 on n-h1-851029-13 Oct 04 20:56:26.966639 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-48ba9263-76ee-49c3-bb40-d4258f47b613 req-8cd466ce-90f5-416c-9495-9590f10ce021 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098768 Oct 04 20:56:26.971582 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1591/3229] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:27.925183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:27.934126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:27.959305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:27.961788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:27.963344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:27.965149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:27.966570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:27.968068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:28.192828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:28.223375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6d07ac1-cbfb-48a5-8489-495683453513 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 3.282115 Oct 04 20:56:28.276686 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1639/3230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:24 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 3303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:28.826734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:28.867334 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0be101fd-bbbc-455e-aa9a-4e96925ab424 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1282 microversion: 2.1 time: 0.957556 Oct 04 20:56:28.882708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1592/3231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:27 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1282 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:29.290389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:29.299861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:29.348761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.351363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.352423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.353755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.359904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.362840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.922625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:29.926901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:29.958602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.959655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.961670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.966331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.969174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.972279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:31.332607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:31.400947 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb6a1693-9a32-41a1-a09f-764811b09195 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 2.110615 Oct 04 20:56:31.401668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1640/3232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:29 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:32.447730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:32.461907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:32.545925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.546241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:32.547056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.550206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.558632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.563323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.568381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.660005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4244580-7904-4be2-b46d-960ad6168565 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 2.747782 Oct 04 20:56:32.716380 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1593/3233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:29 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 2805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:33.497754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-152547680", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "528153a9-4bc3-4dc2-9ae6-3df23391f5d6"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:33.869039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] validate_networks() for [('528153a9-4bc3-4dc2-9ae6-3df23391f5d6', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:36.524907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:36.551848 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5a0d083-b30b-4bec-b43e-8b39d3ae42e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 4.113542 Oct 04 20:56:36.604576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1641/3234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:32 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 4168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:36.649651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:36.653458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:36.688598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:36.695623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:36.697201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:36.707256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:36.708856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:36.714562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:38.361542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:38.424388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd57b6ec-fb93-46de-87be-de61d802ce20 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.811998 Oct 04 20:56:38.429095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1642/3235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:36 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:38.457128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:38.459546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:38.482812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:38.487399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:38.493613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:38.498726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:38.501435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:38.506216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:40.350251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:40.370462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc5b740e-4bb4-4aed-996e-b82c1fa2846f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 1.937524 Oct 04 20:56:40.372978 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1643/3236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:38 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:40.384649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:40.386260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:40.425706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:40.428740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:40.430927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:40.436434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:40.438539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:40.446200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:41.423256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:41.442979 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcf73e74-c900-400b-9ac0-c8ae2acc7aed tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.067413 Oct 04 20:56:41.458837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1644/3237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:40 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:41.458837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609aafb9-0bb6-4033-b54f-20b7448f7eb9", "name": "network-vif-plugged", "status": "completed", "tag": "c392142f-02df-4a9a-b394-3be1a6b85b98"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:41.480421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:41.487488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:41.488676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:41.514191 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] Creating event network-vif-plugged:c392142f-02df-4a9a-b394-3be1a6b85b98 for instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 on n-h1-851029-13 Oct 04 20:56:41.528163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c6cc80c8-a700-477e-b22f-9ecea276a944 req-0282ca63-50f9-48c7-bd2b-cb6a0ed7d820 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080754 Oct 04 20:56:41.529834 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1645/3238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:41.543479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:41.545286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:41.590381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:41.592936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:41.594472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:41.596691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:41.597575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:41.598448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:42.007869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:56:42.008950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:56:42.010078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:56:42.010961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:56:42.024406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:56:42.060909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:42.064360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:42.065764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:42.068783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:42.070293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:42.072869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:42.129063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:56:42.167359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for user 4ac6607c7faa4e8d9745bbf05780e9d6 and project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:56:42.212344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:56:42.219524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:42.581218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-214b667d-16b7-4acd-b67c-2184232fca6d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.818537 Oct 04 20:56:42.593723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1594/3239] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 9828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:56:42.616852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:42.628712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:42.670075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:42.674563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:42.676089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:42.679979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:42.681376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:42.682897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:44.067295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:44.085886 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9532d432-9bf0-498e-96dd-14a09dfe052f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 2.553282 Oct 04 20:56:44.111283 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1646/3240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:41 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:44.143583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-262797a1-49f2-4138-9c8b-c058ff20401f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:44.143583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-262797a1-49f2-4138-9c8b-c058ff20401f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:44.558799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:44.590262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0f79024-3318-4824-922d-149319f0eed0 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.994236 Oct 04 20:56:44.613078 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1595/3241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:42 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:44.634420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-262797a1-49f2-4138-9c8b-c058ff20401f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:44.641036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa935c3-8b37-4dad-9758-6be43e3a4623", "tag": "8b346980-ae7b-4d37-8051-a5dab5cd7bfc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:44.662313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:44.663807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:44.667255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:44.694109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] Creating event network-changed:8b346980-ae7b-4d37-8051-a5dab5cd7bfc for instance faa935c3-8b37-4dad-9758-6be43e3a4623 on n-h2-851029-13 Oct 04 20:56:44.697570 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-262797a1-49f2-4138-9c8b-c058ff20401f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1224 microversion: 2.1 time: 0.578347 Oct 04 20:56:44.698885 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1647/3242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:44 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1224 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:44.720020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7b33ee34-d2c2-4e8f-b563-9fb1d82dc2a2 req-f281ddab-70e8-4804-bf29-5beafbc2735f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103442 Oct 04 20:56:44.726180 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1596/3243] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:45.136230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:45.137529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:45.179344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:45.180367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:45.185228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:45.191214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:45.197355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:45.199643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:46.121582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:46.154288 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54e02254-d835-4774-a9e7-f18399385be9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1314 microversion: 2.1 time: 1.025470 Oct 04 20:56:46.161143 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1648/3244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:45 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:46.186619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:46.191209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:46.231361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:46.232826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:46.235489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:46.240380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:46.243870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:46.246019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:46.667149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1876145557", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d57370fb-68ad-4b0f-a781-e1bd39a394f4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:46.706432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:46.932884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:46.948332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] validate_networks() for [('d57370fb-68ad-4b0f-a781-e1bd39a394f4', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:46.964244 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60b60590-1fc1-44c6-9096-38ba42428c0d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 0.797887 Oct 04 20:56:46.965523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1649/3245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:46 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:47.008633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:47.010262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:47.023515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.025012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.027246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.028181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.029390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.030561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.389140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:47.448129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40f75fe3-f617-41dd-a525-6ffadf1e1dab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1220 microversion: 2.1 time: 0.461651 Oct 04 20:56:47.456154 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1650/3246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:46 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1220 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:47.485705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:47.492564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:47.519690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.520625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.521467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:47.522923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:47.523794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:47.524621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:49.024948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:49.081706 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-779dc1dd-5127-4b21-84e1-166a832f146e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1501 microversion: 2.1 time: 1.629838 Oct 04 20:56:49.082886 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1651/3247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:47 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1501 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:49.140002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:49.150263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:49.184354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:49.187100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:49.187879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:49.193724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:49.209910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:49.209910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:50.939958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:50.980029 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f2c3e0b-6b4d-4604-bbe1-9ac05b1dc0cb tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.863783 Oct 04 20:56:50.982931 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1652/3248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:49 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:51.007266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:51.014862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:51.061552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:51.062922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:51.076987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:51.078820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:51.080644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:51.084639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:51.278820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:56:51.280408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:56:51.281389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:56:51.282297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:56:51.283718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:56:51.340672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:51.341751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:51.343351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:51.346093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:51.347423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:51.351486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:51.400299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=62 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:51.456453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Getting quotas for project 7506970542da4c119f49cafe6fbb71ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:56:51.473026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Getting quotas for user 6b9d8cbffeb24a7b85f556f17607a9ec and project 7506970542da4c119f49cafe6fbb71ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:56:51.477209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:51.532514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Going to run 2 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:56:51.542409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4df823d5-438f-43c9-a3b1-880ba6e6d495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:51.543164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d185f76a-cb39-42d1-a252-835d6c42a493 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1282 microversion: 2.1 time: 0.555700 Oct 04 20:56:51.550298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1653/3249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:50 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1282 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:51.805287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=4df823d5-438f-43c9-a3b1-880ba6e6d495,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:52.053395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:52.055244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:52.099020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.105441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.119319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:52.125727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.127111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.130490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:52.184982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-44d6c9f8-ec7a-43ea-aeae-7a87987f2765 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.721666 Oct 04 20:56:52.187819 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1597/3250] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 6736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:56:52.228450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:52.250048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:52.255329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Searching by: {'deleted': False, 'project_id': '7506970542da4c119f49cafe6fbb71ee'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:56:52.303506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.306097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.308334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:52.310122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.311388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.316718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:52.407243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d52671bf-6b6b-45f5-8c29-850e177542d2 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.199754 Oct 04 20:56:52.421282 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1598/3251] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:56:52 2022] GET /compute/v2.1/servers => generated 677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:52.439951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5caccfd-be24-4fb9-80a1-43dd62a69102 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:52.441939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5caccfd-be24-4fb9-80a1-43dd62a69102 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:52.750020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5caccfd-be24-4fb9-80a1-43dd62a69102 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:52.784773 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5caccfd-be24-4fb9-80a1-43dd62a69102 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1220 microversion: 2.1 time: 0.360614 Oct 04 20:56:52.787545 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1599/3252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:52 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1220 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:52.810504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:52.812632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:52.846694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.847955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.848995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:52.850773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:52.852351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:52.854498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:53.777998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:53.811974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=92 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:53.837152 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50fd02ec-1264-4d09-9481-cfad5a641127 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.800465 Oct 04 20:56:53.858353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1654/3253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:52 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:53.905092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-edf44459-b1d6-47a2-bf0e-4f38ad4e679b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:53.906376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-edf44459-b1d6-47a2-bf0e-4f38ad4e679b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:53.928265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:54.552346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-edf44459-b1d6-47a2-bf0e-4f38ad4e679b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:54.572914 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-edf44459-b1d6-47a2-bf0e-4f38ad4e679b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1220 microversion: 2.1 time: 0.698581 Oct 04 20:56:54.572914 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1655/3254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:53 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1220 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:54.778714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:54.813815 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e20a4041-ec77-4f00-8858-7961693ced06 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 2.022304 Oct 04 20:56:54.831047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1600/3255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:52 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:54.887710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:54.902538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:54.949795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:54.953225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:54.954140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:54.960347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:54.961624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:54.965635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.624359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a99f5bac-e710-4d44-b591-79bf779f1ab0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:55.625531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a99f5bac-e710-4d44-b591-79bf779f1ab0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:55.879344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:55.907408 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1fa49a3b-9b39-472c-8269-0ba790ae4a04 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.027878 Oct 04 20:56:55.920956 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1656/3256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:54 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:55.933696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:55.938558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:55.969625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a99f5bac-e710-4d44-b591-79bf779f1ab0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:55.980289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.981781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.984091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.985365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.986762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.987619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.999764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a99f5bac-e710-4d44-b591-79bf779f1ab0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1220 microversion: 2.1 time: 0.388199 Oct 04 20:56:56.000916 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1601/3257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:55 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:56.305331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479fcefd-de40-4f7a-ad82-b7875ba2fd4a"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:56.338280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:56.371845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:56.372753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:56.373412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:56.385979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:56.387165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:56.387937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:56.959374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:56.973745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd3a3a18-f9d5-4b08-a335-83b345db163b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 1.050637 Oct 04 20:56:57.008577 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1657/3258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:55 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:57.026606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa935c3-8b37-4dad-9758-6be43e3a4623", "name": "network-vif-plugged", "status": "completed", "tag": "8b346980-ae7b-4d37-8051-a5dab5cd7bfc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:57.062631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:57.064560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:57.065489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:57.081881 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] Creating event network-vif-plugged:8b346980-ae7b-4d37-8051-a5dab5cd7bfc for instance faa935c3-8b37-4dad-9758-6be43e3a4623 on n-h2-851029-13 Oct 04 20:56:57.089366 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2d72a95b-ddde-4b76-8928-27832cc0acb9 req-d4cb8712-f9f3-4261-a3b8-65355b258b18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078747 Oct 04 20:56:57.093047 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1658/3259] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:57.107621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:57.129535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:57.156345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:57.178386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:57.184308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:57.185547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:57.186140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:57.186981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.348631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:58.350322 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca53172b-45d8-475a-bfd9-7ec23732a453 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.048045 Oct 04 20:56:58.353331 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1602/3260] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 20:56:56 2022] POST /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9/os-volume_attachments => generated 194 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:56:58.400900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:58.405485 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78cad1a0-25ca-401c-9070-235cd725da72 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 1.310801 Oct 04 20:56:58.412310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:58.424979 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1659/3261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:57 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:58.463811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:58.472416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:58.486771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.489139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.489139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.489529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.489529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.503400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.505291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.505975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.506947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.507494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.508407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.509182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.970494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:59.004752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c44e75f-bc98-4888-b529-b54589034893 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1224 microversion: 2.1 time: 0.637903 Oct 04 20:56:59.025673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1603/3262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:58 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1224 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:59.468560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:59.476187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:59.509286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:59.510950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:59.512422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:59.514420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:59.515848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:59.517694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:00.824501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:00.867187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc4bfc27-47dd-4017-b1ad-c8cfbb117ae8 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 2.407398 Oct 04 20:57:00.868970 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1660/3263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:58 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:00.894429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:00.896515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:00.928117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:00.929442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:00.932832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:00.939021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:00.945190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:00.947383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:01.713736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:01.716790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:01.774584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ab46558-d3bf-4bf3-aa36-f171665e970e tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1324 microversion: 2.1 time: 2.313425 Oct 04 20:57:01.781984 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a6a63d6-a738-4a5a-901e-b1bb42f1ce4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1272 microversion: 2.1 time: 0.902633 Oct 04 20:57:01.784608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1604/3264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:59 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1324 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:01.821764 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1661/3265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:00 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1272 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:01.849106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ca1b3f-fcfe-48a5-97e8-0ed20b901e35", "tag": "874c6c33-7175-4255-80af-1bb00d4733fc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:01.924383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:01.930488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:01.951414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:01.952277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:01.952886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:01.984165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:01.985108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:01.986478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:02.009119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:02.009119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:02.014055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:02.075861 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] Creating event network-changed:874c6c33-7175-4255-80af-1bb00d4733fc for instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 on n-h2-851029-13 Oct 04 20:57:02.112115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-749a8420-eeae-4713-abd3-6e57314b0c01 req-1f4ba7ff-21d4-47e6-a18a-87de54a0f810 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314314 Oct 04 20:57:02.112115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1605/3266] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:02.852462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:02.863709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:02.932116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:02.956128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:02.960814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:02.962595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:02.966470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:02.982757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:02.983673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:04.041757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:04.086523 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f448b55d-5aed-432c-beaf-c2854bbc3db3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 2.165028 Oct 04 20:57:04.088528 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1662/3267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:01 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:04.162173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:04.166555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:04.207538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:04.208635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:04.210822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:04.214915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:04.221450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:04.229976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:04.565829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:05.494494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:05.541468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f99c093-27cd-4207-a14a-1caba6af6ee5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1278 microversion: 2.1 time: 1.442367 Oct 04 20:57:05.554791 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1663/3268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:04 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1278 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:05.557108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:05.592095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:05.596357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:05.623318 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a011c7b6-45f0-48bb-8932-b886cd40e2a8 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1521 microversion: 2.1 time: 2.777462 Oct 04 20:57:05.634237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1606/3269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:02 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1521 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:05.634560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.634560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.634560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.634560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.634560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.635758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.685335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:05.690591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:05.738149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.741475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.742986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.748037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.755786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.773282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.942572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] HTTP exception thrown: Action 999 not found Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Request method failure captured: Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623/os-instance-actions/999 HTTP/1.1 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3kFtxrjyWy0_Qqx1sKcAvi9I6myHeH5QDKHw1V9LhWLBe1eIqdMd6mRsTj0UTX-COc1BPv35mV-Tf5c6L92ldxapsAKgbFlxqlRkWSN6meYoK9kUiqgx2boSCbm7EL7yy_5r75i-PPzsTZ2Mujm8vEahVQhUOmzuPqfFr0yIuwPmU Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7781a80404734a5194371c87eb7e10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8db37092b92c4c43863e58af33e206a0 Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: exception: Action 999 not found Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'faa935c3-8b37-4dad-9758-6be43e3a4623', 'id': '999'} Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 20:57:05.958818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:05.968022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Returning 404 to user: Action 999 not found {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:05.975142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a02f8c76-f3ba-4d20-b609-00f31bf2945d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.293399 Oct 04 20:57:05.975142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1607/3270] 10.222.0.36 () {58 vars in 1308 bytes} [Tue Oct 4 20:57:05 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623/os-instance-actions/999 => generated 66 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:57:05.993687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '.version_select at 0x7f54f5e21ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:06.012418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: d150b544-848c-4485-94f8-91c29ca81102] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:06.029128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:06.053408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] HTTP exception thrown: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Request method failure captured: Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d150b544-848c-4485-94f8-91c29ca81102/os-instance-actions HTTP/1.1 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ3kFtxrjyWy0_Qqx1sKcAvi9I6myHeH5QDKHw1V9LhWLBe1eIqdMd6mRsTj0UTX-COc1BPv35mV-Tf5c6L92ldxapsAKgbFlxqlRkWSN6meYoK9kUiqgx2boSCbm7EL7yy_5r75i-PPzsTZ2Mujm8vEahVQhUOmzuPqfFr0yIuwPmU Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7781a80404734a5194371c87eb7e10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8db37092b92c4c43863e58af33e206a0 Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'd150b544-848c-4485-94f8-91c29ca81102'} Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:06.055985 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Returning 404 to user: Instance d150b544-848c-4485-94f8-91c29ca81102 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-850c4840-84d1-4226-877c-f59a667a108d tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/d150b544-848c-4485-94f8-91c29ca81102/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.075326 Oct 04 20:57:06.072140 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1608/3271] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 4 20:57:05 2022] GET /compute/v2.1/servers/d150b544-848c-4485-94f8-91c29ca81102/os-instance-actions => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:06.099593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:06.100531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:06.142522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.169747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.175655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:06.175655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.175655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.185334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:06.297196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:07.204669 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-081432d9-3ea6-458c-91f4-15222a5a0c18 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "DELETE /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 204 len: 0 microversion: 2.1 time: 1.126194 Oct 04 20:57:07.211039 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1609/3272] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:06 2022] DELETE /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:57:07.231300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:07.233227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:07.253733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:07.257315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:07.263753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:07.265081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:07.269373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:07.271728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:08.037510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:08.094718 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-303cb810-0b17-4793-b521-ba4480f614e7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1278 microversion: 2.1 time: 0.872235 Oct 04 20:57:08.099752 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1610/3273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:07 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1278 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:08.125401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:08.132294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:08.159991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:08.166764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:08.166764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:08.166764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:08.167658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:08.168957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:08.222572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:08.271609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa237b96-e4cb-471d-a08d-6774216f10d4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 2.725889 Oct 04 20:57:08.276632 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1664/3274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:05 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:09.167622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:09.172704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:09.228328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.233659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.235157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:09.242278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.245298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:09.249669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.253094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:09.277742 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6857ecd-7ec2-45f7-9ea1-35ca3b7f74e2 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1527 microversion: 2.1 time: 1.172295 Oct 04 20:57:09.305003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1611/3275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:08 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1527 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:09.331170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:09.336951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:09.370921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.374717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.378295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:09.381185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.384209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.385542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:10.423100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:10.455822 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b02bab8c-39c9-4445-a621-7d935f4ef7c5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1278 microversion: 2.1 time: 1.302133 Oct 04 20:57:10.461523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1665/3276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:09 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1278 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:10.478527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.493152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:10.529711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:10.531320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:10.532161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:10.536007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:10.539936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:10.541827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:12.361694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:12.394551 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6717e516-a45e-48f8-9a54-d6cd78a7da78 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1527 microversion: 2.1 time: 1.930911 Oct 04 20:57:12.399442 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1666/3277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1527 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:12.602267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:12.643348 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68cb79cf-613a-4f0d-943c-179254f3b14c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 3.316807 Oct 04 20:57:12.647624 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1612/3278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:09 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 3326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:12.666953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.682316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:12.742719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.746104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.746903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:12.750140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.753452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.757336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.270876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:13.304715 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8af34f84-8dee-4cce-8136-c4ff12e68c65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1278 microversion: 2.1 time: 0.653844 Oct 04 20:57:13.308733 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1613/3279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1278 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:13.324779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa935c3-8b37-4dad-9758-6be43e3a4623", "name": "network-vif-deleted", "tag": "8b346980-ae7b-4d37-8051-a5dab5cd7bfc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:13.376443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.377664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.378345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.442916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] Creating event network-vif-deleted:8b346980-ae7b-4d37-8051-a5dab5cd7bfc for instance faa935c3-8b37-4dad-9758-6be43e3a4623 on n-h2-851029-13 Oct 04 20:57:13.452052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:13.455836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:13.467197 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1c146e43-cfa5-4b9d-9f22-146bba951586 req-c5f4e1a3-9494-4dc0-9987-74aebe6a7854 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.058414 Oct 04 20:57:13.468516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1667/3280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:13.485991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.487541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.488731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.490594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.492247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.493535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.655960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.657342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.659527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.661992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lazy-loading 'fault' on Instance uuid faa935c3-8b37-4dad-9758-6be43e3a4623 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:57:13.701131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:13.705153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:13.734218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.739325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.744748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.750035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:13.753308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:13.754393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.546149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db37092b92c4c43863e58af33e206a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7781a80404734a5194371c87eb7e10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:14.594774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c8ac95a7-6b48-4109-b21c-0fc269311111 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 200 len: 1314 microversion: 2.1 time: 1.151137 Oct 04 20:57:14.597732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1614/3281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:13 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 1314 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:14.610496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ca1b3f-fcfe-48a5-97e8-0ed20b901e35", "name": "network-vif-plugged", "status": "completed", "tag": "874c6c33-7175-4255-80af-1bb00d4733fc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:14.669661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.671091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.676853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.733768 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] Creating event network-vif-plugged:874c6c33-7175-4255-80af-1bb00d4733fc for instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 on n-h2-851029-13 Oct 04 20:57:14.753583 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8290f7e2-d705-4af3-81a1-77902e1809b4 req-bf25dd71-f6c2-4495-8d32-6bacd561d5a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151679 Oct 04 20:57:14.763480 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1615/3282] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:14.780632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.789499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:14.816847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.820197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.821106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.827412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.828695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.829669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.848499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:15.227650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:15.249746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-566cd06d-30ca-4b01-9d84-0230e697ea07 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1278 microversion: 2.1 time: 0.483420 Oct 04 20:57:15.265212 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1616/3283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:14 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1278 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:15.315536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:15.350067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb42f299-a8b9-49ae-ad26-cd786ca8ec61 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 1.661407 Oct 04 20:57:15.354141 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1668/3284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:13 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:15.672567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.695399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] [instance: faa935c3-8b37-4dad-9758-6be43e3a4623] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:15.707922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:15.710181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:15.710736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:15.712110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:15.712893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:15.714230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:15.772600 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] HTTP exception thrown: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Request method failure captured: Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 HTTP/1.1 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ3kFtxrjyWy0_Qqx1sKcAvi9I6myHeH5QDKHw1V9LhWLBe1eIqdMd6mRsTj0UTX-COc1BPv35mV-Tf5c6L92ldxapsAKgbFlxqlRkWSN6meYoK9kUiqgx2boSCbm7EL7yy_5r75i-PPzsTZ2Mujm8vEahVQhUOmzuPqfFr0yIuwPmU Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7781a80404734a5194371c87eb7e10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7781a80404734a5194371c87eb7e10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7781a80404734a5194371c87eb7e10f9 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1850905952 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8db37092b92c4c43863e58af33e206a0 Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1850905952-project Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'faa935c3-8b37-4dad-9758-6be43e3a4623'} Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:15.776337 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] Returning 404 to user: Instance faa935c3-8b37-4dad-9758-6be43e3a4623 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d72d7c16-97c6-4bb5-94e9-49181e25e061 tempest-InstanceActionsNegativeTestJSON-1850905952 tempest-InstanceActionsNegativeTestJSON-1850905952-project] 10.222.0.36 "GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623" status: 404 len: 111 microversion: 2.1 time: 0.142233 Oct 04 20:57:15.794462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1669/3285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/servers/faa935c3-8b37-4dad-9758-6be43e3a4623 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:57:15.976525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Calling method '.version_select at 0x7f54f6253820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.988548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:15.993094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:15.998178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.068837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.069928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.071140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.096978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.098505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.099759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.124475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c06fbed-06b4-469e-befc-5e42eef1ee22 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-990523613-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.856709 Oct 04 20:57:16.142268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1617/3286] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:16.327122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.328480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:16.354793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.362204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.363402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.367838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.373231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.376222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.422264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.424094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:16.489232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.502949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.502949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:16.502949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:16.504594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:16.505792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:17.369374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:17.398026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a83874df-4a6c-459f-af6d-d6be4bf5813b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 1.090394 Oct 04 20:57:17.413694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1670/3287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:16 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:17.663122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:17.758796 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed39f234-da1b-4902-b5d8-1330f9969bab tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1324 microversion: 2.1 time: 1.352601 Oct 04 20:57:17.765268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1618/3288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:16 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1324 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:18.451188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:18.452157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:18.475185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:18.477363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:18.482080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:18.485005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:18.486443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:18.488844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:18.820870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:18.832104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:18.837918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:18.884384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:18.888528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:18.890956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:18.895073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:18.899462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:18.900900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:21.545411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:21.618864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd752347-139d-42c3-83a1-1eda07a35e6b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 3.174689 Oct 04 20:57:21.620533 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1671/3289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:18 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:21.801615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:21.864807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81bab8cb-4a74-4b2a-92dc-b09c9ceebc6e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 3.048151 Oct 04 20:57:21.896754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1619/3290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:18 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 3086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:21.929511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:21.933513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:21.964594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:21.965993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:21.967156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:21.970211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:21.971749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:21.972797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:22.673859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:22.679467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:22.722285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:22.733154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:22.733154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:22.733154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:22.733154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:22.733154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.660842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:23.720155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1dd02757-88e7-405b-a460-318ee5dca8bc tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 1.784362 Oct 04 20:57:23.738837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1672/3291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:21 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:23.761952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:23.782389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:23.806643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:23.806643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:23.806643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.810188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:23.812311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:23.813902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.930885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:24.076104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:24.611542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93c8b963-4367-467d-94dd-e4366c685440 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 204 len: 0 microversion: 2.1 time: 0.868305 Oct 04 20:57:24.618695 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1673/3292] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:23 2022] DELETE /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:24.654971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ed76f2f-42d7-4c5d-aae4-e6bdc73f46e9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1485332733", "metadata": {"": ""}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ed76f2f-42d7-4c5d-aae4-e6bdc73f46e9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action HTTP/1.1 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 107 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1485332733", "metadata": {"": ""}}} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1485332733', 'metadata': {'': ''}}}} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:24.673774 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:24.685460 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:24.691105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ed76f2f-42d7-4c5d-aae4-e6bdc73f46e9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:24.693300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ed76f2f-42d7-4c5d-aae4-e6bdc73f46e9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action" status: 400 len: 170 microversion: 2.1 time: 0.072135 Oct 04 20:57:24.694822 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1674/3293] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 4 20:57:24 2022] POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action => generated 170 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:24.825411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:24.859260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67da49b4-fc90-4e18-ba9c-db40d1e57ec5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 2.190763 Oct 04 20:57:24.860833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1620/3294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:22 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:24.880216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:24.889243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:24.913396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.918856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.923688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.926000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.926958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.930864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.938977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df823d5-438f-43c9-a3b1-880ba6e6d495", "tag": "9e57d7f3-cd88-440e-be21-da401c8e76fd"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:24.997794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:25.002095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.004905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.006528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:25.042361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] Creating event network-changed:9e57d7f3-cd88-440e-be21-da401c8e76fd for instance 4df823d5-438f-43c9-a3b1-880ba6e6d495 on n-h1-851029-13 Oct 04 20:57:25.053144 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0e39bb5e-bd8e-45ef-b88d-293c8160c8f2 req-50db06ce-135e-4105-aaa0-3cfe02af6ae8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355688 Oct 04 20:57:25.057272 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1675/3295] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:25.073674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:25.075358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:25.088276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.089281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.090099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:25.091518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.092393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.093217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:26.796275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:26.841839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d1230d0-94c9-4982-869a-b2054f689090 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 1.773173 Oct 04 20:57:26.843065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1676/3296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:25 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:26.852904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:26.864614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:26.889640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:26.890401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:26.895978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:26.908622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:26.910369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:26.911507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:27.660747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:27.671261 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b075c7d1-baab-4b58-b850-02a972104f2f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1553 microversion: 2.1 time: 2.805644 Oct 04 20:57:27.672317 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1621/3297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:24 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1553 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:27.680266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:27.681257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:27.690620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:27.691714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:27.692388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:27.693551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:27.694450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:27.695144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.600733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:29.637873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e8055db-383d-45ab-8e10-7e96791f57a3 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 2.792406 Oct 04 20:57:29.651985 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1677/3298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:26 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:29.662513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf", "tag": "4770290b-d1cf-404e-ad47-646da7455a33"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:29.700452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.702262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.703533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.737141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] Creating event network-changed:4770290b-d1cf-404e-ad47-646da7455a33 for instance ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf on n-h2-851029-13 Oct 04 20:57:29.749537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3457ba55-7296-4ee7-b484-3e699570708f req-9b06941a-b0f6-4527-b2e1-b730b462bf3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095133 Oct 04 20:57:29.751774 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1678/3299] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:29.762563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:29.764286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:29.778285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.779382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.780683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.783444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.784862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.785592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.357338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:30.373917 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c8696e8-5b21-4973-8f13-b8e0b1bd9663 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 2.699610 Oct 04 20:57:30.408491 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1622/3300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:27 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:30.427780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-192a6fdb-46fc-4377-99e8-227d44ecb988 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-828733445", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-192a6fdb-46fc-4377-99e8-227d44ecb988 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action HTTP/1.1 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 618 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-828733445", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-828733445', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:30.436813 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:57:30.444990 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:30.454428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-192a6fdb-46fc-4377-99e8-227d44ecb988 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:30.454428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-192a6fdb-46fc-4377-99e8-227d44ecb988 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action" status: 400 len: 938 microversion: 2.1 time: 0.029213 Oct 04 20:57:30.461090 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1623/3301] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 4 20:57:30 2022] POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:57:30.513873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:30.515578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:30.533738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.534623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.538847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.543950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.545547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.548093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.400046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:31.426227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c71444c7-8bc4-4b35-95d0-e83f83211226 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1553 microversion: 2.1 time: 1.671654 Oct 04 20:57:31.432161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1679/3302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:29 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1553 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:31.480244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:31.483225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:31.531287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.532270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.533117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.535988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.536976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.537804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:32.028119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:32.074852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1441734c-b50b-4c17-ae59-1e3b0064c809 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 1.610236 Oct 04 20:57:32.096327 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1624/3303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:30 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:32.374966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609aafb9-0bb6-4033-b54f-20b7448f7eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "c392142f-02df-4a9a-b394-3be1a6b85b98"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:32.416546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:32.417506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:32.418323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:32.469867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] Creating event network-vif-unplugged:c392142f-02df-4a9a-b394-3be1a6b85b98 for instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 on n-h1-851029-13 Oct 04 20:57:32.495300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-180e42c1-b359-4db7-b5a3-0c0005f13a3a req-389d3a11-7b3b-4671-9fdf-c4aeaf67c667 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.396215 Oct 04 20:57:32.497616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1625/3304] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:32.512288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:32.519110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:32.554652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:32.555361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:32.561947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:32.572892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:32.574159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:32.575382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.350121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:33.378362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b92e8dcf-7205-4eb3-a4ba-c3399dc2b366 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 1.941440 Oct 04 20:57:33.427309 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1680/3305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:31 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:33.456365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:33.462681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:33.502449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.515121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.526908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.526908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.530876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.536333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:34.901310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:34.921968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cf598c0-0ec8-4357-b0ed-fcd960a980cb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1511 microversion: 2.1 time: 1.491636 Oct 04 20:57:34.931143 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1681/3306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:33 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1511 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:35.043749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-740896663", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "5f52e78e-d2c9-4685-a323-2481dd0ccf9b"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:35.190182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] validate_networks() for [('5f52e78e-d2c9-4685-a323-2481dd0ccf9b', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:35.206564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:35.227686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a50b3dd-b1f0-47c0-bbf0-9ecbae7aca4d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 2.728696 Oct 04 20:57:35.229934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1626/3307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:32 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:35.253202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:35.268761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:35.269054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.270257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.271648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.273826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.275141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.276324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:36.792718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:36.820015 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b87b7fb7-3c09-4b7c-a0f5-315db59fac9b tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 1.587275 Oct 04 20:57:36.827364 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1627/3308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:35 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:36.844745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a093a8d3-fb8b-41ab-ab2a-69127f66d0f3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a093a8d3-fb8b-41ab-ab2a-69127f66d0f3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action HTTP/1.1 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 285 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.863449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:57:36.869409 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:36.873591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a093a8d3-fb8b-41ab-ab2a-69127f66d0f3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:36.875844 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a093a8d3-fb8b-41ab-ab2a-69127f66d0f3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action" status: 400 len: 619 microversion: 2.1 time: 0.045338 Oct 04 20:57:36.881847 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1628/3309] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 4 20:57:36 2022] POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:36.891158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609aafb9-0bb6-4033-b54f-20b7448f7eb9", "name": "network-vif-deleted", "tag": "c392142f-02df-4a9a-b394-3be1a6b85b98"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:36.932176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:36.944007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:36.945245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:36.986361 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] Creating event network-vif-deleted:c392142f-02df-4a9a-b394-3be1a6b85b98 for instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 on n-h1-851029-13 Oct 04 20:57:36.998183 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2de5144c-76e0-4aac-8d7e-cc1e8ba2c8c0 req-8a71009a-64bc-4398-89aa-af710378d7a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113879 Oct 04 20:57:37.012609 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1629/3310] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:37.023474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:37.025308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:37.039269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.040739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.042479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.048118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.048118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.048118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.429154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:37.447663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dcecfa25-a0d6-4b49-8bf2-aad180c77c6e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1345 microversion: 2.1 time: 0.432296 Oct 04 20:57:37.463421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1630/3311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:37 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1345 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:37.492392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:37.493597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:37.508516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.513762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.513762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.513762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.516922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.518420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.515706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:40.540828 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4332da8d-154c-4b53-9a9a-46727ad4ab11 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 3.074794 Oct 04 20:57:40.579700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1631/3312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:37 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 3114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:40.590721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.591895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.623259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.624372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.625303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.626709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.627607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.628426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.272896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:57:41.273720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:57:41.274713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:57:41.275531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:57:41.276422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:57:41.356895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.363946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.367820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.373270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.377148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.378778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.465700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Getting quotas for project 8b323a1c025c470fb77b10d593176b79. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:41.501023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Getting quotas for user f937c1821d204ef2b29ba720fbeb62ef and project 8b323a1c025c470fb77b10d593176b79. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:41.559434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:57:41.565969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:57:41.778156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:41.870231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-510237a8-3885-4935-bacb-c437e015c9ff tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 1.279505 Oct 04 20:57:41.872190 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1632/3313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:41.903153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df823d5-438f-43c9-a3b1-880ba6e6d495", "name": "network-vif-plugged", "status": "completed", "tag": "9e57d7f3-cd88-440e-be21-da401c8e76fd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:41.927915 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1806775f-8a65-47fe-a483-b6d10ce5da4a tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.994645 Oct 04 20:57:41.954084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1682/3314] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 7022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:57:41.990324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.991796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:41.995520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:41.996059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.997293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.059852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.059852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.059852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.067792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.069223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.090244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.126388 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] Creating event network-vif-plugged:9e57d7f3-cd88-440e-be21-da401c8e76fd for instance 4df823d5-438f-43c9-a3b1-880ba6e6d495 on n-h1-851029-13 Oct 04 20:57:42.153520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b38d39dd-3106-4b1c-bbe2-2bc504affc12 req-e1186b61-bd66-4303-b03d-f568cd354801 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277668 Oct 04 20:57:42.156395 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1633/3315] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:42.173164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:42.178025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:42.221854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.229395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.231955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.236606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.244862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.246704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:43.349137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:43.395564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5193e47e-0250-4bb0-89b6-809abc91d3a0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1345 microversion: 2.1 time: 1.431939 Oct 04 20:57:43.397863 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1683/3316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1345 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:43.413064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0aac653f-11ec-493a-a4b0-ad5face5b90d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:43.415785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0aac653f-11ec-493a-a4b0-ad5face5b90d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:44.032603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aac653f-11ec-493a-a4b0-ad5face5b90d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:44.087825 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0aac653f-11ec-493a-a4b0-ad5face5b90d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1227 microversion: 2.1 time: 0.660000 Oct 04 20:57:44.087825 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1684/3317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:43 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1227 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:44.087825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:44.087825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:44.118289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:44.119363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:44.120148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:44.121527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:44.122430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:44.123326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.069914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:45.120026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d50bc07b-448e-4376-b9a2-6bca0140c41c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 2.957363 Oct 04 20:57:45.123252 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1634/3318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:42 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 2966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:45.138047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf", "name": "network-vif-plugged", "status": "completed", "tag": "4770290b-d1cf-404e-ad47-646da7455a33"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:45.170834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.170834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.170834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.198856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] Creating event network-vif-plugged:4770290b-d1cf-404e-ad47-646da7455a33 for instance ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf on n-h2-851029-13 Oct 04 20:57:45.210810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5b2de2ad-3528-4f80-baf3-75e912da7fe0 req-5028daf3-a1d0-492a-8262-3bee7dc96724 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084223 Oct 04 20:57:45.260421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1635/3319] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:45.364616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:45.368077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:45.436133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.437478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.438702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.445651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.445651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.445651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.788596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:45.818318 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ddc7e12f-dc1b-4ebc-9e42-7f58dc5d9c26 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1320 microversion: 2.1 time: 1.742999 Oct 04 20:57:45.831694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1685/3320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:44 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1320 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:45.878923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:45.880090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:45.917750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.918700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.919543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.920937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.921822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.922981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:46.068010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:46.109016 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20e56941-eddc-4f65-8a32-88a3478b8767 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1345 microversion: 2.1 time: 0.833629 Oct 04 20:57:46.112381 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1636/3321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:45 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1345 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:46.127681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1069168378"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:46.138200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:46.171284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:46.176998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:46.178353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:46.180742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:46.185482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:46.190551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:46.191106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:46.247775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bdfb90b-80da-4a56-8b06-bacd05de033d tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1231 microversion: 2.1 time: 0.386312 Oct 04 20:57:46.251915 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1686/3322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:45 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1231 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:46.272070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:47.595335 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-110907c3-4c6b-4064-8c87-857b29f10a8e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action" status: 202 len: 0 microversion: 2.1 time: 1.479616 Oct 04 20:57:47.599519 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1637/3323] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:57:46 2022] POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action => generated 0 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:57:47.624836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.624836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:47.625336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e611c2c5-4999-475b-a28f-aee00d811595 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f56a9e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1766607035", "description": "tempest-description-1954945753"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:47.643561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.647582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.649159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.652966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.654326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.655590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.282955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:48.317841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55b2359b-f74c-4c4b-b288-4f373c52bbdd tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 200 len: 1507 microversion: 2.1 time: 0.714746 Oct 04 20:57:48.318975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1638/3324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 1507 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:48.338518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.345668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:48.378018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.381909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.386587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.390713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.395333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.397372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.517625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.519240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.520456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.521311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'fault' on Instance uuid 609aafb9-0bb6-4033-b54f-20b7448f7eb9 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:57:48.773608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:48.823095 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd3494f5-d8e8-489f-b3b8-fbc0d4712423 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 200 len: 1350 microversion: 2.1 time: 0.488076 Oct 04 20:57:48.825895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1639/3325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:48 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 1350 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:48.854314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.854314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:48.879011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.886258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.886258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.888360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.889213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.890005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.287640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:49.300473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e611c2c5-4999-475b-a28f-aee00d811595 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 3.048345 Oct 04 20:57:49.301839 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1687/3326] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:57:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 3052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:49.321261 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b52eacef-a6ba-45b1-b904-72910311f52b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1297 microversion: 2.1 time: 0.491691 Oct 04 20:57:49.327239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1640/3327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:48 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1297 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:49.358185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2059180773"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:49.371631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:49.399580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:49.410295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.412363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.414928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.419266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.420190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.420959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.551066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2de6ae17-3742-492e-bbac-4d51dd5b8860 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-750689827", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:49.561545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2de6ae17-3742-492e-bbac-4d51dd5b8860 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] HTTP exception thrown: min_count must be <= max_count Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2de6ae17-3742-492e-bbac-4d51dd5b8860 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Request method failure captured: Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 183 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5Kd-4yQgg_4p51TzJsKg8caiX8KHoY07jRQhlE6-uSi7zH_0I0KRDmKW2CS4g5PFHRnTsEKnlKUU6Zuc6aISVGRxZ0218Ih0QVshL8WQj5hQ-rJWj4vfW2lTo54yhXDSr9-VNL8bMyyT0sC69I9nD3hzk3lzJwFOhoBWtHn1Hc7_0 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 57338d5e0ce1421a9a511ca334ee9e03 Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-750689827", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: exception: min_count must be <= max_count Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-750689827', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 20:57:49.566299 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.585483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2de6ae17-3742-492e-bbac-4d51dd5b8860 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Returning 400 to user: min_count must be <= max_count {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:49.588658 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2de6ae17-3742-492e-bbac-4d51dd5b8860 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.283952 Oct 04 20:57:49.604263 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Cannot 'createImage' instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 while it is in task_state image_snapshot Oct 04 20:57:49.607848 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1688/3328] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:49 2022] POST /compute/v2.1/servers => generated 74 bytes in 305 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action HTTP/1.1 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 85 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2059180773"}} Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'createImage' instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 while it is in task_state image_snapshot Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2059180773'}}} Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:57:49.617246 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 while it is in task_state image_snapshot Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 while it is in task_state image_snapshot Oct 04 20:57:49.639673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.643405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:49.643605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 409 to user: Cannot 'createImage' instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 while it is in task_state image_snapshot {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:49.643789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4df823d5-438f-43c9-a3b1-880ba6e6d495] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:49.643968 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0b38784-d2f9-4114-ae02-142afe2eb26b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action" status: 409 len: 159 microversion: 2.1 time: 0.284333 Oct 04 20:57:49.643968 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1641/3329] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:57:49 2022] POST /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35/action => generated 159 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:57:49.654243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39ae5afe-cd4a-448c-967f-9a6edc16782b tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f5e1fd30>, body: {"security_group_rule": {"parent_group_id": "76b0c9b8-9c9d-4fde-b081-4351e0906708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:49.659106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.669936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.669936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.669936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.669936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.669936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:50.533266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:50.592546 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-036666c9-f845-4c65-8db8-74ba607deaa7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4df823d5-438f-43c9-a3b1-880ba6e6d495" status: 200 len: 1507 microversion: 2.1 time: 0.982640 Oct 04 20:57:50.595145 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1689/3330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:49 2022] GET /compute/v2.1/servers/4df823d5-438f-43c9-a3b1-880ba6e6d495 => generated 1507 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:50.605570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f547887-5799-4f13-a412-a87e350deb35 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54f66525e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.270356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f547887-5799-4f13-a412-a87e350deb35 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/images/5106260d-6eda-4844-bcaa-9f4143b46c2f" status: 204 len: 0 microversion: 2.1 time: 0.672734 Oct 04 20:57:51.276944 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1690/3331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:50 2022] DELETE /compute/v2.1/images/5106260d-6eda-4844-bcaa-9f4143b46c2f => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:51.286419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4285dcf5-8c03-4db0-a8f5-ff627cce209c tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-551980437", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "max_count": 0}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4285dcf5-8c03-4db0-a8f5-ff627cce209c tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Request method failure captured: Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 167 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5Kd-4yQgg_4p51TzJsKg8caiX8KHoY07jRQhlE6-uSi7zH_0I0KRDmKW2CS4g5PFHRnTsEKnlKUU6Zuc6aISVGRxZ0218Ih0QVshL8WQj5hQ-rJWj4vfW2lTo54yhXDSr9-VNL8bMyyT0sC69I9nD3hzk3lzJwFOhoBWtHn1Hc7_0 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 57338d5e0ce1421a9a511ca334ee9e03 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-551980437", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "max_count": 0}} Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-551980437', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'max_count': 0}}} Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:51.308113 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4285dcf5-8c03-4db0-a8f5-ff627cce209c tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4285dcf5-8c03-4db0-a8f5-ff627cce209c tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.037766 Oct 04 20:57:51.323770 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1691/3332] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:51 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:51.326594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.326594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:51.342870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.344550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.345688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.347323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.348294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.349130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.434834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:51.442930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:51.447412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39ae5afe-cd4a-448c-967f-9a6edc16782b tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.801679 Oct 04 20:57:51.448522 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1642/3333] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:57:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 HTTP/1.1 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '609aafb9-0bb6-4033-b54f-20b7448f7eb9'} Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:51.453812 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:51.463844 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:57:51.470700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:51.470700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92e3cab5-1001-4e63-86df-adf84288d064 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 404 len: 111 microversion: 2.1 time: 0.152218 Oct 04 20:57:51.470700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1692/3334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:51 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:51.471619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.472083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:51.486248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.487246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.488100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.490079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.491036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.491867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.496609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.502835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4df823d5-438f-43c9-a3b1-880ba6e6d495] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:51.595759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.598835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.598835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.600098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.609613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.610477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.783622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4df823d5-438f-43c9-a3b1-880ba6e6d495] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:52.396311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53692600-0216-4f21-aecb-e39c729433a7 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4df823d5-438f-43c9-a3b1-880ba6e6d495" status: 204 len: 0 microversion: 2.1 time: 0.924039 Oct 04 20:57:52.398432 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1693/3335] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:51 2022] DELETE /compute/v2.1/servers/4df823d5-438f-43c9-a3b1-880ba6e6d495 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:52.420068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:52.423221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:52.449061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:52.449916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:52.457162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:52.462457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:52.465925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:52.469625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:52.613052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:52.654408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-82fabdb6-c79a-4944-a8c1-619273f09430 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 1.203478 Oct 04 20:57:52.655784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1643/3336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:51 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:52.676446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1870f6bb-06b0-4133-a7cf-f02c8f88dcc6 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1840060089", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "max_count": 2.5}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1870f6bb-06b0-4133-a7cf-f02c8f88dcc6 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Request method failure captured: Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 170 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5Kd-4yQgg_4p51TzJsKg8caiX8KHoY07jRQhlE6-uSi7zH_0I0KRDmKW2CS4g5PFHRnTsEKnlKUU6Zuc6aISVGRxZ0218Ih0QVshL8WQj5hQ-rJWj4vfW2lTo54yhXDSr9-VNL8bMyyT0sC69I9nD3hzk3lzJwFOhoBWtHn1Hc7_0 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 57338d5e0ce1421a9a511ca334ee9e03 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1840060089", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "max_count": 2.5}} Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1840060089', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:52.699361 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1870f6bb-06b0-4133-a7cf-f02c8f88dcc6 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1870f6bb-06b0-4133-a7cf-f02c8f88dcc6 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.053297 Oct 04 20:57:52.716724 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1644/3337] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:52.727215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199812ee-bb80-4e11-b62a-a083a3a5715a tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f5e9fb80>, body: {"security_group_rule": {"parent_group_id": "76b0c9b8-9c9d-4fde-b081-4351e0906708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:53.034216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-199812ee-bb80-4e11-b62a-a083a3a5715a tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199812ee-bb80-4e11-b62a-a083a3a5715a tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 138 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: {"security_group_rule": {"parent_group_id": "76b0c9b8-9c9d-4fde-b081-4351e0906708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: exception: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '76b0c9b8-9c9d-4fde-b081-4351e0906708', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.038563 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.051477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:53.051477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:53.051477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 Oct 04 20:57:53.051477 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.055959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-199812ee-bb80-4e11-b62a-a083a3a5715a tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: This rule already exists in group 76b0c9b8-9c9d-4fde-b081-4351e0906708 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:53.058026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-199812ee-bb80-4e11-b62a-a083a3a5715a tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.339890 Oct 04 20:57:53.060117 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1645/3338] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:57:52 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:53.074446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:53.078630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:53.098131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.102577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.102577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:53.103567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.108122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:53.116165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.117381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:53.140493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d3b7283-131a-4eba-bef8-132ac933fbb2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1520 microversion: 2.1 time: 0.736486 Oct 04 20:57:53.141769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1694/3339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:52 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1520 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:53.161890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:53.163637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:53.165362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9/os-volume_attachments HTTP/1.1 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': '609aafb9-0bb6-4033-b54f-20b7448f7eb9'} Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:53.165623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48762fc3-6240-4d41-8d94-362b9b91937a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103285 Oct 04 20:57:53.179652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1646/3340] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 20:57:53 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9/os-volume_attachments => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:53.201729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77082d30-b1ab-4212-9ec6-bef0e6e479c5 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-419680156", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 0}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:53.212642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.214650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.225008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77082d30-b1ab-4212-9ec6-bef0e6e479c5 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Request method failure captured: Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 167 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5Kd-4yQgg_4p51TzJsKg8caiX8KHoY07jRQhlE6-uSi7zH_0I0KRDmKW2CS4g5PFHRnTsEKnlKUU6Zuc6aISVGRxZ0218Ih0QVshL8WQj5hQ-rJWj4vfW2lTo54yhXDSr9-VNL8bMyyT0sC69I9nD3hzk3lzJwFOhoBWtHn1Hc7_0 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 57338d5e0ce1421a9a511ca334ee9e03 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-419680156", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 0}} Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-419680156', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'min_count': 0}}} Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:53.228421 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:57:53.239138 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:53.244533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.245247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77082d30-b1ab-4212-9ec6-bef0e6e479c5 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:53.247385 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77082d30-b1ab-4212-9ec6-bef0e6e479c5 tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.069060 Oct 04 20:57:53.249289 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1647/3341] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:53.252897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.256960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:53.262283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e97cd452-68bf-4925-b402-2b734bb7aa65 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f5764ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:53.384979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:53.491412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:53.970348 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85ef6852-d185-4648-b1a0-f17d561a6508 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf" status: 204 len: 0 microversion: 2.1 time: 0.825582 Oct 04 20:57:53.972905 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1695/3342] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:53 2022] DELETE /compute/v2.1/servers/ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf => generated 0 bytes in 830 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:53.999156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:54.006055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:54.045247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:54.050477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:54.053958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:54.069561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:54.071371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:54.076137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:54.082215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:54.232558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:54.285394 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e97cd452-68bf-4925-b402-2b734bb7aa65 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/47ff8d69-f40e-4f6f-a7c3-c9c2986bcc9b" status: 202 len: 0 microversion: 2.1 time: 1.030817 Oct 04 20:57:54.288970 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1648/3343] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 4 20:57:53 2022] DELETE /compute/v2.1/os-security-group-rules/47ff8d69-f40e-4f6f-a7c3-c9c2986bcc9b => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:57:54.327342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66649f22-db99-408b-9f4f-ae931acd15ac tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1901549189", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 2.5}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66649f22-db99-408b-9f4f-ae931acd15ac tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Request method failure captured: Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 170 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5Kd-4yQgg_4p51TzJsKg8caiX8KHoY07jRQhlE6-uSi7zH_0I0KRDmKW2CS4g5PFHRnTsEKnlKUU6Zuc6aISVGRxZ0218Ih0QVshL8WQj5hQ-rJWj4vfW2lTo54yhXDSr9-VNL8bMyyT0sC69I9nD3hzk3lzJwFOhoBWtHn1Hc7_0 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ef912e11025641b3b0ea0d41fcd2735d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ef912e11025641b3b0ea0d41fcd2735d Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-507257711 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 57338d5e0ce1421a9a511ca334ee9e03 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-507257711-project Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1901549189", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 2.5}} Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1901549189', 'imageRef': '08650df2-2319-4b76-af09-4569093fd163', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:57:54.350371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66649f22-db99-408b-9f4f-ae931acd15ac tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66649f22-db99-408b-9f4f-ae931acd15ac tempest-MultipleCreateNegativeTestJSON-507257711 tempest-MultipleCreateNegativeTestJSON-507257711-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.061512 Oct 04 20:57:54.368135 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1649/3344] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:54.387498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:54.388619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:54.420584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:54.421562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:54.422975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:54.424383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:54.425282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:54.426071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:54.948007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a57f22e-6b1a-4161-a842-3b461415acb4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 204 len: 0 microversion: 2.1 time: 0.972381 Oct 04 20:57:54.955499 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1696/3345] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:53 2022] DELETE /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:54.972304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1990259831", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:55.135728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:55.601569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:55.625657 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c8ed198-a381-4de2-a7d5-be6f4c1d7ad4 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 1.250026 Oct 04 20:57:55.639238 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1650/3346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:54 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:55.659313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba4b98be-9456-4ead-900d-4bf24063fa25 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f6016430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-654659920", "description": "tempest-description-233326925"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:58.376455 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba4b98be-9456-4ead-900d-4bf24063fa25 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 2.728188 Oct 04 20:57:58.379503 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1651/3347] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:57:55 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:58.395240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1263845939", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d57370fb-68ad-4b0f-a781-e1bd39a394f4"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:58.648970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] validate_networks() for [('d57370fb-68ad-4b0f-a781-e1bd39a394f4', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:58.770818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:57:58.779372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:57:58.781804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:57:58.789018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:57:58.791277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:57:58.816956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:58.859190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:58.860847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:58.861690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:58.863633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:58.869082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:58.869082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:58.925340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:58.941817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:58.985932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:57:58.992963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:57:59.304884 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-996d6025-9685-43e3-8a23-2e4079cf1d85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.351358 Oct 04 20:57:59.310199 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1697/3348] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:57:59.333525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:59.333525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:59.377276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:59.382095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:59.413584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:59.421141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:59.423547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:59.428322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.095228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:00.132797 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a149358-2daf-4b3a-bb9e-3a079bbaa143 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 200 len: 1309 microversion: 2.1 time: 0.818269 Oct 04 20:58:00.145094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1698/3349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:59 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 1309 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:00.159176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ca1b3f-fcfe-48a5-97e8-0ed20b901e35", "name": "network-vif-plugged", "status": "completed", "tag": "874c6c33-7175-4255-80af-1bb00d4733fc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:00.208345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.208345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.208345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.257919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] Creating event network-vif-plugged:874c6c33-7175-4255-80af-1bb00d4733fc for instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 on n-h2-851029-13 Oct 04 20:58:00.269750 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cedd12dc-d4b3-41d3-9136-655628cada54 req-e419b6c3-7e12-4c0d-bfc0-b650f5d32330 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121895 Oct 04 20:58:00.271790 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1699/3350] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:00.284447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:00.286922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:00.299815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.301042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.302291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.305589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.306989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.308083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.421848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:01.444192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0532b1d8-ca68-4fd6-ad52-9c31329e8974 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 1.169143 Oct 04 20:58:01.445762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1700/3351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:00 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:01.477065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df823d5-438f-43c9-a3b1-880ba6e6d495", "name": "network-vif-deleted", "tag": "9e57d7f3-cd88-440e-be21-da401c8e76fd"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:01.542985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.547065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.549166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.589220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] Creating event network-vif-deleted:9e57d7f3-cd88-440e-be21-da401c8e76fd for instance 4df823d5-438f-43c9-a3b1-880ba6e6d495 on n-h1-851029-13 Oct 04 20:58:01.607032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4b2bb658-f8ab-4aea-9f7c-5e1cb83679fb req-f3a8efc3-33a5-40a1-a6fe-bfee07b69f0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146804 Oct 04 20:58:01.616436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1701/3352] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:01.632628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e333ec14-bf90-4309-9a45-6e4a34dfcfbd tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f63ae4c0>, body: {"security_group_rule": {"parent_group_id": "b761e95b-bee7-4b67-b4e9-ef61e196a1e0", "ip_protocol": "tcp", "from_port": 1741843390, "to_port": 22}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:01.843103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e333ec14-bf90-4309-9a45-6e4a34dfcfbd tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Invalid port range 1741843390:22. Former value cannot be greater than the later Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e333ec14-bf90-4309-9a45-6e4a34dfcfbd tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 146 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: {"security_group_rule": {"parent_group_id": "b761e95b-bee7-4b67-b4e9-ef61e196a1e0", "ip_protocol": "tcp", "from_port": 1741843390, "to_port": 22}} Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid port range 1741843390:22. Former value cannot be greater than the later Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b761e95b-bee7-4b67-b4e9-ef61e196a1e0', 'ip_protocol': 'tcp', 'from_port': 1741843390, 'to_port': 22}}} Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1741843390:22. Former value cannot be greater than the later Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1741843390:22. Former value cannot be greater than the later Oct 04 20:58:01.848332 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1741843390:22. Former value cannot be greater than the later Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e333ec14-bf90-4309-9a45-6e4a34dfcfbd tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: Invalid port range 1741843390:22. Former value cannot be greater than the later {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:01.863070 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e333ec14-bf90-4309-9a45-6e4a34dfcfbd tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.247039 Oct 04 20:58:01.880788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1702/3353] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:01 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:01.902257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ca1b3f-fcfe-48a5-97e8-0ed20b901e35", "name": "network-vif-deleted", "tag": "874c6c33-7175-4255-80af-1bb00d4733fc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:01.929853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.931374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.932621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.973857 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] Creating event network-vif-deleted:874c6c33-7175-4255-80af-1bb00d4733fc for instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 on n-h2-851029-13 Oct 04 20:58:01.995910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:01.998189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:02.000362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:02.001322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-71bdea47-6ce9-4d95-9987-2fd0fa7b5c13 req-520ac65a-74f8-4201-9048-082efa22da60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115530 Oct 04 20:58:02.001973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:02.004491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:02.005430 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1703/3354] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:02.038587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.040230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.041358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.043235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.049053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.050324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.060054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:02.063287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:02.091221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.092729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.097840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.101636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.102762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.104012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.146890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Getting quotas for project 7506970542da4c119f49cafe6fbb71ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:02.174086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Getting quotas for user 6b9d8cbffeb24a7b85f556f17607a9ec and project 7506970542da4c119f49cafe6fbb71ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:02.229736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Going to run 2 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:02.238008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:02.390038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:02.432227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dba79c8-b633-433e-9692-a4a97fa29dff tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 200 len: 1219 microversion: 2.1 time: 0.406950 Oct 04 20:58:02.433399 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1704/3355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:02 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 1219 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:02.441334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=4358121b-38c0-401b-9aee-ae967c84f4cb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:02.454582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:02.461796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:02.501686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.502909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.504682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.506340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.509018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.511103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.597427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 HTTP/1.1 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35'} Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.605593 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 20:58:02.616546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.621671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:02.623871 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c3bc310-e5d2-487a-84dc-6a91327dec50 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 404 len: 111 microversion: 2.1 time: 0.183110 Oct 04 20:58:02.626485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1705/3356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:02 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:02.643707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-987958b7-8c45-4092-a3cf-50879aed96d1 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f5f4c040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1136338099", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:02.649701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-987958b7-8c45-4092-a3cf-50879aed96d1 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Security group id should be uuid Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-987958b7-8c45-4092-a3cf-50879aed96d1 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 131 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1136338099", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group id should be uuid Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1136338099', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:02.657952 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:02.671087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 20:58:02.671087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:02.674890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-987958b7-8c45-4092-a3cf-50879aed96d1 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: Security group id should be uuid {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:02.677290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-987958b7-8c45-4092-a3cf-50879aed96d1 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.046889 Oct 04 20:58:02.687116 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1706/3357] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:02 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:02.697689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:02.699698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:02.722247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.722831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.723663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.725118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.726025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.726875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.793458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:02.820202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.821407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.822274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.916513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db793085-8d50-49bf-bfd9-ad7b6b51ed58 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.534305 Oct 04 20:58:02.918881 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1652/3358] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 4538 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:58:02.946228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:02.949348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:02.981115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.982744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.987277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.989163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:02.992970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:02.994294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:03.055378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'flavor' on Instance uuid fa5aee88-270a-4369-b096-eb460d04e8b6 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:58:03.115625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'system_metadata' on Instance uuid fa5aee88-270a-4369-b096-eb460d04e8b6 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:58:03.279523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'metadata' on Instance uuid fa5aee88-270a-4369-b096-eb460d04e8b6 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:58:03.458106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:03.464875 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c74cced7-25cd-4650-bdfe-627e7f882769 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 0.532810 Oct 04 20:58:03.467520 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1653/3359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:02 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:03.478026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'create', calling method: .version_select at 0x7f54f5e9f5e0>, body: {"keypair": {"name": "tempest-keypair-1148804032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE62x/gaaCYZZd50e1N7920AXQdC7RRA4I68auJgphTjwGOZeEnCi4i4AMO38QXGHz4f1mlnNRkDBbZVw+UKEDL5v2cYDwsFEf3RWg7yJ7EtgQtgr5AZc4JfH9v0nSdeGQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:03.511620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:03.524943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for user 4ac6607c7faa4e8d9745bbf05780e9d6 and project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:03.558124 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:58:03.597288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:03.599322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:03.600593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:04.166640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96ab7cda-40b6-487a-bc92-bbd657d1f0f5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 204 len: 0 microversion: 2.1 time: 1.482541 Oct 04 20:58:04.174691 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1707/3360] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:02 2022] DELETE /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 0 bytes in 1487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:04.190186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80aad4fc-af2c-462f-84e9-73d8e7e72671 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f5fc2040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1036568523", "description": "tempest-description-1306792526"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:04.573034 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54546. Oct 04 20:58:04.688609 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79df0aca-7b57-474b-9494-2ddcb2dba2d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.218027 Oct 04 20:58:04.703009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1654/3361] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:58:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:04.714816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:04.727433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:04.729226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Searching by: {'deleted': False, 'project_id': '7506970542da4c119f49cafe6fbb71ee'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:58:04.764408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:04.765934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:04.767598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:04.769547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:04.771071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:04.772786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:04.832452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:58:04.910294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a7168c2-661e-421d-8a44-917dfc1b18db tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.203846 Oct 04 20:58:04.911531 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1655/3362] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 20:58:04 2022] GET /compute/v2.1/servers => generated 673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:04.929953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf", "name": "network-vif-deleted", "tag": "4770290b-d1cf-404e-ad47-646da7455a33"}, {"name": "network-changed", "server_uuid": "a164964b-4d56-4c9f-b747-a3466f41d39e", "tag": "34d4bb86-3e2f-4c25-bb8f-d86e64037405"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:04.953325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:04.955402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:04.956345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.047392 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Creating event network-vif-deleted:4770290b-d1cf-404e-ad47-646da7455a33 for instance ccc11ff8-e2dc-4ac8-82c1-b5163a5e20bf on n-h2-851029-13 Oct 04 20:58:05.049243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] Creating event network-changed:34d4bb86-3e2f-4c25-bb8f-d86e64037405 for instance a164964b-4d56-4c9f-b747-a3466f41d39e on n-h1-851029-13 Oct 04 20:58:05.077377 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-cc39add7-3a5b-4b38-86a8-c4c80ff5b062 req-ef36a11d-aa8f-4d45-8d5a-f30d901e9e7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.157294 Oct 04 20:58:05.080656 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1656/3363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:05.093368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:05.095752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:05.108290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.110212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.112669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.115123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.116471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.117539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.347927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:05.383048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-123dfbc0-7d27-4754-9f4a-a6c70a3f33cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 200 len: 1273 microversion: 2.1 time: 0.298985 Oct 04 20:58:05.386622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1657/3364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:05 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:05.418189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:05.420130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:05.436070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.438028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.439273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.443370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.444376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.445236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.992359 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80aad4fc-af2c-462f-84e9-73d8e7e72671 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.815681 Oct 04 20:58:05.994148 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1708/3365] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:58:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:06.041764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5695b854-a899-4941-a386-1365298f2e8a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:06.045148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5695b854-a899-4941-a386-1365298f2e8a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:06.341288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5695b854-a899-4941-a386-1365298f2e8a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:06.367095 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5695b854-a899-4941-a386-1365298f2e8a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1218 microversion: 2.1 time: 0.370737 Oct 04 20:58:06.378728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1709/3366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:05 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1218 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:06.398429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa3f91f4-f8fa-46c2-b1e1-e2aeadc9e876 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f6031ca0>, body: {"security_group_rule": {"parent_group_id": "50f02074-3ce3-4d7e-a0e4-89e190ecde04", "ip_protocol": "tempest-999-86146912", "from_port": 22, "to_port": 22}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:06.696145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:06.717891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-807744cc-e5b9-4413-8459-b768c4eb76fe tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 1.328304 Oct 04 20:58:06.721077 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1658/3367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:05 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:06.770545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:06.772352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:06.821120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:06.824197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:06.827158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:06.833450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:06.838200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:06.842128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:06.867170 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fa3f91f4-f8fa-46c2-b1e1-e2aeadc9e876 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Invalid IP protocol tempest-999-86146912. Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa3f91f4-f8fa-46c2-b1e1-e2aeadc9e876 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 155 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: {"security_group_rule": {"parent_group_id": "50f02074-3ce3-4d7e-a0e4-89e190ecde04", "ip_protocol": "tempest-999-86146912", "from_port": 22, "to_port": 22}} Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid IP protocol tempest-999-86146912. Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'security_group_rule': {'parent_group_id': '50f02074-3ce3-4d7e-a0e4-89e190ecde04', 'ip_protocol': 'tempest-999-86146912', 'from_port': 22, 'to_port': 22}}} Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-86146912. Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-86146912. Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:06.871000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-86146912. Oct 04 20:58:06.881381 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:06.887097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa3f91f4-f8fa-46c2-b1e1-e2aeadc9e876 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: Invalid IP protocol tempest-999-86146912. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:06.887097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa3f91f4-f8fa-46c2-b1e1-e2aeadc9e876 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.513764 Oct 04 20:58:06.893350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1710/3368] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:06 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:06.917945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f12eba1-087d-4ad3-8fbc-4d6802ec815c tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f601f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-42733944", "description": "tempest-description-1903739644"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:07.286954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:07.315911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76aae349-cf07-4cbc-8524-a5cb6063d6b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 200 len: 1217 microversion: 2.1 time: 0.591768 Oct 04 20:58:07.321342 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1659/3369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:06 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 1217 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:07.412880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:07.414188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:07.427744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.428688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.429827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.431636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.432847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.433605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.958108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:07.975821 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3df40643-1b96-442c-9d8d-931eb98225e5 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1222 microversion: 2.1 time: 0.572253 Oct 04 20:58:07.977573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1660/3370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:07 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1222 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:07.990282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:07.992106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:08.019945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:08.022012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:08.023498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:08.025430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:08.026429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:08.027334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:08.901650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:10.269593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:10.286520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b488cc14-45cf-47c9-9fd1-890be4d73fac tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 2.306341 Oct 04 20:58:10.292895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1661/3371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:07 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:10.309758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:10.311706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:10.339922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.341267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.342715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.345062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.346492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.347827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.404536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:10.458015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f12eba1-087d-4ad3-8fbc-4d6802ec815c tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 3.558194 Oct 04 20:58:10.499041 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1711/3372] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:58:06 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 3566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:10.513386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:10.515801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:10.536033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.537048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.538274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.539926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.540774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.541542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.710184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:10.726702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-365958bd-e2a5-48f5-b885-f350231d3ead tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 200 len: 1217 microversion: 2.1 time: 0.436725 Oct 04 20:58:10.729544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1662/3373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:10 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 1217 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:10.743971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a164964b-4d56-4c9f-b747-a3466f41d39e", "name": "network-vif-plugged", "status": "completed", "tag": "34d4bb86-3e2f-4c25-bb8f-d86e64037405"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:10.767409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.770493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.771657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.806620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] Creating event network-vif-plugged:34d4bb86-3e2f-4c25-bb8f-d86e64037405 for instance a164964b-4d56-4c9f-b747-a3466f41d39e on n-h1-851029-13 Oct 04 20:58:10.817228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-674b0f25-5413-4451-b75c-006acbb0ba6e req-dd5f2647-941e-4b3c-be33-a9c2219794ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083576 Oct 04 20:58:10.819223 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1663/3374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:10.834923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa2d7aa5-57f0-47b7-be2b-09a4b2bac441 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54fa5a0700>, body: {"security_group_rule": {"parent_group_id": "209e205f-8fd9-4bed-8d0d-7603c9708023", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:10.927643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:10.948165 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9a9272b-9b7b-45cd-8a49-d9a261db2fec tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1276 microversion: 2.1 time: 0.446050 Oct 04 20:58:10.954137 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1712/3375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:10 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1276 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:11.238278 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fa2d7aa5-57f0-47b7-be2b-09a4b2bac441 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa2d7aa5-57f0-47b7-be2b-09a4b2bac441 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 138 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: {"security_group_rule": {"parent_group_id": "209e205f-8fd9-4bed-8d0d-7603c9708023", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '209e205f-8fd9-4bed-8d0d-7603c9708023', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:58:11.241460 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa2d7aa5-57f0-47b7-be2b-09a4b2bac441 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa2d7aa5-57f0-47b7-be2b-09a4b2bac441 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.420894 Oct 04 20:58:11.266869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1664/3376] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 427 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:11.276792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0211f16f-6456-4b21-a51c-9e5b01100891 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f63ae040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-959584656", "description": "tempest-description-808627599"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.331148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:11.332989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:11.377761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:11.380436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:11.383006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:11.386952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:11.388452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:11.389910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:12.172774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:12.205220 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-24459a1c-9fa8-4b84-9079-998d1e4dfe68 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1327 microversion: 2.1 time: 0.881415 Oct 04 20:58:12.206773 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1665/3377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:11 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1327 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:12.228610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:12.230368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:12.255745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:12.256848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:12.257668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:12.262406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:12.263574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:12.264423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:12.565200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:12.610768 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-938e9c08-dce7-43c0-96d8-529139109341 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 200 len: 1219 microversion: 2.1 time: 0.401405 Oct 04 20:58:12.613181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1666/3378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:12 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:12.639617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:12.644484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:12.679062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:12.682892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:12.687027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:12.691045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:12.693740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:12.697448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:13.164235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0211f16f-6456-4b21-a51c-9e5b01100891 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.908729 Oct 04 20:58:13.167427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1713/3379] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:13.210625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-356969930", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:13.391258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] validate_networks() for [('528153a9-4bc3-4dc2-9ae6-3df23391f5d6', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:58:13.540976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:14.698269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:14.732871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-377ff28d-e6ca-41a9-996f-26b3f0d95f62 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 2.113970 Oct 04 20:58:14.736009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1667/3380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:12 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:14.750457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ac8c7f3-3fb9-4522-8188-f47ee12b0905 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f6016160>, body: {"security_group_rule": {"parent_group_id": "0934fc52-78fa-4df7-b2b6-4da7be34480d", "ip_protocol": "tcp", "from_port": 22, "to_port": 976450466}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:14.801981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:14.998257 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1ac8c7f3-3fb9-4522-8188-f47ee12b0905 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ac8c7f3-3fb9-4522-8188-f47ee12b0905 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 145 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: {"security_group_rule": {"parent_group_id": "0934fc52-78fa-4df7-b2b6-4da7be34480d", "ip_protocol": "tcp", "from_port": 22, "to_port": 976450466}} Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0934fc52-78fa-4df7-b2b6-4da7be34480d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 976450466}}} Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 Oct 04 20:58:15.004101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 Oct 04 20:58:15.016463 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.018759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ac8c7f3-3fb9-4522-8188-f47ee12b0905 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 400 to user: Invalid port range 22:976450466. Valid TCP ports should be between 1-65535 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:15.021440 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ac8c7f3-3fb9-4522-8188-f47ee12b0905 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.282660 Oct 04 20:58:15.025193 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1668/3381] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:14 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:15.040468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:15.041983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:15.060687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.061489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.063242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:15.065481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.067029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.071211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:15.880880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:15.915976 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25d52e54-ed30-45d4-b58d-848e34de9fa3 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1527 microversion: 2.1 time: 0.888614 Oct 04 20:58:15.918262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1669/3382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:15 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1527 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:15.934037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:15.948285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:16.007706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.033084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.033943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.035676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.051018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.059786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.128117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 HTTP/1.1 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fa5aee88-270a-4369-b096-eb460d04e8b6'} Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:16.136496 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aabd8ec1-1395-42b6-9f1f-4fbc09c02b3c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 404 len: 111 microversion: 2.1 time: 0.219226 Oct 04 20:58:16.152670 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1670/3383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:15 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:16.167773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Action: 'create', calling method: .version_select at 0x7f54f5e1fd30>, body: {"security_group_rule": {"parent_group_id": "081b4c6b-40ab-4119-bb27-b07f6efb9ae0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:16.355165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:16.394189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:16.400906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:16.400906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:16.402234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:16.402234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:16.440588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.447006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.448050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.449430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.454345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.455294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.504141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:58:16.505319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Neutron security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:58:16.506355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.506355 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 138 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: {"security_group_rule": {"parent_group_id": "081b4c6b-40ab-4119-bb27-b07f6efb9ae0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'security_group_rule': {'parent_group_id': '081b4c6b-40ab-4119-bb27-b07f6efb9ae0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:58:16.513350 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 404 to user: Security group 081b4c6b-40ab-4119-bb27-b07f6efb9ae0 does not exist Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-7dafed0c-c708-44c0-a5d0-fe10ca2c4d37'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:16.528773 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2a482df-cb4b-4f24-9686-26417ac87c44 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.368970 Oct 04 20:58:16.541879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1671/3384] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 4 20:58:16 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:16.546115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:16.559005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for user 4ac6607c7faa4e8d9745bbf05780e9d6 and project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:16.560970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:16.563369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:16.595500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.596577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.604523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.608320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:16.609298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:16.610141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.647289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:16.654362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:17.008310 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76f23e76-af36-479c-89d6-a4cbd1505be5 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.837605 Oct 04 20:58:17.009442 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1714/3385] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:58:17.024191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:17.025411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:17.070217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.075890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.083286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.083556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.084522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.085198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.760183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:17.792631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee642d80-4d31-4720-988e-ae197e23226a tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 1.259556 Oct 04 20:58:17.796190 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1672/3386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:16 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:17.830497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-255504173", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:17.964685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:58:18.108435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:18.121610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:18.136852 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6e8642bd-9469-4a52-b6eb-6794660ebe46 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1527 microversion: 2.1 time: 1.125297 Oct 04 20:58:18.143763 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1715/3387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:17 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1527 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:18.161327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f639ee50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:18.318569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:58:18.320533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Neutron security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b not found {{(pid=123541) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 20:58:18.321652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] HTTP exception thrown: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.321652 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Request method failure captured: Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-security-group-rules/4f1d733a-6f94-45e4-b6d6-b91b506ab46b HTTP/1.1 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ5JM4cM6ECA5p_dYi19BDxtYL5nxo2PKV1mqTIvv95pDKhj4Jb-VQ2z5gJOXhWIk8OCoPiqIvvmowAaYJa_5629jZswSL7_DYuby6_IjtNquH4dpVM3URorSg8EKepvSYx0whRYQfgOKZrRBKSvftgE41fgb1ZjWNcUOFuj4uV6cZo Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ea0688a9c10142e4909fa6ef30a9b0dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ea0688a9c10142e4909fa6ef30a9b0dd Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b5512b36393a44469e76fa68c047af0c Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4f1d733a-6f94-45e4-b6d6-b91b506ab46b'} Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:58:18.327048 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Returning 404 to user: Security group rule 4f1d733a-6f94-45e4-b6d6-b91b506ab46b does not exist Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-7c416804-8a07-4572-a62f-cf3122afac94'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94e05f0d-1ff2-46e2-b8e7-2354543e29ba tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/4f1d733a-6f94-45e4-b6d6-b91b506ab46b" status: 404 len: 199 microversion: 2.1 time: 0.185973 Oct 04 20:58:18.336440 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1716/3388] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 4 20:58:18 2022] DELETE /compute/v2.1/os-security-group-rules/4f1d733a-6f94-45e4-b6d6-b91b506ab46b => generated 199 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:18.376005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d2e831e-d535-4102-bbc7-1930dd0575a0 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:18.377831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d2e831e-d535-4102-bbc7-1930dd0575a0 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:18.627748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d2e831e-d535-4102-bbc7-1930dd0575a0 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:18.650407 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d2e831e-d535-4102-bbc7-1930dd0575a0 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1224 microversion: 2.1 time: 0.295759 Oct 04 20:58:18.652955 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1717/3389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:18 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1224 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:19.131963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:19.134055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:19.150540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:19.152262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:19.153188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:19.155038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:19.157481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:19.158795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:19.202062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] HTTP exception thrown: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Request method failure captured: Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e HTTP/1.1 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ48q6QAuCgAcEHA4wQh8zSKEwSE9ljV2GP4L6HYFR4r2ZDNHJkKUO1Yh1BBDdTp5NrTyKd_XZEEC8ZRjzaJIppxIQkugB1yxijonyZnhz-XxHPAeoMyvBkYtj2_Sf_I41ZiS-AkwLKem9RTWEpaaE5sMzFOyI9hEieP8QRWs1tvWTU Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 41608fd5f2604e82963e8ea651a553ec Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 41608fd5f2604e82963e8ea651a553ec Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestMultiTenantJSON-33845477-project Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc88626726c34dd287daf2ed67e2681e Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477-project Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a164964b-4d56-4c9f-b747-a3466f41d39e'} Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:19.205988 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Returning 404 to user: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eeee92b1-59a4-47a8-862d-4c62239a6325 tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 404 len: 111 microversion: 2.1 time: 0.555739 Oct 04 20:58:19.225386 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1718/3390] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:18 2022] DELETE /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 111 bytes in 567 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:19.228070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a7dc216-c475-4f7e-ba88-a53adc68aeaf tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f5df8790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.167556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:20.168453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:20.169580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:20.170556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:20.172692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:20.185449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:20.203239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.204556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.205799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:20.208309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.210643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.212170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:20.270171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:20.295470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:20.336351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:20.342861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:20.570620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5548bd5a-8130-4247-b058-9e247f073189 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.772005 Oct 04 20:58:20.576135 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1673/3391] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:58:20.604742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.604742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:20.613921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.614901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.615723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:20.617382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.618191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.618655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.717200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a7dc216-c475-4f7e-ba88-a53adc68aeaf tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0934fc52-78fa-4df7-b2b6-4da7be34480d" status: 202 len: 0 microversion: 2.1 time: 2.493211 Oct 04 20:58:21.725163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1719/3392] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:58:19 2022] DELETE /compute/v2.1/os-security-groups/0934fc52-78fa-4df7-b2b6-4da7be34480d => generated 0 bytes in 2499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:58:21.740488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:21.742449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:21.803904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:21.806479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:21.809669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.816494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:21.817569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:21.822756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.838924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:21.893066 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fedbc105-8d22-44e2-96dd-d531ef4eacaf tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 1.298180 Oct 04 20:58:21.904199 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1674/3393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:21.933767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646c11fd-3090-4d34-8de4-a267e46a99d0", "tag": "028db6f2-206c-4922-a87f-246f1ca0dd49"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:21.985863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:21.993958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.001337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.050771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] Creating event network-changed:028db6f2-206c-4922-a87f-246f1ca0dd49 for instance 646c11fd-3090-4d34-8de4-a267e46a99d0 on n-h1-851029-13 Oct 04 20:58:22.070755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-cba3ddd6-c8a6-4227-b9a7-e39831732745 req-5d58f2e0-2a6f-4e4b-bdbd-a7282eab2ae5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163620 Oct 04 20:58:22.081774 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1675/3394] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:22.096432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:22.104699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:22.126238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.133495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.134828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.136531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.139599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.142303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.408473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.433216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e0fb8d1-ff44-4ce1-a9ab-3cef16c82f76 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1294 microversion: 2.1 time: 0.355337 Oct 04 20:58:22.437089 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1676/3395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:22 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1294 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:22.449849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f6246e5-3eb6-4d12-ae05-8344c3da5610 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:22.453873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f6246e5-3eb6-4d12-ae05-8344c3da5610 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:22.648473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8f6246e5-3eb6-4d12-ae05-8344c3da5610 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.667738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f6246e5-3eb6-4d12-ae05-8344c3da5610 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1214 microversion: 2.1 time: 0.227838 Oct 04 20:58:22.683704 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1677/3396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:22 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:22.711749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55770ad5-2480-41ae-b9e8-c503d10d7ed3 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f60014c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:23.019305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.037997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa7f432d-bcda-4ec3-ba57-989a2b459951 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1527 microversion: 2.1 time: 1.308272 Oct 04 20:58:23.037997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1720/3397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:21 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1527 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:23.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4358121b-38c0-401b-9aee-ae967c84f4cb", "tag": "c980f883-1bca-4260-a9a8-05391d619883"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:23.106078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.107121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.107944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.137062 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] Creating event network-changed:c980f883-1bca-4260-a9a8-05391d619883 for instance 4358121b-38c0-401b-9aee-ae967c84f4cb on n-h2-851029-13 Oct 04 20:58:23.147656 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b3f18a7d-89ab-4c01-aa56-aebacd880e72 req-4aaed927-b7e4-44ff-9ccd-6b47b46db8d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092959 Oct 04 20:58:23.149123 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1721/3398] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:23.167152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:23.169631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:23.182900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.183859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.184687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.185990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.187473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.188273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.130386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:24.152541 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a487b8dc-4354-467b-b15a-354b55537413 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 0.994326 Oct 04 20:58:24.172295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1722/3399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:23 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:24.197617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Action: 'update', calling method: >, body: {"server": {"name": "a164964b-4d56-4c9f-b747-a3466f41d39e_new"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:24.205486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.225604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.226765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.227940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.229638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.231106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.232772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.274422 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] HTTP exception thrown: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Request method failure captured: Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e HTTP/1.1 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 64 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ48q6QAuCgAcEHA4wQh8zSKEwSE9ljV2GP4L6HYFR4r2ZDNHJkKUO1Yh1BBDdTp5NrTyKd_XZEEC8ZRjzaJIppxIQkugB1yxijonyZnhz-XxHPAeoMyvBkYtj2_Sf_I41ZiS-AkwLKem9RTWEpaaE5sMzFOyI9hEieP8QRWs1tvWTU Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 41608fd5f2604e82963e8ea651a553ec Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_41608fd5f2604e82963e8ea651a553ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 41608fd5f2604e82963e8ea651a553ec Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477 Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestMultiTenantJSON-33845477-project Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc88626726c34dd287daf2ed67e2681e Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-33845477-project Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: {"server": {"name": "a164964b-4d56-4c9f-b747-a3466f41d39e_new"}} Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a164964b-4d56-4c9f-b747-a3466f41d39e', 'body': {'server': {'name': 'a164964b-4d56-4c9f-b747-a3466f41d39e_new'}}} Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:58:24.288590 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] Returning 404 to user: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:24.297977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-adb9a1e3-9f91-4cfb-8334-4f296972839a tempest-ServersNegativeTestMultiTenantJSON-33845477 tempest-ServersNegativeTestMultiTenantJSON-33845477-project] 10.222.0.36 "PUT /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 404 len: 111 microversion: 2.1 time: 0.121407 Oct 04 20:58:24.313248 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1723/3400] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 20:58:24 2022] PUT /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:24.322456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:24.324828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.340164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.341192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.342276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.344453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.345693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.346586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.738686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:24.779474 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4fcde70-bccd-4614-85a6-f298edbcdaa6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1282 microversion: 2.1 time: 0.475285 Oct 04 20:58:24.787144 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1724/3401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:24 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1282 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:24.797075 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55770ad5-2480-41ae-b9e8-c503d10d7ed3 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/209e205f-8fd9-4bed-8d0d-7603c9708023" status: 202 len: 0 microversion: 2.1 time: 2.110719 Oct 04 20:58:24.808394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1678/3402] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:58:22 2022] DELETE /compute/v2.1/os-security-groups/209e205f-8fd9-4bed-8d0d-7603c9708023 => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:58:24.814797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:24.823624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.846564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:24.848119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.848447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.849326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.850116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.851784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.852609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.853378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.863804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.865244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.875777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.877743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.879032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.880152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.952042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:25.164238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:25.189795 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8cf06ad7-48e6-495d-bf99-3b7b06c4502e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1210 microversion: 2.1 time: 0.404343 Oct 04 20:58:25.193475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1725/3403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:24 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1210 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:25.210348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c000a6b6-cdac-483b-a4b4-45aca1055894 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f5e15af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:25.532487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b7a3c4aa-68b1-4969-a0a9-a1ce5eb999f2 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 204 len: 0 microversion: 2.1 time: 0.718125 Oct 04 20:58:25.533680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1679/3404] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:24 2022] DELETE /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:25.556260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:25.557736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:25.586105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:25.587881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:25.589518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:25.591526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:25.594758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:25.605006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.267349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:26.299235 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31598134-84ac-4d05-a51b-4e55946beb4e tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 0.762732 Oct 04 20:58:26.305455 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1680/3405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:25 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:26.323263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:26.339953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:26.365398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.367199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.371799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.373643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.376197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.385636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.501890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:27.361516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c000a6b6-cdac-483b-a4b4-45aca1055894 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/50f02074-3ce3-4d7e-a0e4-89e190ecde04" status: 202 len: 0 microversion: 2.1 time: 2.155103 Oct 04 20:58:27.367506 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1726/3406] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:58:25 2022] DELETE /compute/v2.1/os-security-groups/50f02074-3ce3-4d7e-a0e4-89e190ecde04 => generated 0 bytes in 2169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:58:27.395491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:27.395491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:27.515474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.523760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.539599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.564342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.566989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.589002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:28.635664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.093802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.122412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7426a93-1753-4bbd-82a4-db064bca5088 tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1533 microversion: 2.1 time: 2.814699 Oct 04 20:58:29.125255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1681/3407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:26 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1533 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:29.141640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:29.143956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:29.159450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.161786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.165991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.169033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.170520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.172740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.464994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.482179 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4df9916c-dc97-4c38-a9a1-87f6cf234515 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 2.114127 Oct 04 20:58:29.484799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1727/3408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:27 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:29.496647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:29.498456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:29.515424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.515424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.515424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.517695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.518587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.519465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.527234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.546627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e2e638e-f2a8-4c74-886c-629da23b8773 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1272 microversion: 2.1 time: 0.415339 Oct 04 20:58:29.548784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1682/3409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:29 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1272 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:29.578801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40518dbd-6b95-46e6-97be-f8a493c96af0 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f55d3550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.244720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:30.942931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.963648 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c98ab9a6-a8f0-46d7-bce3-b085e52e0044 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 1.476021 Oct 04 20:58:30.970644 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1728/3410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:29 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:30.979192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646c11fd-3090-4d34-8de4-a267e46a99d0", "name": "network-vif-plugged", "status": "completed", "tag": "028db6f2-206c-4922-a87f-246f1ca0dd49"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:31.004336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:31.008428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.015659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.015659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.039169 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] Creating event network-vif-plugged:028db6f2-206c-4922-a87f-246f1ca0dd49 for instance 646c11fd-3090-4d34-8de4-a267e46a99d0 on n-h1-851029-13 Oct 04 20:58:31.050110 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-aba56465-8306-4614-804f-143dc42eb65f req-b861b0a2-16c2-4068-b6df-f6865fc5ec2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082361 Oct 04 20:58:31.080167 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1729/3411] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:31.111623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:31.120138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:31.157749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.164046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.166218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.167703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.168747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.171664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.006732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f937c1821d204ef2b29ba720fbeb62ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b323a1c025c470fb77b10d593176b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:32.028721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40518dbd-6b95-46e6-97be-f8a493c96af0 tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b761e95b-bee7-4b67-b4e9-ef61e196a1e0" status: 202 len: 0 microversion: 2.1 time: 2.476315 Oct 04 20:58:32.034237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1683/3412] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:58:29 2022] DELETE /compute/v2.1/os-security-groups/b761e95b-bee7-4b67-b4e9-ef61e196a1e0 => generated 0 bytes in 2485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:58:32.054128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:32.055693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:32.072387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.076177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.078299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.078539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d7e6857-b5cd-4dbe-8a8e-2b5dacaa1a3b tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 200 len: 1533 microversion: 2.1 time: 0.993712 Oct 04 20:58:32.079649 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1730/3413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:31 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 1533 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:32.080974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.082001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.086350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.109740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:32.111263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:32.134162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.142516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.143584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.145502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.146241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.154501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.551308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:32.576419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54ac80e1-15b1-4430-92b0-baa4f85b7aac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1272 microversion: 2.1 time: 0.487241 Oct 04 20:58:32.579539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1731/3414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:32 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1272 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:32.601181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:32.604821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:32.624648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.640994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.648168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.650450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.651905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.658099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.659588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:33.419553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:33.479094 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b6cbddf-dc3d-4038-8b9e-b43851f81be2 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 1.440104 Oct 04 20:58:33.487565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1684/3415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:32 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:33.523564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd771ee3-9e87-4b02-b7dc-7f46081b0f9f tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] Calling method '.version_select at 0x7f54f6016430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:34.303671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:34.346168 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21fb448a-7b22-4804-b557-3a89736de58c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1318 microversion: 2.1 time: 1.761193 Oct 04 20:58:34.353230 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1732/3416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:32 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1318 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:34.379157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a164964b-4d56-4c9f-b747-a3466f41d39e", "name": "network-vif-deleted", "tag": "34d4bb86-3e2f-4c25-bb8f-d86e64037405"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:34.427290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:34.431250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:34.433943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:34.465450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] Creating event network-vif-deleted:34d4bb86-3e2f-4c25-bb8f-d86e64037405 for instance a164964b-4d56-4c9f-b747-a3466f41d39e on n-h1-851029-13 Oct 04 20:58:34.475621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1b7d143c-6585-49c4-b092-651aaebb4970 req-a8505838-8af9-4f3f-8595-20b6f0483d6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119159 Oct 04 20:58:34.485771 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1733/3417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:34.646621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-190371bb-a12e-49b9-882b-181da0a95368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: .version_select at 0x7f54f5e15040>, body: {"keypair": {"name": "tempest-keypair-2061477077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRTE0DWoAtpnHWAL4DwHgWyhaCiqvcKpwH53jSBHxjSRRFjzlmFG3mXE26qvqX5ZALs+ZU72AQdwdg94CmYFxVcWcf0IBvSt/ZoXjzZDOKHlwr5Kcf1gh0NH589Nu5D2Q=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:34.676080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-190371bb-a12e-49b9-882b-181da0a95368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:34.705001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-190371bb-a12e-49b9-882b-181da0a95368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:34.858049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-190371bb-a12e-49b9-882b-181da0a95368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.373637 Oct 04 20:58:34.869263 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1734/3418] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 20:58:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:34.893913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4358121b-38c0-401b-9aee-ae967c84f4cb", "name": "network-vif-plugged", "status": "completed", "tag": "c980f883-1bca-4260-a9a8-05391d619883"}, {"server_uuid": "a164964b-4d56-4c9f-b747-a3466f41d39e", "name": "network-vif-unplugged", "status": "completed", "tag": "34d4bb86-3e2f-4c25-bb8f-d86e64037405"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:34.945640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:34.946564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:34.947444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.042560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Creating event network-vif-plugged:c980f883-1bca-4260-a9a8-05391d619883 for instance 4358121b-38c0-401b-9aee-ae967c84f4cb on n-h2-851029-13 Oct 04 20:58:35.044993 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] Creating event network-vif-unplugged:34d4bb86-3e2f-4c25-bb8f-d86e64037405 for instance a164964b-4d56-4c9f-b747-a3466f41d39e on n-h1-851029-13 Oct 04 20:58:35.079911 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1e83f061-bb8a-4a4e-aba1-aaedba34ab09 req-3a011c89-edee-46f9-b8fd-cb08cedf0b12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.203179 Oct 04 20:58:35.083112 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1735/3419] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:35.098484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:35.100279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] [instance: a164964b-4d56-4c9f-b747-a3466f41d39e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:35.147844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.150957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.156268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.161379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.165373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.166552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.240505 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] HTTP exception thrown: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Request method failure captured: Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e HTTP/1.1 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4ntCWr-QJ7Ste8XqfZT-8jD_3KhWIkM4bQtl__si8ZIMQ-vkIzsaTlBSFJClUoKhkDYoR_4QkwjLnGzbNNTqDfpXKHhtSMhYKCGxyyoz2zBlDzMi7wj04Q_1ExXHGpMKTGHTNyu5n_pWTcP2T29HWbseih86d3jDzxMzRRKaE7WrA Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8b323a1c025c470fb77b10d593176b79 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-867526992 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b323a1c025c470fb77b10d593176b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b323a1c025c470fb77b10d593176b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b323a1c025c470fb77b10d593176b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b323a1c025c470fb77b10d593176b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-867526992 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8b323a1c025c470fb77b10d593176b79 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-867526992 Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestMultiTenantJSON-867526992-project Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: f937c1821d204ef2b29ba720fbeb62ef Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-867526992-project Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a164964b-4d56-4c9f-b747-a3466f41d39e'} Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:35.243174 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] Returning 404 to user: Instance a164964b-4d56-4c9f-b747-a3466f41d39e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aed81219-01f4-4753-a361-44c84a080bea tempest-ServersNegativeTestMultiTenantJSON-867526992 tempest-ServersNegativeTestMultiTenantJSON-867526992-project] 10.222.0.36 "GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e" status: 404 len: 111 microversion: 2.1 time: 0.159221 Oct 04 20:58:35.252940 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1736/3420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:35 2022] GET /compute/v2.1/servers/a164964b-4d56-4c9f-b747-a3466f41d39e => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:35.263659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504e21e9-8180-4152-bcd1-5eb1dbf83574", "tag": "da967f7a-b2c7-475d-914c-0c0aff2b2874"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:35.278329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.279175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.279905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.324231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] Creating event network-changed:da967f7a-b2c7-475d-914c-0c0aff2b2874 for instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 on n-h2-851029-13 Oct 04 20:58:35.335955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6d7dee18-1860-403f-8834-6960c98ad905 req-ebe5d991-61ea-4a0b-a0e1-5d9e755ba142 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087618 Oct 04 20:58:35.338101 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1737/3421] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:35.352801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:35.354744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:35.372869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.374309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.375597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.377565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.379605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.380910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.163189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:36.185004 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0775c79b-102c-49ee-b256-6218c08006a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.843258 Oct 04 20:58:36.186864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1738/3422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:35 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:36.195735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:36.200651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:36.216500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.224229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.226486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.228725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.230914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.234424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.271180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd771ee3-9e87-4b02-b7dc-7f46081b0f9f tempest-SecurityGroupRulesNegativeTestJSON-1641125529 tempest-SecurityGroupRulesNegativeTestJSON-1641125529-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/76b0c9b8-9c9d-4fde-b081-4351e0906708" status: 202 len: 0 microversion: 2.1 time: 2.752159 Oct 04 20:58:36.275458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1685/3423] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 20:58:33 2022] DELETE /compute/v2.1/os-security-groups/76b0c9b8-9c9d-4fde-b081-4351e0906708 => generated 0 bytes in 2758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:58:36.305276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:36.308071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:36.348633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.353958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.355795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.362172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.365460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.369347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.990321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:37.996339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:38.089691 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdf0f5c0-340a-45e1-ab70-d115fe1ce39c tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 200 len: 1505 microversion: 2.1 time: 1.805269 Oct 04 20:58:38.090953 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1686/3424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:36 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 1505 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:38.150038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:38.162852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:38.189022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:38.220612 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8fdaa71-a782-48ef-a4f7-505ce8702ac4 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 2.031106 Oct 04 20:58:38.229306 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1739/3425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:36 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:38.236446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.242468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.245226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.248258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.251876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.255259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:38.256190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.287384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:38.346342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.355603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.360098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.366443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.376308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.380254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:40.607708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:40.625270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2129276-936c-4619-8670-a02ace96f476 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 2.532310 Oct 04 20:58:40.627162 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1687/3426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:38 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:40.636600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:40.638203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:40.650627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:40.652031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:40.653145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:40.655774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:40.657055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:40.658091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.212016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:41.244582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81d57ee0-1f26-42f3-9f62-54aa5216fc89 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1505 microversion: 2.1 time: 3.010111 Oct 04 20:58:41.247034 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1740/3427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:38 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1505 bytes in 3016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:41.288480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:41.297161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:41.332328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.338487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.339481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.343344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.350776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.352038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.474134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:41.632700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:41.931795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:41.992101 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee8cbd88-3a03-4a68-b2fc-e96f73987c5a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 1.362572 Oct 04 20:58:41.993273 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1688/3428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:40 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:42.039330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:42.040911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:42.087449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.089009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.090008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.091588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.093259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.096334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.187600 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4048200f-d9c7-4a81-9fe0-da4fe374ccd1 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 204 len: 0 microversion: 2.1 time: 0.906600 Oct 04 20:58:42.194084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1741/3429] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:41 2022] DELETE /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 0 bytes in 913 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:42.218485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:42.219682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:42.245143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.246054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.246936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.248279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.249190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.250005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.348244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:42.916324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5da69d08-2086-4a7e-8df1-d4ad0a263a75 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 204 len: 0 microversion: 2.1 time: 0.718526 Oct 04 20:58:42.918431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:42.919226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1742/3430] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:42 2022] DELETE /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:42.954940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504e21e9-8180-4152-bcd1-5eb1dbf83574", "name": "network-vif-plugged", "status": "completed", "tag": "da967f7a-b2c7-475d-914c-0c0aff2b2874"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:42.967563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-277e8245-0e64-40c3-a808-be70acb1c78c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.948128 Oct 04 20:58:42.970548 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1689/3431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:42 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:42.990556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:42.992063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:42.992302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.993139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.994038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.026975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.028533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.033406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.035346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.039184 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] Creating event network-vif-plugged:da967f7a-b2c7-475d-914c-0c0aff2b2874 for instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 on n-h2-851029-13 Oct 04 20:58:43.041883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.048729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.062585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4eecda08-eb59-4429-ad0e-d9a5f0abd4ac req-4f657cde-86ed-4833-a074-36b7440ae8ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135446 Oct 04 20:58:43.076619 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1743/3432] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:43.087717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:43.092640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:43.112268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.112268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.113451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.113451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.113787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.118229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.034152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:44.060871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce6a4d9f-d7be-4fea-85d2-1ee209d15bc4 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1511 microversion: 2.1 time: 1.084522 Oct 04 20:58:44.061857 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1690/3433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:42 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1511 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:44.070971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:44.080480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:44.094760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.101900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.105501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.105501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.106415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.107797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.469145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:44.500249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1091e51c-9eec-4e0f-b8ac-8f44d269bc0d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 1.420688 Oct 04 20:58:44.510874 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1744/3434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:43 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:44.642486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c058f440-0431-4d99-a11c-bba545b6eaa5", "tag": "f7facf28-f105-43ec-88be-bc4890efb7e0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:44.689969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.691053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.692015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.729403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:44.734047 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] Creating event network-changed:f7facf28-f105-43ec-88be-bc4890efb7e0 for instance c058f440-0431-4d99-a11c-bba545b6eaa5 on n-h1-851029-13 Oct 04 20:58:44.748390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f906ee7a-1940-414a-b269-302f6cafcf6f req-1df15153-d6ff-4976-bedc-929d58e8259b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114675 Oct 04 20:58:44.751501 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1745/3435] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:58:45.014253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:45.043415 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9c378f3-9d4a-4ead-a94f-b2ef000e7971 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.979359 Oct 04 20:58:45.049714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1691/3436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:44 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:45.115583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:45.123326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:45.144455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.145466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.146954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:45.148245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.150445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.151489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:45.546979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:45.548135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:45.600845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.602334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.603595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:45.605359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.606622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.621944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.201036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:47.241358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:47.242632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f2ba1ed3-3333-4d19-95ab-96572b2acd6c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1324 microversion: 2.1 time: 1.701737 Oct 04 20:58:47.271260 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1692/3437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:45 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1324 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:47.286313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:47.288365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:47.301019 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8aa7c3e-a18c-43a8-ba8d-bce27a0647ad tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1511 microversion: 2.1 time: 2.194304 Oct 04 20:58:47.302086 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1746/3438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:45 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1511 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:47.306136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.307440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.315042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.316829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.318481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.319817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.011741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4358121b-38c0-401b-9aee-ae967c84f4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "c980f883-1bca-4260-a9a8-05391d619883"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:48.075915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:48.096906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.096906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.096906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.106538 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aaa3a705-b1a2-4396-a0d8-a15dc629c967 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.832410 Oct 04 20:58:48.111355 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1693/3439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:47 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:48.145816 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] Creating event network-vif-unplugged:c980f883-1bca-4260-a9a8-05391d619883 for instance 4358121b-38c0-401b-9aee-ae967c84f4cb on n-h2-851029-13 Oct 04 20:58:48.169914 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2f546ca2-da12-4ff5-ab13-bd1888884af4 req-a059d78d-c2ce-45bc-97b2-d933173c1f9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165991 Oct 04 20:58:48.184873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1747/3440] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:48.319823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:48.323629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:48.350825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:48.356458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:48.377240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.387950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.392881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.394278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.396045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.396617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.399281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.401352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.405387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.407379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.408261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.415335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.379097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:49.395993 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84dc963d-8d35-4bc9-be9d-6add6260c453 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1520 microversion: 2.1 time: 1.085349 Oct 04 20:58:49.397130 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1694/3441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:48 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1520 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:49.407424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:49.409330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:49.424462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.426058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.427458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.429466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.430943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.432206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.482782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:49.513678 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33833149-9e68-48de-9a78-3d0e0bb0be65 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1511 microversion: 2.1 time: 1.170722 Oct 04 20:58:49.523260 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1748/3442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:48 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1511 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:49.554434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:49.558116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:49.581073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.584043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.584881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.586745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.588265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.589240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:50.110269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:50.145823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-640327ad-e1ce-418d-81b4-80b9d8bf6d80 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.746265 Oct 04 20:58:50.150723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1695/3443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:49 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:50.212419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:50.255227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1cc71ef-5192-4c74-a969-b30ec8be5b39 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1520 microversion: 2.1 time: 0.728778 Oct 04 20:58:50.257671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1749/3444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:49 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1520 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:50.317742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-825459651"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:50.324744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:50.339140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:50.340478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:50.341502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:50.343825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:50.345087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:50.346023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:50.588444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:50.593557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:50.616924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:50.621262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:50.623122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:50.627321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:50.630600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:50.632155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.145373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:51.167701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09a8c241-e802-4e06-b495-ee4d045f2cb0 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1511 microversion: 2.1 time: 0.596850 Oct 04 20:58:51.169475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1750/3445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:50 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:51.179443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646c11fd-3090-4d34-8de4-a267e46a99d0", "name": "network-vif-deleted", "tag": "028db6f2-206c-4922-a87f-246f1ca0dd49"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:51.214755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.217817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.219227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.244723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] Creating event network-vif-deleted:028db6f2-206c-4922-a87f-246f1ca0dd49 for instance 646c11fd-3090-4d34-8de4-a267e46a99d0 on n-h1-851029-13 Oct 04 20:58:51.255670 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-94451ca2-c727-4598-9e28-66323fb5b627 req-4259c348-3169-4b35-b1ea-f800ad11bfbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083120 Oct 04 20:58:51.257893 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1751/3446] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:51.271851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:51.273706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:51.307449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.315326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.316520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.318140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.319350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.320606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.329730 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ba634df-adea-4bb8-b1c9-76da0829bc69 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574/action" status: 202 len: 0 microversion: 2.1 time: 1.029959 Oct 04 20:58:51.338740 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1696/3447] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:58:50 2022] POST /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574/action => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:58:51.364410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a49c2298-c8af-4420-91d1-87e0c56a9a5b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54f57324c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:51.953782 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a49c2298-c8af-4420-91d1-87e0c56a9a5b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629" status: 204 len: 0 microversion: 2.1 time: 0.603034 Oct 04 20:58:51.955532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1697/3448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:51 2022] DELETE /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:58:51.986805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5562e44e-1d93-404f-a907-69fbcd14bc85 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54fa5a0d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:52.069496 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-5562e44e-1d93-404f-a907-69fbcd14bc85 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Image not found. Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5562e44e-1d93-404f-a907-69fbcd14bc85 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629 HTTP/1.1 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '481c3304-8354-4aeb-9a73-e84f15878629'} Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 481c3304-8354-4aeb-9a73-e84f15878629 Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:58:52.086339 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 481c3304-8354-4aeb-9a73-e84f15878629 could not be found. Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5562e44e-1d93-404f-a907-69fbcd14bc85 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5562e44e-1d93-404f-a907-69fbcd14bc85 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629" status: 404 len: 62 microversion: 2.1 time: 0.128437 Oct 04 20:58:52.110365 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1698/3449] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 4 20:58:51 2022] GET /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629 => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:58:52.140970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:52.142955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:52.142955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:52.154095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:52.171415 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28ced6b8-8f80-4130-ac17-075266199098 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.910154 Oct 04 20:58:52.174524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.175321 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1752/3450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:51 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:52.183983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.185303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.188000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.189573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.190479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.225501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:52.229340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:52.293465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.294381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.295246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.304020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.305289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.306376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.915692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9d8cbffeb24a7b85f556f17607a9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7506970542da4c119f49cafe6fbb71ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:53.000863 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a80c0d61-5643-43ad-9add-1fa1e6e22b80 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 200 len: 1469 microversion: 2.1 time: 0.784203 Oct 04 20:58:53.003617 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1753/3451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:52 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:53.030097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-156277118", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6625a5dc-d4c9-493c-a356-6d80fd39a592"}], "security_groups": [{"name": "tempest-securitygroup--1219406203"}], "key_name": "tempest-keypair-2061477077", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:53.343044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:53.379705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a413acd-7404-42ed-9445-59e27bfc117d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1532 microversion: 2.1 time: 1.270998 Oct 04 20:58:53.383366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1699/3452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:52 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1532 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:53.407777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:53.411782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:53.427979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:53.429369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:53.430571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:53.432330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:53.433532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:53.435478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.752142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:54.777788 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f2eacb1c-7602-46bf-8839-bdfa0d67c9ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 1.392217 Oct 04 20:58:54.813745 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1700/3453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:53 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:54.827253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4358121b-38c0-401b-9aee-ae967c84f4cb", "name": "network-vif-deleted", "tag": "c980f883-1bca-4260-a9a8-05391d619883"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:54.851893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.853620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.855148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.893063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] Creating event network-vif-deleted:c980f883-1bca-4260-a9a8-05391d619883 for instance 4358121b-38c0-401b-9aee-ae967c84f4cb on n-h2-851029-13 Oct 04 20:58:54.910358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ab9210da-711c-4cf8-842e-1e72429085f9 req-528485a9-4746-4cae-988d-6f71050f976d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095291 Oct 04 20:58:54.913424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1701/3454] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:54.924216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:54.926327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 4358121b-38c0-401b-9aee-ae967c84f4cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:54.941875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.945312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.946713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.949617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.951309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.955723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.004402 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] HTTP exception thrown: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Request method failure captured: Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb HTTP/1.1 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4MsEQe97HEC56dbG4PtP3lO-nJjH5-rnLMLyQyOs0zufFqpCqbMznqx-ao2P6xuvgy2lSvllEQ9p4l6mbC2acUmcWZ5iJvjIx57Keroiwlz_fHhxTFfYIvLQnIaqZEYYqRQo5QbAfdEJhYYLKMq9TD9qfB4g2OWOvUhPKlcWAhw_0 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7506970542da4c119f49cafe6fbb71ee Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7506970542da4c119f49cafe6fbb71ee Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MultipleCreateTestJSON-1243492472-project Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6b9d8cbffeb24a7b85f556f17607a9ec Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MultipleCreateTestJSON-1243492472-project Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4358121b-38c0-401b-9aee-ae967c84f4cb'} Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.008543 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Returning 404 to user: Instance 4358121b-38c0-401b-9aee-ae967c84f4cb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2938edf3-052e-4d86-8073-73d0bd2cd9d9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb" status: 404 len: 111 microversion: 2.1 time: 0.096865 Oct 04 20:58:55.021051 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1702/3455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:54 2022] GET /compute/v2.1/servers/4358121b-38c0-401b-9aee-ae967c84f4cb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:55.032584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:55.033496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:55.060594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.067821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.072078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.074550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.083213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.084383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.369112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] validate_networks() for [('6625a5dc-d4c9-493c-a356-6d80fd39a592', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:58:55.865485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:55.883575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee56d4dc-84fd-4d4a-8fbd-cd4cb47326c3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1533 microversion: 2.1 time: 0.864138 Oct 04 20:58:55.884708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1703/3456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:55 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1533 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:55.896338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:55.897510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] [instance: 646c11fd-3090-4d34-8de4-a267e46a99d0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:55.915026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.915998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.916472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.918559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.919828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.921952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.956880 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] HTTP exception thrown: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Request method failure captured: Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 HTTP/1.1 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4MsEQe97HEC56dbG4PtP3lO-nJjH5-rnLMLyQyOs0zufFqpCqbMznqx-ao2P6xuvgy2lSvllEQ9p4l6mbC2acUmcWZ5iJvjIx57Keroiwlz_fHhxTFfYIvLQnIaqZEYYqRQo5QbAfdEJhYYLKMq9TD9qfB4g2OWOvUhPKlcWAhw_0 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7506970542da4c119f49cafe6fbb71ee Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7506970542da4c119f49cafe6fbb71ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7506970542da4c119f49cafe6fbb71ee Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1243492472 Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-MultipleCreateTestJSON-1243492472-project Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6b9d8cbffeb24a7b85f556f17607a9ec Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-MultipleCreateTestJSON-1243492472-project Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '646c11fd-3090-4d34-8de4-a267e46a99d0'} Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.979380 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] Returning 404 to user: Instance 646c11fd-3090-4d34-8de4-a267e46a99d0 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30bc3e32-6b48-4cc9-9191-13e07277cbc9 tempest-MultipleCreateTestJSON-1243492472 tempest-MultipleCreateTestJSON-1243492472-project] 10.222.0.36 "GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0" status: 404 len: 111 microversion: 2.1 time: 0.095137 Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1704/3457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:55 2022] GET /compute/v2.1/servers/646c11fd-3090-4d34-8de4-a267e46a99d0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:56.001366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:56.030283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:56.031749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:56.033000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:56.038476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:56.039827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:56.041030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:56.959799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:56.980488 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a74a310-36cd-4288-82cd-bbe574222897 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 0.994818 Oct 04 20:58:56.985723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1705/3458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:55 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:57.001630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:57.007858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:57.030834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.032364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.033519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.035246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.036666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.037758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.047594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:57.733588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:57.737220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:57.738852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:57.739990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:57.742282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:57.801204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.804586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.806563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.833402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.837913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.849080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.934700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:57.949157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:57.979033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:57.984130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:58.007978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:58.031862 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63a93077-6f35-4778-82ea-5fccd67e81b1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1520 microversion: 2.1 time: 1.043292 Oct 04 20:58:58.043162 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1706/3459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:56 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1520 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:58.052777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.063872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:58.090523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.091438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.092242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.093305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.094099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.094857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.301623 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6bb901b-5bda-4bb2-9037-9bc8f0011cfb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.291781 Oct 04 20:58:58.318096 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1754/3460] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 5314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:58:58.336071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.341476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:58.369667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.371847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.372596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.374789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.375739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.378815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.493457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:59.205636 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-925b68ec-ff0f-41b9-a0ca-75caa9392aa1 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 204 len: 0 microversion: 2.1 time: 0.884236 Oct 04 20:58:59.215246 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1755/3461] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:58 2022] DELETE /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:59.228170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb00c8c-0f5c-4eec-bd86-9783e2c66948 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:59.229607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfb00c8c-0f5c-4eec-bd86-9783e2c66948 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:59.278131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:00.202933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bfb00c8c-0f5c-4eec-bd86-9783e2c66948 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:00.221960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfb00c8c-0f5c-4eec-bd86-9783e2c66948 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1238 microversion: 2.1 time: 1.007064 Oct 04 20:59:00.224634 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1756/3462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:59 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1238 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:00.235065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c058f440-0431-4d99-a11c-bba545b6eaa5", "name": "network-vif-plugged", "status": "completed", "tag": "f7facf28-f105-43ec-88be-bc4890efb7e0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:00.259000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.260428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.264097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.315899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] Creating event network-vif-plugged:f7facf28-f105-43ec-88be-bc4890efb7e0 for instance c058f440-0431-4d99-a11c-bba545b6eaa5 on n-h1-851029-13 Oct 04 20:59:00.333463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-234e2d95-d637-4828-9c07-7a33de7e48bc req-6fa0bb85-03fc-42e6-b1d2-215015630f77 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105614 Oct 04 20:59:00.336405 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1757/3463] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:00.375122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:00.377953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:00.395305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.397199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.398313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.400288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.401985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.408174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.496742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:00.525021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba177108-90ea-4058-a738-36f4fdc8458c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 2.479736 Oct 04 20:59:00.527423 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1707/3464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:58 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:01.275656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:01.277305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:01.293553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.294980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.299349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.299349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.299349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.299896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.512632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:01.543606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5d34ce8-2206-4d92-8daf-56f7245070c7 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1526 microversion: 2.1 time: 1.204717 Oct 04 20:59:01.547034 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1758/3465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:00 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1526 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:01.580423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:01.581626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:01.597920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.599504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.600453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.601977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.603079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.603985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.651328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:01.676433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:01.706224 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5753ae20-9740-4cc9-9646-9417163919d4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1242 microversion: 2.1 time: 0.437884 Oct 04 20:59:01.707363 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1708/3466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:01 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1242 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:02.393691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504e21e9-8180-4152-bcd1-5eb1dbf83574", "name": "network-vif-plugged", "status": "completed", "tag": "da967f7a-b2c7-475d-914c-0c0aff2b2874"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:02.455408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.457905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.459069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.508726 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] Creating event network-vif-plugged:da967f7a-b2c7-475d-914c-0c0aff2b2874 for instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 on n-h2-851029-13 Oct 04 20:59:02.537721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b342379b-c0d0-4200-b022-bdb6ab96c300 req-b52b54b6-d23a-4504-a976-90394c8c9bb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152413 Oct 04 20:59:02.551089 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1709/3467] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:02.600802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:02.611010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:02.626074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.636498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.637530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.642250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.644341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.651810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.938699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:02.969109 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8409ed58-8ee3-4383-87bd-9d27b32a4800 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1314 microversion: 2.1 time: 1.397649 Oct 04 20:59:02.974177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1759/3468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:01 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:02.990026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:03.033961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:03.083712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:03.084768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:03.087108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.088940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:03.090233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:03.094391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.211838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:03.248392 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80c471c0-23d3-4d9a-94fa-7c977fee3b68 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1484 microversion: 2.1 time: 0.663914 Oct 04 20:59:03.257394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1710/3469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:02 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1484 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:03.301801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:03.316693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa4f6e6a-2022-4a4b-8407-397c759097d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1290 microversion: 2.1 time: 0.337255 Oct 04 20:59:03.317774 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1760/3470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:02 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1290 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:03.321541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504e21e9-8180-4152-bcd1-5eb1dbf83574", "name": "network-vif-deleted", "tag": "da967f7a-b2c7-475d-914c-0c0aff2b2874"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:03.379270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:03.385686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:03.386806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.453999 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] Creating event network-vif-deleted:da967f7a-b2c7-475d-914c-0c0aff2b2874 for instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 on n-h2-851029-13 Oct 04 20:59:03.484719 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c3f05880-5a02-45ac-909d-c6e1b28a9361 req-7c8481bf-79c8-4ea6-b213-ee7a55420c78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175975 Oct 04 20:59:03.498033 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1711/3471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:04.021076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:04.028145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:04.048296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.055744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.059114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.066171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.066171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.070349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.305547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:04.315941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:04.343393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.348473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.353473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.357103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.362014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.362624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.581767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.581767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.588756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.590024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lazy-loading 'fault' on Instance uuid 504e21e9-8180-4152-bcd1-5eb1dbf83574 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:04.755321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:04.783946 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4812cceb-1adf-48ea-b1f3-ea393d0341e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 200 len: 1314 microversion: 2.1 time: 0.493816 Oct 04 20:59:04.786649 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1712/3472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:04 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:04.798715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:04.800114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:04.814288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.815256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.816092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:04.817474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:04.818374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:04.819196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.181276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:05.200093 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57ab9a7b-0723-4307-93ab-79f79ad90134 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1502 microversion: 2.1 time: 1.186517 Oct 04 20:59:05.201611 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1761/3473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:04 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1502 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:05.252218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:05.252218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:05.261336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.262197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.263531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.265559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.266813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.267993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.272288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:05.298153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-12bfbad1-13a3-477f-90d4-fff3d2f61798 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1296 microversion: 2.1 time: 0.507834 Oct 04 20:59:05.298576 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1713/3474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:04 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1296 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:05.756306 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a76008db-26c0-40a4-b018-4b1336bfad5a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5/action" status: 202 len: 0 microversion: 2.1 time: 0.516623 Oct 04 20:59:05.763186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1762/3475] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:05 2022] POST /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:05.781143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:05.782335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:05.804977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.804977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.804977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.806633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.807989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.808785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.832409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:05.833725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:05.859083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.860327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.861300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.863074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.864401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.865811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.902004 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 HTTP/1.1 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '504e21e9-8180-4152-bcd1-5eb1dbf83574'} Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:05.906448 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:05.918019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:05.920206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f1a89ad-1a21-4403-8ade-b9a48a29bb88 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 404 len: 111 microversion: 2.1 time: 0.095757 Oct 04 20:59:05.935648 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1763/3476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:05 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:06.223326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-724729669", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:06.360726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] validate_networks() for [('528153a9-4bc3-4dc2-9ae6-3df23391f5d6', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:59:07.358792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:07.383243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-456cdb35-58e6-4bb6-a0d6-fe5658ff92e3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1507 microversion: 2.1 time: 1.617283 Oct 04 20:59:07.386529 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1714/3477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:05 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1507 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:07.400093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:07.402964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:07.420993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:07.423115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:07.424962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:07.428035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:07.429766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:07.431295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:07.880718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:08.311672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:08.328167 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67de0fe1-ac7d-4a8d-b731-075467117a13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 0.938284 Oct 04 20:59:08.329527 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1715/3478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:08.433815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:08.436899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:08.452234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.453324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.454792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:08.456619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.457556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.460976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:09.693120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:59:09.694038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:59:09.694777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:59:09.696360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:59:09.697428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:59:09.718118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:09.719811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:09.721134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:09.723098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:09.724479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:09.725952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:09.766309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:59:09.778435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Getting quotas for user 4ac6607c7faa4e8d9745bbf05780e9d6 and project ae5439ddd7214e219e9b5f8ef1739b90. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:59:09.807512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:59:09.813446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:59:09.853488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:09.879294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72b9d0ea-4049-4006-aa9e-ddae0f8da6bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1487 microversion: 2.1 time: 1.453280 Oct 04 20:59:09.928974 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1716/3479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:08 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1487 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:09.956343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:09.958538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:09.981442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:09.983389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:09.984598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:09.986309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:09.987567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:09.988674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.176257 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dea107d9-bc6c-4207-b966-fb39ab994586 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.965225 Oct 04 20:59:10.191315 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1764/3480] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 3982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:59:10.203765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:10.206253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:10.219237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.220725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.222119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.223881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.225114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.227951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.349353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:59:10.954103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89bef6f7-8e5c-44d5-8243-e26af5d54eac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 204 len: 0 microversion: 2.1 time: 0.759614 Oct 04 20:59:10.959126 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1765/3481] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:59:10 2022] DELETE /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:59:10.978000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c473f2d2-e22d-4284-a14c-974e267913db tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:10.985064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c473f2d2-e22d-4284-a14c-974e267913db tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:11.083742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:11.098178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3005d99c-388f-451e-b4d9-fe4621019ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 1.152119 Oct 04 20:59:11.100153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1717/3482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:09 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:11.134418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:11.136662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:11.179486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c473f2d2-e22d-4284-a14c-974e267913db tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:11.219385 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c473f2d2-e22d-4284-a14c-974e267913db tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1224 microversion: 2.1 time: 0.254803 Oct 04 20:59:11.234956 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1766/3483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:10 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1224 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:11.235217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.235217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.236376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.241142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.244817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.247353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.319381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:11.371134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.372059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.372954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.422426 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] Creating event network-changed:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 20:59:11.432768 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-852f0a20-8ddf-464a-80f5-b02c9c5d879b req-6bb4ecb7-6076-4ce6-bd3b-7fa22e56b4bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125876 Oct 04 20:59:11.435131 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1767/3484] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:12.152464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:12.163617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:12.200546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:12.201844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:12.205999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:12.211479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:12.216420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:12.219341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:13.383143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:13.396658 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-487fb803-7d96-43a4-a5d4-8dbf500e1c2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1493 microversion: 2.1 time: 2.294186 Oct 04 20:59:13.397366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1718/3485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:11 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1493 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:13.406849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:13.408361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:13.422180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:13.424257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:13.425563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:13.427395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:13.428748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:13.429882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:13.726130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:13.755406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2e6e561-9f1f-4bb0-ba08-1f52510b3203 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1220 microversion: 2.1 time: 0.353725 Oct 04 20:59:13.761359 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1719/3486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:13 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1220 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:14.155282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:14.176314 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e99a9b6-6135-4a9f-9790-db4df4da6c4b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 2.037641 Oct 04 20:59:14.195914 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1768/3487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:12 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:14.445474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:14.446779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:14.477638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.478602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.479447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.480816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.481684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.483348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.573144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c058f440-0431-4d99-a11c-bba545b6eaa5", "name": "network-vif-deleted", "tag": "f7facf28-f105-43ec-88be-bc4890efb7e0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:14.621422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.622316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.623374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.649878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] Creating event network-vif-deleted:f7facf28-f105-43ec-88be-bc4890efb7e0 for instance c058f440-0431-4d99-a11c-bba545b6eaa5 on n-h1-851029-13 Oct 04 20:59:14.704392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-be9eed6e-1438-434e-a382-936f1c8f5db5 req-8371d9cd-219b-4b27-b710-963bcd64d59a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131777 Oct 04 20:59:14.706212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1769/3488] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:14.815038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:14.820640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:14.858162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.862942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.864347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.868059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.875493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.876313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:15.415971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:15.454843 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae21fa0e-03f3-4c5f-a630-b8b77c88f0a4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 200 len: 1451 microversion: 2.1 time: 1.017439 Oct 04 20:59:15.461100 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1720/3489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:14 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 1451 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:15.475694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:15.485231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:15.503543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:15.505019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:15.506401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:15.508089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:15.509294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:15.510494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:15.698183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:15.732639 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b1dce97-b079-4b4f-93ac-8923940c585a tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1276 microversion: 2.1 time: 0.929013 Oct 04 20:59:15.733782 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1770/3490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:14 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1276 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:16.519032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:16.520924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:16.541670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.543659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.544958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.558432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.559853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.562400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.614707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 HTTP/1.1 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c058f440-0431-4d99-a11c-bba545b6eaa5'} Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:16.620011 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 20:59:16.636186 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:16.640240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:16.643133 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f14c62a1-8c21-46a1-9881-2302833f42bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 404 len: 111 microversion: 2.1 time: 0.133086 Oct 04 20:59:16.645870 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1771/3491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:16 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:59:16.783804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:16.787482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:16.828229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.830369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.833719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.836596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.839130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.843629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.870094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:16.917289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c38124e-6f5b-4cb1-b449-7b280f1a253b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 1.453614 Oct 04 20:59:16.918454 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1721/3492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:15 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:16.949018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-615363035", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:17.104772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:59:17.238916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:17.280520 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c15184a-03f0-47dd-9df3-a953a575367d tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1282 microversion: 2.1 time: 0.506167 Oct 04 20:59:17.283487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1772/3493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:16 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1282 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:17.980622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:17.988277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:18.032332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:18.033617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:18.039832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:18.047335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:18.059585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:18.059585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.661292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:19.688183 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab57d32c-36e1-428b-a499-953dcaf07f07 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 1.725762 Oct 04 20:59:19.689842 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1773/3494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:17 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:19.736178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:19.737908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:19.749504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:19.753032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.754533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.755798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.757588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.759827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.761104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.854623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:59:20.855574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.857995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:59:20.860066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:59:20.861367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:59:20.863078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:59:20.878790 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b65d293-9426-4b16-a7b1-0cfd9aad3744 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.173462 Oct 04 20:59:20.884607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.886172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.887998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.889694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1774/3495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:19 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:20.892443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.893873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.895123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.919823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-plugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:20.950724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:59:20.960272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.961200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.962037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.971444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:59:21.023590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:59:21.024665 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] Creating event network-vif-plugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 20:59:21.028415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:59:21.069373 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4d3701c9-3064-4513-b119-39dce99c6bb6 req-c6c7fd03-0cd6-4303-92d2-d44d1f10790e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174696 Oct 04 20:59:21.077465 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1775/3496] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:21.099024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:21.103503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.162000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.162922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.172457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.173837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.176372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.176372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.201923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:21.321987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e57ee33-44e7-4b2e-9c14-4f2f621edd1b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.394586 Oct 04 20:59:21.330459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1722/3497] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:59:21.360089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6fa407fe-72f0-4b84-99e0-99f70c28fba0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:21.361855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6fa407fe-72f0-4b84-99e0-99f70c28fba0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.621229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6fa407fe-72f0-4b84-99e0-99f70c28fba0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:21.646142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6fa407fe-72f0-4b84-99e0-99f70c28fba0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1214 microversion: 2.1 time: 0.301178 Oct 04 20:59:21.650039 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1723/3498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:21 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:21.928346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:21.936397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.949843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.949843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.949843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.949843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.949843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.952197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:22.027086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:22.065129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-619c9bce-0636-48ce-9609-6c5b32457d4a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 0.984768 Oct 04 20:59:22.067444 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1776/3499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:21 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:22.675122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:22.704857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f5b99ae-a316-4cc0-bb22-af8443cf7c0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:22.705387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f5b99ae-a316-4cc0-bb22-af8443cf7c0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:22.710912 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee223d31-cc1e-4c60-9964-f47eb196db09 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 0.784354 Oct 04 20:59:22.720888 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1724/3500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:21 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:22.968241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f5b99ae-a316-4cc0-bb22-af8443cf7c0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:22.996715 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f5b99ae-a316-4cc0-bb22-af8443cf7c0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1214 microversion: 2.1 time: 0.312344 Oct 04 20:59:23.019408 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1777/3501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:22 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:23.126409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:23.129460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:23.150183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:23.154526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.157385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.157815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.159966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.162195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.163807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.228041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:23.767780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:23.772312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:23.813862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.819210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.820938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.823080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.826192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.830720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:24.403480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:24.444202 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba42b4e3-bbc1-488f-83d5-c9b8533f118f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1364 microversion: 2.1 time: 1.333996 Oct 04 20:59:24.452913 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1725/3502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:23 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1364 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:24.477618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:24.480628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:24.498757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:24.500279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:24.501429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:24.503540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:24.505620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:24.506887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:24.598121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:24.614749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95a56059-c64c-4dde-85ff-788ea585c148 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 0.856541 Oct 04 20:59:24.643562 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1778/3503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:23 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:24.711313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:24.760911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-537f5141-ca9f-4c83-a068-01ce104738e7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1210 microversion: 2.1 time: 0.303694 Oct 04 20:59:24.764245 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1726/3504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:24 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1210 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:25.405944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775e43cf-d278-412c-9f4e-709466f67ba7", "tag": "ad5ecf5a-53cf-4400-94ef-2ca6134a82b8"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:25.439028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.440396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.441593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.468619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] Creating event network-changed:ad5ecf5a-53cf-4400-94ef-2ca6134a82b8 for instance 775e43cf-d278-412c-9f4e-709466f67ba7 on n-h2-851029-13 Oct 04 20:59:25.481442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-dfdc93ad-9500-4e94-98f3-533f073b87cb req-4be45406-e586-42b6-a188-c171370283a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080445 Oct 04 20:59:25.483593 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1779/3505] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:25.501536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:25.502627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:25.529499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.536251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.537474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.548220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.549625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.550366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.661337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:25.663015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:25.689838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.692589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.693410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.694796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.699798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.700646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.751412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:26.296955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.299395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.316330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48f135f8-106f-4c67-9c6d-e61ae66233a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 0.662891 Oct 04 20:59:26.317952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1780/3506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:25 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:26.339744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:26.348563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:26.363021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.364459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.365595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.367465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.368711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.370159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.373702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c45fcd8-f21c-4a8a-a296-eed5e43e9129 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1550 microversion: 2.1 time: 0.877096 Oct 04 20:59:26.377251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1727/3507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:25 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1550 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:26.424449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:26.426108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:26.442879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.442879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.442879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.442879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.444132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.445456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.705417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.724402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c55bcda-c311-4527-b909-7e54a0c20a88 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1274 microversion: 2.1 time: 0.403843 Oct 04 20:59:26.735551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1781/3508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:26 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:26.979115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-83e6fede-2574-48cb-9a10-40009de2511d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.564064 Oct 04 20:59:26.980423 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1728/3509] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 20:59:26 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/os-interface => generated 284 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:27.370750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:27.372771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.398455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.401718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.403285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.405613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.406965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.408412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.778459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:27.780035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.838641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.840544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.841930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.844352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.845916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.847266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.519875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:28.562142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-684f3178-0dae-4124-bb1a-df3bf478649d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1272 microversion: 2.1 time: 0.791973 Oct 04 20:59:28.590737 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1729/3510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:27 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1272 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:28.752819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:28.771153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0247bd60-54d4-4a22-814b-30702e0cc8ba tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.408575 Oct 04 20:59:28.771998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1782/3511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:27 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:29.619904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:29.621226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.646322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.659400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.663777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.668349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.670332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.676829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.830070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:29.832587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.850572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.852395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.854123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.856249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.858269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.859573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:30.169336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:30.185303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c722e4b2-ac0a-4245-a7a8-b990b1181892 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1272 microversion: 2.1 time: 0.573579 Oct 04 20:59:30.197713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1730/3512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:29 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1272 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:30.906839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:30.938317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c1f2713-b8f8-4a66-83a2-509c8dc08916 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.120488 Oct 04 20:59:30.939882 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1783/3513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:29 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:31.254651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:31.257320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.267684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:31.277613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.279940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.283008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.284859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.286162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.287872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.594716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.614340 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-621b6016-e68c-4393-a922-8f99c3ffe248 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1272 microversion: 2.1 time: 0.369410 Oct 04 20:59:31.627063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1731/3514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:31 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:31.981840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:31.983312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.993472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:32.027188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.028334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.029930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.032932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.034335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.039023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.672990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:32.674177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:32.690179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:32.722496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.723459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.728655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.729920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.759523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.760501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.995645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:34.344884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:34.370740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66deefa3-5409-47da-9f44-490e04c82fca tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 2.396530 Oct 04 20:59:34.372868 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1784/3515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:31 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:34.835649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:34.867139 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec348602-04c8-4a99-b7b7-af8a8b510325 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 2.203412 Oct 04 20:59:34.875505 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1732/3516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:32 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:35.427137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:35.432253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:35.474455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.480466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.482688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.492588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.495697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.499033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.925172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:35.931085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:35.966017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.967383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.968111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.969118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.969778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.970340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.187859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.227303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-497278f4-3c52-4050-b455-c3cea9a7c077 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.813043 Oct 04 20:59:37.229534 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1785/3517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:35 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:37.252037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:37.286402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.296539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.297764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.353294 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] Creating event network-changed:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 20:59:37.371089 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c9133277-869c-4610-a939-b6f59f0dd1e4 req-311b4a8d-ce1a-4f44-8a5b-ffa9fdb0bc07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137420 Oct 04 20:59:37.372165 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1786/3518] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:37.393165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57eb2146-c731-45c2-8494-558834adbc61", "tag": "f66fc200-097a-4dbe-9462-a41240d23aa1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:37.437826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.444044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.445515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.511323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] Creating event network-changed:f66fc200-097a-4dbe-9462-a41240d23aa1 for instance 57eb2146-c731-45c2-8494-558834adbc61 on n-h1-851029-13 Oct 04 20:59:37.526303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b19cdbc8-4154-46f5-9a74-6a83b5c8b9c2 req-717f8c9a-4650-4367-82a0-6896069697d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148621 Oct 04 20:59:37.532820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1787/3519] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:37.639220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.671234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-023f723d-256a-4860-8b80-f20fb0eb8794 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 1.754908 Oct 04 20:59:37.677314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1733/3520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:35 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:38.279602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:38.287739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:38.321090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.323187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.325485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.332850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.333739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.334645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.728485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:38.735120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:38.771386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.774468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.778325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.780510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.785778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.789133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:39.642227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:39.684839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4035e51-2a4b-43bb-bddb-bca3fa016d1f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.417130 Oct 04 20:59:39.693103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1788/3521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:38 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:39.715468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775e43cf-d278-412c-9f4e-709466f67ba7", "name": "network-vif-plugged", "status": "completed", "tag": "ad5ecf5a-53cf-4400-94ef-2ca6134a82b8"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:39.754212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:39.755190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:39.756030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:39.814609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:39.816025 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] Creating event network-vif-plugged:ad5ecf5a-53cf-4400-94ef-2ca6134a82b8 for instance 775e43cf-d278-412c-9f4e-709466f67ba7 on n-h2-851029-13 Oct 04 20:59:39.832212 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0d865673-8d4c-4c6e-874d-f5f832e4b2dd req-d25deed4-5142-4aaf-9a21-17dd60b62453 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137000 Oct 04 20:59:39.838887 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1789/3522] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:39.843057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15e50254-06bd-4412-a45c-fa22779850ba tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 1.121589 Oct 04 20:59:39.858711 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1734/3523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:38 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:40.746488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:40.749902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:40.765882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.767564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.768973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.771219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.772791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.774034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.890383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:40.891589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:41.057112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.063960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.071315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.073334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.080283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.089384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.775330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:41.800964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e45f1728-650e-49ae-8f54-12cb2173c4a9 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1324 microversion: 2.1 time: 1.064981 Oct 04 20:59:41.802697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1790/3524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:40 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1324 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:42.508215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:42.564285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9dadb7c3-b13c-47c6-883a-56ac4d58dc67 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 1.681036 Oct 04 20:59:42.566796 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1735/3525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:40 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:42.869783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:42.871386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:42.910462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.916352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.931126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.935344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.936529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.937397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:43.636949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:43.684208 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c55ad98-af53-4151-9cde-f89a2eda8f66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1520 microversion: 2.1 time: 0.831227 Oct 04 20:59:43.692206 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1791/3526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:42 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1520 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:43.722175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:43.723488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:43.753078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.755516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.757659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:43.764914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.768476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.775099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.126251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0111419-c128-4da5-9382-9220b2755289 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] Calling method '.version_select at 0x7f54f5595d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.276198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0111419-c128-4da5-9382-9220b2755289 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748/defaults" status: 200 len: 371 microversion: 2.1 time: 0.853763 Oct 04 20:59:44.277208 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1736/3527] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:59:43 2022] GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748/defaults => generated 371 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:44.294437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.295977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:44.322085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.323081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.323877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.328495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.330826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.340765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.448010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:59:44.474946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:44.501439 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d518680-defd-43f5-bca0-a48524fde46a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 0.806949 Oct 04 20:59:44.503451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1792/3528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:43 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:44.525459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2010a30-442f-4b3c-b5d0-80c80b8295e6 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] Calling method '.version_select at 0x7f54f5f0eaf0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.737811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2010a30-442f-4b3c-b5d0-80c80b8295e6 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748" status: 200 len: 371 microversion: 2.1 time: 0.227325 Oct 04 20:59:44.746283 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1793/3529] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:59:44 2022] GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748 => generated 371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:44.779974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e18df40d-dddd-4e0d-8e2b-dd36521f77eb tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] Calling method '.version_select at 0x7f54fa6a04c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.979786 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e18df40d-dddd-4e0d-8e2b-dd36521f77eb tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748/defaults" status: 200 len: 371 microversion: 2.1 time: 0.211591 Oct 04 20:59:44.996052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1794/3530] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 20:59:44 2022] GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748/defaults => generated 371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:45.051997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0072cff9-e671-43a5-9c0e-b3513188d991 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] Calling method '.version_select at 0x7f54fa6b5ee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.125997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d618b2a-06e0-4d85-9c41-aa1589c95f7c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 204 len: 0 microversion: 2.1 time: 0.838105 Oct 04 20:59:45.127727 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1737/3531] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:59:44 2022] DELETE /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:59:45.157372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.158440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.195891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.198799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.199838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.210182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.214080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.216954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.252869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0072cff9-e671-43a5-9c0e-b3513188d991 tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748" status: 200 len: 371 microversion: 2.1 time: 0.227691 Oct 04 20:59:45.296637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1795/3532] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748 => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:45.321820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9360f9c9-1604-46a9-83e6-136d517a02ca tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] Calling method '.version_select at 0x7f54f63ae040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.540199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9360f9c9-1604-46a9-83e6-136d517a02ca tempest-QuotasTestJSON-1924239440 tempest-QuotasTestJSON-1924239440-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748?user_id=c61a669a71e84e9ea8b29f5435d43c99" status: 200 len: 371 microversion: 2.1 time: 0.239952 Oct 04 20:59:45.554296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1796/3533] 10.222.0.36 () {58 vars in 1323 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/os-quota-sets/73da7910f8944e88842ab7b0cbf4e748?user_id=c61a669a71e84e9ea8b29f5435d43c99 => generated 371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:45.565578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.565578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.622873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.628351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.628351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.628351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.635015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.636022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.210632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:46.251786 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2921c38-2551-4072-9992-0761a611a11f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1526 microversion: 2.1 time: 1.117151 Oct 04 20:59:46.254103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1738/3534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1526 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:46.462649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:46.503391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7db621b-4405-4584-a250-c6856dea9208 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 0.945777 Oct 04 20:59:46.506510 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1797/3535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:47.305663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.308224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.323595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.325764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.327294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.329093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.330383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.331649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.593326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.595971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.627188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.627188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.627188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.627188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.627931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.628237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.175495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:48.209951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68eb9d54-71b0-430e-84f0-1439259c75e6 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1526 microversion: 2.1 time: 0.911799 Oct 04 20:59:48.223383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1739/3536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:47 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1526 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:48.371929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:48.383142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9d055ff-20cd-46c4-8a47-49e2dd2cbf36 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 0.835153 Oct 04 20:59:48.384943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1798/3537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:47 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:49.022819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb2146-c731-45c2-8494-558834adbc61", "name": "network-vif-plugged", "status": "completed", "tag": "f66fc200-097a-4dbe-9462-a41240d23aa1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:49.078997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.080108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.080951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.184337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] Creating event network-vif-plugged:f66fc200-097a-4dbe-9462-a41240d23aa1 for instance 57eb2146-c731-45c2-8494-558834adbc61 on n-h1-851029-13 Oct 04 20:59:49.198258 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-49e9dae5-d9b7-4ab7-a665-9495501b81cf req-9c66f083-8a65-4d2c-a939-3321099788b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201511 Oct 04 20:59:49.203139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1740/3538] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:49.264148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:49.265425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:49.311922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.314126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.317397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.335452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.336440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.347776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.437929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:49.441491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:49.479679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.481041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.485904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.487642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.489405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.505604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:50.284611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:50.346207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97bb01be-51dd-4fc8-892f-0adb71af92d3 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1484 microversion: 2.1 time: 1.097596 Oct 04 20:59:50.354345 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1799/3539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:49 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1484 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:50.426430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775e43cf-d278-412c-9f4e-709466f67ba7", "name": "network-vif-deleted", "tag": "ad5ecf5a-53cf-4400-94ef-2ca6134a82b8"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:50.474735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:50.476282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:50.478169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:50.539319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] Creating event network-vif-deleted:ad5ecf5a-53cf-4400-94ef-2ca6134a82b8 for instance 775e43cf-d278-412c-9f4e-709466f67ba7 on n-h2-851029-13 Oct 04 20:59:50.564026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6a4dadc1-dce4-4da7-9be5-ae82e28f3bdd req-c45037a2-11e1-47b0-9001-c5abb68bb052 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186710 Oct 04 20:59:50.579226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1800/3540] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:51.206360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:51.249198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e6cb51f-1cde-4b6b-9c3e-2f7bf4eb4901 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1314 microversion: 2.1 time: 1.828180 Oct 04 20:59:51.256539 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1741/3541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:49 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1314 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:51.414176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:51.423186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:51.477574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:51.478851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:51.479958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.486853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:51.489473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:51.490854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.711175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:51.716934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:51.717838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.720967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lazy-loading 'fault' on Instance uuid 775e43cf-d278-412c-9f4e-709466f67ba7 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:52.314564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6607c7faa4e8d9745bbf05780e9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5439ddd7214e219e9b5f8ef1739b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:52.330843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:52.343461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:52.377146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 200 len: 1314 microversion: 2.1 time: 0.984135 Oct 04 20:59:52.383723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1801/3542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:51 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:52.393317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.396832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.405995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:52.405995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.405995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.409671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:52.508685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:53.091603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.093693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002419 Oct 04 20:59:53.094395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1802/3543] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:59:53.112047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.117601 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.005919 Oct 04 20:59:53.131558 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1803/3544] 10.222.0.36 () {54 vars in 1035 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/v2/ => generated 379 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 20:59:53.134332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.137078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003311 Oct 04 20:59:53.151900 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1804/3545] 10.222.0.36 () {54 vars in 1041 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/v2.1/ => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:53.159088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.161726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19f641b-d7a7-4f92-8feb-902c2d024659 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002807 Oct 04 20:59:53.177002 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1805/3546] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 04 20:59:53.434775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.440079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 775e43cf-d278-412c-9f4e-709466f67ba7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:53.445462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:53.467793 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f26776dc-3052-49b8-a926-f69cd0e95d7d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1501 microversion: 2.1 time: 1.167982 Oct 04 20:59:53.476681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.479255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.493747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.495932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.499479 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1742/3547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:52 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1501 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:53.521736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.522699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.538382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:53.543468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:53.587107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.588670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.589846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.593091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.597120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.598363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.631362 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 HTTP/1.1 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '775e43cf-d278-412c-9f4e-709466f67ba7'} Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.635384 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.644367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 775e43cf-d278-412c-9f4e-709466f67ba7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:53.647122 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dca73ec8-fa0d-43f5-ba97-977e6f22ce66 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7" status: 404 len: 111 microversion: 2.1 time: 0.219757 Oct 04 20:59:53.655697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1806/3548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/v2.1/servers/775e43cf-d278-412c-9f4e-709466f67ba7 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:53.676482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dbcb322f-56ab-4a1a-aa10-f7ef08632169 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54f62c9940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.701113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'flavor' on Instance uuid 57eb2146-c731-45c2-8494-558834adbc61 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:53.774417 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-dbcb322f-56ab-4a1a-aa10-f7ef08632169 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Image not found. Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dbcb322f-56ab-4a1a-aa10-f7ef08632169 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629 HTTP/1.1 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: exception: Image not found. Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '481c3304-8354-4aeb-9a73-e84f15878629'} Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 481c3304-8354-4aeb-9a73-e84f15878629 to delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 481c3304-8354-4aeb-9a73-e84f15878629 could not be found. Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.775219 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dbcb322f-56ab-4a1a-aa10-f7ef08632169 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Image not found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dbcb322f-56ab-4a1a-aa10-f7ef08632169 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629" status: 404 len: 62 microversion: 2.1 time: 0.114391 Oct 04 20:59:53.782283 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1807/3549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:53 2022] DELETE /compute/v2.1/images/481c3304-8354-4aeb-9a73-e84f15878629 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:59:53.813262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.815677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:53.852134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.860268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.860268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.860268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.868986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.870321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.902820 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 HTTP/1.1 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '504e21e9-8180-4152-bcd1-5eb1dbf83574'} Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:53.906612 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22919b20-825f-4212-ac19-fddb1073ca92 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 404 len: 111 microversion: 2.1 time: 0.118678 Oct 04 20:59:53.919322 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1808/3550] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 20:59:53 2022] DELETE /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:53.927467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.928888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 504e21e9-8180-4152-bcd1-5eb1dbf83574] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:53.942179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.943153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.944151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.945561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.946479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.947905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:54.013025 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 HTTP/1.1 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '504e21e9-8180-4152-bcd1-5eb1dbf83574'} Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:54.024109 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 504e21e9-8180-4152-bcd1-5eb1dbf83574 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:54.030411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ebe2b3c5-6862-48fe-905a-f34165b1851c tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574" status: 404 len: 111 microversion: 2.1 time: 0.109014 Oct 04 20:59:54.042768 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1809/3551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/v2.1/servers/504e21e9-8180-4152-bcd1-5eb1dbf83574 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:54.061532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a566b08-c823-4a73-9b29-91ec52d7207b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54f5f2f1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:54.297221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a566b08-c823-4a73-9b29-91ec52d7207b tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148804032" status: 202 len: 0 microversion: 2.1 time: 0.251883 Oct 04 20:59:54.304835 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1810/3552] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 20:59:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148804032 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:55.069486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1176aa25-69f4-4c15-bbe5-eb33e648e10e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61/action" status: 202 len: 0 microversion: 2.1 time: 1.538518 Oct 04 20:59:55.069486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1743/3553] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:53 2022] POST /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61/action => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:55.081751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:55.083609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:55.100731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:55.102123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:55.104155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:55.105971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:55.109532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:55.117005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:55.118267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:55.523101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:56.644988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:56.674394 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d714808-ecd8-41cf-bb81-dacf2b9fd0a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.602746 Oct 04 20:59:56.687408 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1811/3554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:55 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:57.751590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:57.755971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:57.795873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:57.809194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.811419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.812598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:57.818079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.819888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.821373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:58.976870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:59.016444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4e00dba-7e18-4043-9a38-a264c8a1eba2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.276425 Oct 04 20:59:59.021314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1744/3555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:57 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:59.677533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:59.680650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:59.708524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.710374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.711813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:59.713682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.714959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.715979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:00.082359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:00.083694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:00.116497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:00.117392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:00.118798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:00.120807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:00.122032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:00.123149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:01.326016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:01.348382 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb55f524-4eb8-4ef2-a0a3-6e3c034559a9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.675438 Oct 04 21:00:01.350748 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1812/3556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:59 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:01.828208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5483e691-0020-4a41-ad3f-b1d0a041cd1d tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Action: 'create', calling method: .version_select at 0x7f54f5dcb940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1919278993", "metadata": {"Type": "work"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:02.084163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:02.105190 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d836dfae-4a27-4488-8a9f-882ecae6da68 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 2.028104 Oct 04 21:00:02.110932 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1745/3557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:00 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:02.119643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30fb95f0-b4d2-42be-8276-c020d0b5be7f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '.version_select at 0x7f54f55b14c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:02.177178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-30fb95f0-b4d2-42be-8276-c020d0b5be7f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Image not found. Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30fb95f0-b4d2-42be-8276-c020d0b5be7f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/images/5106260d-6eda-4844-bcaa-9f4143b46c2f HTTP/1.1 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: exception: Image not found. Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '5106260d-6eda-4844-bcaa-9f4143b46c2f'} Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5106260d-6eda-4844-bcaa-9f4143b46c2f to delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5106260d-6eda-4844-bcaa-9f4143b46c2f could not be found. Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:02.184034 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 21:00:02.200203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:02.209279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30fb95f0-b4d2-42be-8276-c020d0b5be7f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Image not found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:02.209279 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30fb95f0-b4d2-42be-8276-c020d0b5be7f tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/images/5106260d-6eda-4844-bcaa-9f4143b46c2f" status: 404 len: 62 microversion: 2.1 time: 0.095582 Oct 04 21:00:02.214008 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1746/3558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:02 2022] DELETE /compute/v2.1/images/5106260d-6eda-4844-bcaa-9f4143b46c2f => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:00:02.233359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:02.238201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:02.264532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:02.269431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:02.271405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:02.276976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:02.278531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:02.283913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.316937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:03.334103 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-351ec6e4-6b2f-4891-8c5c-d52a3f292b90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.117455 Oct 04 21:00:03.354884 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1747/3559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:02 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:03.366330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:03.367290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:03.394335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.394335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.394335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.394335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.404369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.405278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.439027 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 HTTP/1.1 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35'} Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:00:03.442418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-966759f4-46cd-41c6-bccb-7bf0f3913308 tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 404 len: 111 microversion: 2.1 time: 0.107792 Oct 04 21:00:03.470811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1748/3560] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:00:03 2022] DELETE /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:00:03.478827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:03.479814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:03.494403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.495354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.496162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.497565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.498513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.499208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.694237 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5483e691-0020-4a41-ad3f-b1d0a041cd1d tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.340509 Oct 04 21:00:03.695935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1813/3561] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 4 21:00:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2344 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 21:00:03.707674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:03.709513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:03.721635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:03.726125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.727081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.728306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.729867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.730759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.731592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.524824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:04.557119 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22e94c14-c423-4cce-8328-b79e050fe249 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.858756 Oct 04 21:00:04.560197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:04.575451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1814/3562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:03 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:04.617172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:04.621943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] [instance: 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:04.628147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6363d659-5758-4948-878c-7fa189ca54cd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.164448 Oct 04 21:00:04.636270 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1749/3563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:03 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:04.646474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:04.647496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:04.648298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.649690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:04.650839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:04.658538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.664157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81d2f382-20ce-47b4-b38f-fc63575393a1 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f55861f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:04.721158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] HTTP exception thrown: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Request method failure captured: Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 HTTP/1.1 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ4APJ5cIU_GtScuLaj-Xnc4ncBH48hnQ9sNlckesAUVfhUfUq3kXp9LW_UEoiFrZDdqVZDVIFZGP5jaJ6L1IYCzOII94HXO0Et0h1CDcPhs7wZQQoyAcFG8HSdOXW_VT8t1PMNL5iR4_8_CUN1rEu0iGmlZkbGc0RaHC8k2OVHeYQ4 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae5439ddd7214e219e9b5f8ef1739b90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae5439ddd7214e219e9b5f8ef1739b90 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-508031589 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ac6607c7faa4e8d9745bbf05780e9d6 Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-508031589-project Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '89ca1b3f-fcfe-48a5-97e8-0ed20b901e35'} Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:00:04.737156 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. Oct 04 21:00:04.750731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:00:04.760185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] Returning 404 to user: Instance 89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:04.765575 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e0f71cd-ebd5-422c-a0cb-a24547c2798e tempest-ImagesOneServerNegativeTestJSON-508031589 tempest-ImagesOneServerNegativeTestJSON-508031589-project] 10.222.0.36 "GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35" status: 404 len: 111 microversion: 2.1 time: 0.188044 Oct 04 21:00:04.769759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1815/3564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:04 2022] GET /compute/v2.1/servers/89ca1b3f-fcfe-48a5-97e8-0ed20b901e35 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:00:04.800217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-34347091"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:04.810754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:04.841366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:04.841366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:04.843875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.848675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:04.849726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:04.850873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.935186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81d2f382-20ce-47b4-b38f-fc63575393a1 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.285489 Oct 04 21:00:04.936760 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1750/3565] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:04 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:06.025643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:06.029515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9df68cd-2d95-4bdb-a60b-5ff289532368 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 1.251129 Oct 04 21:00:06.030778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:06.032861 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1816/3566] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:04 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:00:06.081470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f86e3786-8adc-4c70-b97d-0a7884e39eb7 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54fa655430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:06.084454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:06.088226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:06.092211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:06.097322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:06.101977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:06.103500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:06.380399 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f86e3786-8adc-4c70-b97d-0a7884e39eb7 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.344162 Oct 04 21:00:06.381543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1817/3567] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:06 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:07.405632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-875a17b1-4bc4-4cc2-a668-88ffc27d591f tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f5f28310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:07.565260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:07.593205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-875a17b1-4bc4-4cc2-a668-88ffc27d591f tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 354 microversion: 2.1 time: 0.194409 Oct 04 21:00:07.598123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c04335b-9aa2-4091-a6aa-b87d29a74015 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.917028 Oct 04 21:00:07.605731 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1751/3568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:05 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:07.607995 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1818/3569] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:07 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:07.623692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-37344e78-8ebf-4f7f-8b52-40fe150d37c0 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f55b18b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:07.796182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-37344e78-8ebf-4f7f-8b52-40fe150d37c0 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 354 microversion: 2.1 time: 0.169656 Oct 04 21:00:07.796182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1752/3570] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:07 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:00:07.829314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fd2401c-efc7-4875-9508-b07e7c4889a7 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54fa655b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:08.288108 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fd2401c-efc7-4875-9508-b07e7c4889a7 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 202 len: 0 microversion: 2.1 time: 0.475889 Oct 04 21:00:08.289206 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1819/3571] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:00:07 2022] DELETE /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:00:08.301336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cca1ebe0-a12e-4f56-82f0-ed1da7f52d46 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f5731d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:08.456771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cca1ebe0-a12e-4f56-82f0-ed1da7f52d46 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.149939 Oct 04 21:00:08.456771 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1753/3572] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:08 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:08.666586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:08.671757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:08.705639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:08.706580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:08.707669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:08.712935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:08.714338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:08.715839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:09.476946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aec0eefe-e068-4d02-b357-d10e7fcfc16c tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f5f9a820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:09.683149 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aec0eefe-e068-4d02-b357-d10e7fcfc16c tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.217991 Oct 04 21:00:09.696012 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1754/3573] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:09 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:10.444698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-plugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:10.495892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:10.514719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:10.518388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:10.576235 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] Creating event network-vif-plugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:00:10.588690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-89e9fff3-3db6-4f18-b3a5-95c64ae4d368 req-67d11b71-888f-4c45-bc98-92693d4c9775 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151519 Oct 04 21:00:10.596617 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1755/3574] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:00:10.710901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2662a147-b99a-490d-bb34-f238f2d177f3 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f55d3160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:10.881812 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2662a147-b99a-490d-bb34-f238f2d177f3 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.179932 Oct 04 21:00:10.895406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1756/3575] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:10 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:10.987683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:11.047851 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51e36a5d-9e43-49d6-8392-e1a217253c12 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 2.387796 Oct 04 21:00:11.058616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1820/3576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:08 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:11.712735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Action: 'create', calling method: .version_select at 0x7f54f5732b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:11.832131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Getting quotas for project 97b397398af544269b6b54dc6277bdec. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:11.849735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Getting quotas for user 47cc06a2a89d4ef08c86cffbb572cbc4 and project 97b397398af544269b6b54dc6277bdec. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:11.911766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a89d973d-1dbb-496e-8e70-852b46ab3c37 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54fa4d5b80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.164899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Getting quotas for project 97b397398af544269b6b54dc6277bdec. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:12.196784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Getting quotas for user 47cc06a2a89d4ef08c86cffbb572cbc4 and project 97b397398af544269b6b54dc6277bdec. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:12.222874 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a89d973d-1dbb-496e-8e70-852b46ab3c37 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.323138 Oct 04 21:00:12.224349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1821/3577] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:11 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:00:12.256293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.262142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:12.297193 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78f61728-61e0-408c-96fa-4b8d33e00b85 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.816974 Oct 04 21:00:12.305659 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1757/3578] 10.222.0.36 () {62 vars in 1214 bytes} [Tue Oct 4 21:00:11 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:00:12.310857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:12.312708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:12.315924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:12.320105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:12.332285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:12.333079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:12.345670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96d2d420-b98d-49a3-8f9d-b1ee5ae63e34 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.437282 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96d2d420-b98d-49a3-8f9d-b1ee5ae63e34 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.126961 Oct 04 21:00:12.451451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1758/3579] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 4 21:00:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:00:12.470058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d5f5de0-d8cb-4d50-b88d-150a01787dc0 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.507597 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d5f5de0-d8cb-4d50-b88d-150a01787dc0 tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9" status: 200 len: 235 microversion: 2.64 time: 0.054299 Oct 04 21:00:12.509519 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1759/3580] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 4 21:00:12 2022] GET /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9 => generated 235 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:00:12.529635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-705603db-ee10-4edd-9826-72d448ddafcb tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.727655 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-705603db-ee10-4edd-9826-72d448ddafcb tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9" status: 204 len: 0 microversion: 2.64 time: 0.205969 Oct 04 21:00:12.729406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1760/3581] 10.222.0.36 () {60 vars in 1307 bytes} [Tue Oct 4 21:00:12 2022] DELETE /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:00:12.763629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c624e690-a1d3-42f0-b940-3def0e62efab tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.796496 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c624e690-a1d3-42f0-b940-3def0e62efab tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] HTTP exception thrown: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c624e690-a1d3-42f0-b940-3def0e62efab tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Request method failure captured: Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9 HTTP/1.1 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ7by2i8SJN97KJFa4Hsi1eLdk1chFGzgkW7gRhnIJ0xOEKBwfUF1sO5qk4fmA8336FMf7xMmN6T1KA--Zt9cCmnr7r57PFqGi4CZsF8WI0N0gvqnXoGBPMRDS34CWO4jk41o7khrk4KUafJUGZV5VWDcrjW0Z_OnE71qHgAgQKCgcQ Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 97b397398af544269b6b54dc6277bdec Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerGroup264TestJSON-1638089010 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97b397398af544269b6b54dc6277bdec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/97b397398af544269b6b54dc6277bdec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/97b397398af544269b6b54dc6277bdec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_97b397398af544269b6b54dc6277bdec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerGroup264TestJSON-1638089010 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 97b397398af544269b6b54dc6277bdec Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1638089010 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerGroup264TestJSON-1638089010-project Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 47cc06a2a89d4ef08c86cffbb572cbc4 Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerGroup264TestJSON-1638089010-project Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '93918e57-6236-4e5d-8f8f-31c2f53fb4f9'} Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:12.812771 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c624e690-a1d3-42f0-b940-3def0e62efab tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] Returning 404 to user: Instance group 93918e57-6236-4e5d-8f8f-31c2f53fb4f9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c624e690-a1d3-42f0-b940-3def0e62efab tempest-ServerGroup264TestJSON-1638089010 tempest-ServerGroup264TestJSON-1638089010-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9" status: 404 len: 117 microversion: 2.64 time: 0.079791 Oct 04 21:00:12.831715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1761/3582] 10.222.0.36 () {60 vars in 1307 bytes} [Tue Oct 4 21:00:12 2022] DELETE /compute/v2.1/os-server-groups/93918e57-6236-4e5d-8f8f-31c2f53fb4f9 => generated 117 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:00:13.253908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8992c8b5-96f9-409c-9844-7c3f23061dce tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54fa5a0f70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:13.492207 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8992c8b5-96f9-409c-9844-7c3f23061dce tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.249474 Oct 04 21:00:13.494076 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1762/3583] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:13 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:00:13.877990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:13.934340 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba242ae4-7912-44e0-909f-135e7de30f0c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.707111 Oct 04 21:00:13.947867 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1822/3584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:12 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:14.521305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9d17b16-aa2e-40de-b981-06602acfe44c tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f6263670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:14.727248 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9d17b16-aa2e-40de-b981-06602acfe44c tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 200 len: 353 microversion: 2.1 time: 0.215859 Oct 04 21:00:14.729119 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1763/3585] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:14 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:15.002981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:15.005360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:15.024983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:15.039589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:15.041076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:15.047809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:15.049518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:15.051057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:15.755843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e92f009-1328-4d93-8cf5-5be21cc4c9c8 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Calling method '.version_select at 0x7f54f5554b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:15.912830 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2e92f009-1328-4d93-8cf5-5be21cc4c9c8 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] HTTP exception thrown: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e92f009-1328-4d93-8cf5-5be21cc4c9c8 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Request method failure captured: Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f HTTP/1.1 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ7Q2aGvV1XGuiE4dMu2DNqUPmkzf1M21JO1a-QKpDPyRYJCnLeHo-MdW4fcZ9PVCJyo4Z3DUNsd4HfYMLqQoiz2nzR-md3zyBx3lK_6r8crnhqoHhpn4-ECs_sKMAXdg7yqyKGvLzWjiD8mOrciW7ZcXJlsFk4I2pXSUv0B38ifQ2U Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: a563cf1032c24c28973e52039d168cd1 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesGetTestJSON-1085156298 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a563cf1032c24c28973e52039d168cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a563cf1032c24c28973e52039d168cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a563cf1032c24c28973e52039d168cd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a563cf1032c24c28973e52039d168cd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesGetTestJSON-1085156298 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: a563cf1032c24c28973e52039d168cd1 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesGetTestJSON-1085156298 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesGetTestJSON-1085156298-project Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5d43ba1da9d44835ac4cee7fe7d69927 Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesGetTestJSON-1085156298-project Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '0a4e36ed-078f-4f28-827a-9a936aeca46f'} Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. (HTTP 404) (Request-ID: req-a134052a-41b2-4fe3-bb47-15870ef5dff8) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:00:15.918542 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:00:15.931291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e92f009-1328-4d93-8cf5-5be21cc4c9c8 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] Returning 404 to user: Volume 0a4e36ed-078f-4f28-827a-9a936aeca46f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:15.945691 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e92f009-1328-4d93-8cf5-5be21cc4c9c8 tempest-VolumesGetTestJSON-1085156298 tempest-VolumesGetTestJSON-1085156298-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f" status: 404 len: 109 microversion: 2.1 time: 0.198631 Oct 04 21:00:15.952142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1764/3586] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:15 2022] GET /compute/v2.1/os-volumes/0a4e36ed-078f-4f28-827a-9a936aeca46f => generated 109 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:00:16.521404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:16.656337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-605d47f9-c377-44d9-ba45-9adefc5ca2ac tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.661399 Oct 04 21:00:16.701366 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1823/3587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:14 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:17.712942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:17.717870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:17.762917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:17.779822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:17.785695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:17.790277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:17.791833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:17.793135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:18.990899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:19.023866 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04bac95f-7d10-447f-b58c-a8c29c92b973 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.319906 Oct 04 21:00:19.034641 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1765/3588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:17 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:20.086345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:20.090562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:20.142716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:20.152694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:20.155717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:20.163628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:20.169318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:20.183161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:21.858558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:21.903389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47271694-2b4b-4965-b16c-ea9c0c86ff5b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1507 microversion: 2.1 time: 1.835767 Oct 04 21:00:21.905227 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1824/3589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:20 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1507 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:22.957852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:22.966011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:23.012476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:23.019563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:23.030337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:23.034868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:23.036361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:23.037236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:23.044474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:23.288808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:24.087948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:24.167251 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23ff3783-c329-45a2-a5f9-4d5aa62f15b0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1528 microversion: 2.1 time: 1.204961 Oct 04 21:00:24.182236 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1766/3590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:22 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1528 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:25.214203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:25.217640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:25.280895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.289598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.290033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.291239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.299387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.302514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.493670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:26.552860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.589455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02acba37-69c0-47b4-a158-385e9876f689 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1528 microversion: 2.1 time: 1.382764 Oct 04 21:00:26.599143 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1825/3591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:25 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1528 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:27.653523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:27.661965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:27.712798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.717904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.719825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:27.728216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.729510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.731002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.554205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.615511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2edd7e13-ea4c-4d74-95fc-1599ca2af28f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.970321 Oct 04 21:00:28.633622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1767/3592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:27 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:29.685120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:29.700744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:29.728963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.738885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.747434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:29.750545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.751997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.753170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.201886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb2146-c731-45c2-8494-558834adbc61", "name": "network-vif-plugged", "status": "completed", "tag": "f66fc200-097a-4dbe-9462-a41240d23aa1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:32.286703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:32.301328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:32.321405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:32.327014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.409752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] Creating event network-vif-plugged:f66fc200-097a-4dbe-9462-a41240d23aa1 for instance 57eb2146-c731-45c2-8494-558834adbc61 on n-h1-851029-13 Oct 04 21:00:32.443791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c78e8025-df52-4fe7-b422-e8409f202960 req-77499d13-f63e-41d0-a6b8-dbf81cc82c4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255170 Oct 04 21:00:32.447813 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1768/3593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:32.949834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:33.076184 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1be10468-c0f6-40b4-b5c8-7c04ad92d58d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 3.388665 Oct 04 21:00:33.083419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1826/3594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:29 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 3409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:34.136569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:34.159557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:34.209291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:34.216414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:34.231511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:34.234860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:34.236657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:34.237918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:34.963445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:34.990934 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b14e44b5-19f0-4b2c-b965-2a9585bb006a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.862649 Oct 04 21:00:34.993120 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1769/3595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:34 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:35.648272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcc33697-527f-4a10-9369-aa481d3a82de tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54fa64b1f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:35.967862 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcc33697-527f-4a10-9369-aa481d3a82de tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/73427151-590e-4594-868b-283bdbd13a3b" status: 200 len: 351 microversion: 2.1 time: 0.341715 Oct 04 21:00:35.970423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1827/3596] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:35 2022] GET /compute/v2.1/os-volumes/73427151-590e-4594-868b-283bdbd13a3b => generated 351 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:36.043810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:36.055592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:36.079430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.083750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.086181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.092606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.094333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.098762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.769768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:37.812055 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e49fc5cc-fe75-44bf-8628-e7e458c9496e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.767530 Oct 04 21:00:37.821798 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1770/3597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:36 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:38.872708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:38.885025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:38.905054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=18 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:38.910094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.911835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.914931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:38.917079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.919023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.921299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:40.253391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:40.307937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-457ea5ba-d087-4429-b60a-92790efca415 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.438910 Oct 04 21:00:40.353323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1828/3598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:38 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:41.382028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:41.382971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:41.466777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:41.494488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:41.500525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:41.504109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:41.518718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:41.521307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.920425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2dfe0f15-b2cc-434b-9d0e-a6536d35a50d tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f5e4a5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:43.768558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2dfe0f15-b2cc-434b-9d0e-a6536d35a50d tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f9c5d31e-d477-442f-b8cf-91dfeaf30101" status: 200 len: 350 microversion: 2.1 time: 0.856055 Oct 04 21:00:43.769664 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1829/3599] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:42 2022] GET /compute/v2.1/os-volumes/f9c5d31e-d477-442f-b8cf-91dfeaf30101 => generated 350 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:44.028340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:44.052102 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c8ca3836-c694-4dd8-b23b-fb1f7e927433 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 2.690718 Oct 04 21:00:44.054620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1771/3600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:41 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:45.100794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:45.117523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:45.173355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:45.174616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:45.175658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:45.177201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:45.178290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:45.180504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:45.847642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:45.881296 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-887be7fc-8138-42b8-90c0-6530fb870940 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.781384 Oct 04 21:00:45.892798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1830/3601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:45 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:46.938537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:46.946394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:46.969622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.976114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.978879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.982445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.984220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.985222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:47.850350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:47.906506 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c79198e2-2867-4d54-ad2e-808357c1e511 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.977036 Oct 04 21:00:47.929659 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1772/3602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:46 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:48.970064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:48.976164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:49.011962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:49.017319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:49.019228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:49.022306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:49.027488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:49.037488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:49.883686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:49.921001 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5f136aa-ecdc-4e4f-9565-5a4273ca9aa2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.961096 Oct 04 21:00:49.968191 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1831/3603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:48 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:50.323073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e21d555-29bb-4a73-88dc-471fe60aabf3 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f555c280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.581637 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e21d555-29bb-4a73-88dc-471fe60aabf3 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2630a9cb-8d5f-4cd6-842c-7e291514587f" status: 200 len: 351 microversion: 2.1 time: 0.273123 Oct 04 21:00:50.587073 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1773/3604] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:50 2022] GET /compute/v2.1/os-volumes/2630a9cb-8d5f-4cd6-842c-7e291514587f => generated 351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:50.625517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40558068-27c5-44e6-84be-06360b0916ce tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54fa6a00d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.979887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.979887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:51.012993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:51.015618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:51.018071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:51.021253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:51.025391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:51.026218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:51.083737 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40558068-27c5-44e6-84be-06360b0916ce tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.445597 Oct 04 21:00:51.083737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1832/3605] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 4 21:00:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:51.111348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79e6edd3-d618-4f7b-9710-f2fc017e2da2 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54fa655280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:51.554047 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79e6edd3-d618-4f7b-9710-f2fc017e2da2 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.455137 Oct 04 21:00:51.556001 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1833/3606] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 4 21:00:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:51.590432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0828eaf7-aff6-45ed-8566-ef726d5afcf1 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f5e15dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:52.097697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0828eaf7-aff6-45ed-8566-ef726d5afcf1 tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.518369 Oct 04 21:00:52.100343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1834/3607] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 4 21:00:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:52.135218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca7ef5f5-7a0c-4c01-8c40-80432c8a9e8b tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54fa6a0160>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:52.266347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.329923 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c527594-d749-4a87-8d95-3e2099fd1ea0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.363960 Oct 04 21:00:52.334773 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1774/3608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:50 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:52.819716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca7ef5f5-7a0c-4c01-8c40-80432c8a9e8b tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.697209 Oct 04 21:00:52.821813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1835/3609] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 21:00:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:52.860537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3728f31-6ebc-463c-965a-2388bf0d02ed tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f555c8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:53.382269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:53.386141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:53.410320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3728f31-6ebc-463c-965a-2388bf0d02ed tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.551745 Oct 04 21:00:53.414192 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1775/3610] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 21:00:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:53.432203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:53.433637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:53.434391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:53.438071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:53.439368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:53.440549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:53.447353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-854f249d-a321-4b79-888b-8c3c8599eb4c tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f55543a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:53.918750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-854f249d-a321-4b79-888b-8c3c8599eb4c tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.475926 Oct 04 21:00:53.918750 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1776/3611] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 21:00:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:53.950844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0345893b-9175-4f63-9d53-e4265ef36aba tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f5554310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:54.367299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0345893b-9175-4f63-9d53-e4265ef36aba tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.429394 Oct 04 21:00:54.368404 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1777/3612] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Oct 4 21:00:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:00:54.401282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:54.427975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60088217-b810-48c3-8e4a-b36f2f9040ca tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] Calling method '.version_select at 0x7f54f555cf70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:54.495487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9988b923-d18b-4998-9e70-13dae5a07361 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.092563 Oct 04 21:00:54.513611 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1836/3613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:53 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:54.982173 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60088217-b810-48c3-8e4a-b36f2f9040ca tempest-VolumesTestJSON-1670297562 tempest-VolumesTestJSON-1670297562-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.577155 Oct 04 21:00:54.982781 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1778/3614] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 21:00:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:55.570479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:55.577206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:55.601454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.605727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.606708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.610693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.615937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.616780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:56.471468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:56.509192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=40 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:56.525563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce24f890-aeea-4c4e-a794-67330bbe63dc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.956363 Oct 04 21:00:56.527983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1837/3615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:55 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:57.584275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:57.586036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:57.636684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.637582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.648739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.655223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.660628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.666231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.710538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=44 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:58.684274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:58.718444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57f1b295-ee96-4595-a025-f96e199ce7cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.135798 Oct 04 21:00:58.787841 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1779/3616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:57 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:59.786970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:59.790962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:59.834156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.836527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.841642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:59.845950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.848196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.849358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:00.360560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:00.381943 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a301b757-5a30-4b23-81a2-160d5b711559 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.607945 Oct 04 21:01:00.384271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1838/3617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:59 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:01.436936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:01.440231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:01.467477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:01.479444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:01.481169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:01.482784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:01.486574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:01.487720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.609547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:02.664073 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9066402d-51b2-48cd-94d5-0f1b014d5819 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.236406 Oct 04 21:01:02.665139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1780/3618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:01 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:03.042226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:03.044487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:03.087865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.089321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.090754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.092424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.093628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.094837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.724017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:03.727187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:03.778376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.787663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.789133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.790851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.792752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.808429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:05.235583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.278216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6a34f9e-efec-4fb1-bda2-643cb0027704 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.561008 Oct 04 21:01:05.292752 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1781/3619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:03 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:06.176067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:06.212897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84b8b083-365c-4248-b417-3cc453b143c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 3.174141 Oct 04 21:01:06.212897 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1839/3620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:03 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:06.333897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:06.344609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:06.387626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:06.401126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.405546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.407486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:06.416466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.422296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.423688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.261276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:07.267269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:07.296921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:07.300550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:07.305229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.307374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:07.312739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:07.316410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.613915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.648335 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3782984f-a0bc-4309-9ede-8ba36ef31998 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.325266 Oct 04 21:01:07.654129 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1782/3621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:06 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:08.698138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:08.699211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:08.752067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.772753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.775852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.778029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.783988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.785164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:10.491320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:10.519616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-952f8e75-9509-458a-95a6-a306f73a7abe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 3.267847 Oct 04 21:01:10.521999 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1840/3622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 3272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:10.544006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:10.581686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:10.623800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:10.625015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:10.631458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:10.753421 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] Creating event network-vif-unplugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:01:10.774933 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-99c160fb-9ad6-475a-ada4-6baba6955539 req-a1a3d3ed-c558-4e17-b60a-bb310a6cea16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.249647 Oct 04 21:01:10.777066 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1841/3623] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:10.793113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-248560349"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:10.800001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:10.830280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:10.832137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:10.833425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:10.835740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:10.838222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:10.840378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.899681 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bb3fadb-680a-419c-abaf-c569b7636d84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 1.114020 Oct 04 21:01:11.902336 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1842/3624] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:10 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:01:12.143556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:12.205252 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ef1c0a2-a84c-4e07-b5e5-30f291829c4c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 3.514154 Oct 04 21:01:12.217859 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1783/3625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:08 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 3528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:13.298013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:13.305081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:13.393819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.399725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.401973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:13.408060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.413592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.413592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:14.423412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:14.480459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92e48b5f-b65a-4ac8-bbc0-b8a2bbc4e969 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.205757 Oct 04 21:01:14.484883 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1843/3626] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:13 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:15.529602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:15.534165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:15.575632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:15.578054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:15.587984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:15.594373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:15.595696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:15.598022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:17.403607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:17.455919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-899530ff-f335-49e4-a417-118f73271dc3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.933176 Oct 04 21:01:17.460094 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1784/3627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:15 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:18.509396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:18.513490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:18.580140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.583842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.589849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.623569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.626976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.632439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:20.373655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:20.440876 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22ed9e62-e758-491a-8828-5fa9a00e3465 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.937970 Oct 04 21:01:20.491892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1844/3628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:18 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:20.749825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Calling method '.version_select at 0x7f54f556b1f0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:20.967953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG neutronclient.v2_0.client [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist", "detail": ""}} {{(pid=123542) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:01:20.971185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.security_group_api [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Neutron security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f not found {{(pid=123542) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:01:20.972631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] HTTP exception thrown: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.972631 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Request method failure captured: Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-security-groups/b4925a1c-3a5e-4136-9901-2c4c17f93f9f HTTP/1.1 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8f9tg5QxLIK8uZvO2qJzD3FFdNw9u2kgSp-NPhQCP3nOWrZP2s0hKKpBvLLGCntavyAb0ZlusS2Lc7RjCCGLvzd4Rapcud4D8pTqZ-ViIB7f9sMDiALEqKtpQlsrh3FrztYMkvRPw3WWiQZIvrfmnw5Ssm02HU7apJl15IfenEybk Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d605e359171344deacb9dadd05d31a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d605e359171344deacb9dadd05d31a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d9e61562b0f84c059e59d988e04f5af8 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: exception: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b4925a1c-3a5e-4136-9901-2c4c17f93f9f'} Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:01:20.977226 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Returning 404 to user: Security group b4925a1c-3a5e-4136-9901-2c4c17f93f9f does not exist Oct 04 21:01:20.990911 n-d-851029-13 devstack@n-api.service[123542]: Neutron server returns request_ids: ['req-532ae7a9-b950-4c3b-950d-7a0467877956'] {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:21.004481 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-12bf127d-616e-49c2-aa12-d65f06359ba5 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b4925a1c-3a5e-4136-9901-2c4c17f93f9f" status: 404 len: 194 microversion: 2.1 time: 1.220786 Oct 04 21:01:21.004481 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1785/3629] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 21:01:19 2022] DELETE /compute/v2.1/os-security-groups/b4925a1c-3a5e-4136-9901-2c4c17f93f9f => generated 194 bytes in 1226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:21.024590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8183b801-5681-4833-8e48-af1389de29d2 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013420 Oct 04 21:01:21.030254 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1845/3630] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 4 21:01:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:01:21.063843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e50adfb2-c58e-40ba-ac1d-8399e2cf2842 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Calling method '.version_select at 0x7f54f556bca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:21.516345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:21.520194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:21.586493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.589524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.590515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:21.600877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.608745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.612319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:22.945209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:23.000256 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e407777-9a17-4e95-8ace-bf01fdacdbb9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.508662 Oct 04 21:01:23.004177 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1846/3631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:21 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:23.127516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e50adfb2-c58e-40ba-ac1d-8399e2cf2842 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.083825 Oct 04 21:01:23.129043 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1786/3632] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 21:01:21 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:23.161421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Calling method '.version_select at 0x7f54f5dcb5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:24.082116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:24.096135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:24.163330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:24.166070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.168141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.191431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:24.198717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.207181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Request method failure captured: Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-security-groups/73ef1458-318c-4bb8-8e76-a4bda49ba299 HTTP/1.1 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ8f9tg5QxLIK8uZvO2qJzD3FFdNw9u2kgSp-NPhQCP3nOWrZP2s0hKKpBvLLGCntavyAb0ZlusS2Lc7RjCCGLvzd4Rapcud4D8pTqZ-ViIB7f9sMDiALEqKtpQlsrh3FrztYMkvRPw3WWiQZIvrfmnw5Ssm02HU7apJl15IfenEybk Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d605e359171344deacb9dadd05d31a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d605e359171344deacb9dadd05d31a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d9e61562b0f84c059e59d988e04f5af8 Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: exception: Insufficient rights for removing default security group. Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '73ef1458-318c-4bb8-8e76-a4bda49ba299'} Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.456936 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-75e8a2a4-e105-4f80-81dc-8e6893d8c47f'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:24.469756 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9260e6a3-0f1a-4e90-8416-8defdb09d9f6 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/73ef1458-318c-4bb8-8e76-a4bda49ba299" status: 400 len: 182 microversion: 2.1 time: 1.298050 Oct 04 21:01:24.477809 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1847/3633] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 21:01:23 2022] DELETE /compute/v2.1/os-security-groups/73ef1458-318c-4bb8-8e76-a4bda49ba299 => generated 182 bytes in 1327 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:01:24.510880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Calling method '.version_select at 0x7f54f5df8280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:24.663540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:01:24.665364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Neutron security group 114b30a6-905a-439a-a78c-618ed3db4bd2 not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:01:24.667589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] HTTP exception thrown: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.667589 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Request method failure captured: Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-security-groups/114b30a6-905a-439a-a78c-618ed3db4bd2 HTTP/1.1 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ8f9tg5QxLIK8uZvO2qJzD3FFdNw9u2kgSp-NPhQCP3nOWrZP2s0hKKpBvLLGCntavyAb0ZlusS2Lc7RjCCGLvzd4Rapcud4D8pTqZ-ViIB7f9sMDiALEqKtpQlsrh3FrztYMkvRPw3WWiQZIvrfmnw5Ssm02HU7apJl15IfenEybk Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d605e359171344deacb9dadd05d31a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d605e359171344deacb9dadd05d31a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d9e61562b0f84c059e59d988e04f5af8 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '114b30a6-905a-439a-a78c-618ed3db4bd2'} Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:01:24.672696 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] Oct 04 21:01:24.678884 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:24.695761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Returning 404 to user: Security group 114b30a6-905a-439a-a78c-618ed3db4bd2 does not exist Oct 04 21:01:24.695761 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-3f1bf4ac-36d2-4c56-a491-852169ad72cf'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:24.698300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-080bcdbc-9365-4ce1-a26a-5036db62eb1e tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/114b30a6-905a-439a-a78c-618ed3db4bd2" status: 404 len: 194 microversion: 2.1 time: 0.204276 Oct 04 21:01:24.712541 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1848/3634] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 21:01:24 2022] GET /compute/v2.1/os-security-groups/114b30a6-905a-439a-a78c-618ed3db4bd2 => generated 194 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:24.733542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Action: 'update', calling method: .version_select at 0x7f54f5f289d0>, body: {"security_group": {"name": "tempest-sg-1364660734", "description": "tempest-description-1743468080"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:25.218297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG neutronclient.v2_0.client [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist", "detail": ""}} {{(pid=123541) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 21:01:25.220643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.security_group_api [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Neutron security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 not found {{(pid=123541) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 21:01:25.221712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] HTTP exception thrown: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.221712 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Request method failure captured: Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: request: PUT /compute/v2.1/os-security-groups/52ada7f7-6c02-49d7-98ae-6c709017ff75 HTTP/1.1 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 102 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ8f9tg5QxLIK8uZvO2qJzD3FFdNw9u2kgSp-NPhQCP3nOWrZP2s0hKKpBvLLGCntavyAb0ZlusS2Lc7RjCCGLvzd4Rapcud4D8pTqZ-ViIB7f9sMDiALEqKtpQlsrh3FrztYMkvRPw3WWiQZIvrfmnw5Ssm02HU7apJl15IfenEybk Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d605e359171344deacb9dadd05d31a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d605e359171344deacb9dadd05d31a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d605e359171344deacb9dadd05d31a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: d605e359171344deacb9dadd05d31a89 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-924802713 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d9e61562b0f84c059e59d988e04f5af8 Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-924802713-project Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: {"security_group": {"name": "tempest-sg-1364660734", "description": "tempest-description-1743468080"}} Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: exception: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '52ada7f7-6c02-49d7-98ae-6c709017ff75', 'body': {'security_group': {'name': 'tempest-sg-1364660734', 'description': 'tempest-description-1743468080'}}} Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 21:01:25.225768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] Oct 04 21:01:25.231710 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.254850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] Returning 404 to user: Security group 52ada7f7-6c02-49d7-98ae-6c709017ff75 does not exist Oct 04 21:01:25.254850 n-d-851029-13 devstack@n-api.service[123541]: Neutron server returns request_ids: ['req-9929958f-6125-43cc-894e-aae9fb5019f4'] {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:25.254850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e09edf41-bc95-488c-b78b-c7454b363134 tempest-SecurityGroupsNegativeTestJSON-924802713 tempest-SecurityGroupsNegativeTestJSON-924802713-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/52ada7f7-6c02-49d7-98ae-6c709017ff75" status: 404 len: 194 microversion: 2.1 time: 0.517886 Oct 04 21:01:25.254850 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1849/3635] 10.222.0.36 () {60 vars in 1290 bytes} [Tue Oct 4 21:01:24 2022] PUT /compute/v2.1/os-security-groups/52ada7f7-6c02-49d7-98ae-6c709017ff75 => generated 194 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:26.227038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:26.264532 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60514144-e801-4e96-8958-a415e54c2d56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 2.213576 Oct 04 21:01:26.272018 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1787/3636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:24 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:27.320641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:27.321852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:27.438491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:27.439292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:27.440140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:27.442543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:27.482018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:27.501419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.613572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-plugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:28.668817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.669509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.673816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.699652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:28.771459 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] Creating event network-vif-plugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:01:28.794575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9a4ca34f-1d0b-44d4-871f-e2a5bee546b4 req-ed593771-304d-44e0-9576-0c86bb7b74a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190025 Oct 04 21:01:28.823019 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1788/3637] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:01:31.099453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:31.107501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:31.182129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a811d397-abc2-4520-84b6-e5ffc161dfc5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 3.859938 Oct 04 21:01:31.201147 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1850/3638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:27 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 3889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:32.242683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:32.249191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:32.295216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.296565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.315459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.325397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.331946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.333112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:34.380432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:34.432746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d875a219-2495-46c2-a60d-b22c93b1f80f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 2.196471 Oct 04 21:01:34.466702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1789/3639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:32 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:35.495685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:35.512889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:35.566253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:35.592091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:35.592843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:35.594118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:35.595724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:35.596518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:37.748051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:37.794342 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81e2b132-5209-4105-a2cc-a70f79e1a5bd tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 2.304407 Oct 04 21:01:37.798820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1851/3640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:35 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:38.313307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1080182170", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:38.379446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:38.844854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:38.850940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:38.900053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.905915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.911896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:38.920298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.921889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.926311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:40.481923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:40.513487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f600eec-a7b9-4316-8233-8010d8a0ec60 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.676657 Oct 04 21:01:40.519118 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1852/3641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:38 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:41.566369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:41.567617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:41.583543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:41.617666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:41.627858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:41.628812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:41.632511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:41.639825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:41.641032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:44.331792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:44.400321 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4ed3421-5268-4147-8de4-0af4e77e3128 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 2.841682 Oct 04 21:01:44.403307 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1853/3642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:41 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:44.421981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:45.455348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:45.461162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:45.528078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:45.538324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:45.540792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:45.581371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:45.601340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.060s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:45.604691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:46.618283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:46.656391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a43e30db-1c3b-4db8-9623-88234f7089d9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.213796 Oct 04 21:01:46.675288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1854/3643] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:45 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:47.738885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:47.740183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:47.822202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.823222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.824138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:47.839261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.840290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.841315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:48.484522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:48.953180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:49.006013 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32648774-00eb-4870-8faf-8ea2fc665b54 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.282536 Oct 04 21:01:49.010939 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1855/3644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:47 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:50.067314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:50.070340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:50.087471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:50.091217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:50.098927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:50.098927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:50.098927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:50.098927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:51.668308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:51.689014 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-295b5a60-681c-4593-9aec-50563d8f374b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.632892 Oct 04 21:01:51.716539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1856/3645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:50 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:52.741081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:52.742737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:52.767698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:52.768943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:52.769965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:52.772286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:52.773489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:52.776614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:53.911445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:53.946818 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0115176-c3cb-4ac8-bc30-16da2df4fd4a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 1.209469 Oct 04 21:01:53.953248 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1857/3646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:52 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:55.017499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:55.020268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:55.060858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] validate_networks() for [('385a247c-d0ba-44c3-bd6f-77e0b4667a31', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:01:55.070480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:55.109678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:55.111634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:55.116390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:55.126881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:55.130195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:55.906283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:55.956475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4e3ebae-05b6-4844-8302-e97cc3a2473b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1523 microversion: 2.1 time: 0.940436 Oct 04 21:01:55.959584 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1858/3647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:55 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1523 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:57.006492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:57.022443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:57.049063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:57.052226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:57.053307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:57.059117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:57.060090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:57.061089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.206244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:58.248258 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d2a6278-683b-490a-8a61-926948bfc4d2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1505 microversion: 2.1 time: 1.249077 Oct 04 21:01:58.250155 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1859/3648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:56 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1505 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:58.881599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:01:58.882454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:01:58.886737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:01:58.886737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:01:58.886737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:01:58.937948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.938844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.939608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.941027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.941878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.942641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.077916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:01:59.101681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for user 4e16f8fc1a794af89bc061b23deb8c33 and project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:01:59.133549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:01:59.139736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:01:59.307067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:59.308255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:59.337037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.338441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.339922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.345311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.350218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.353798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.625320 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [c4350d11-eb33-433e-bfd3-6b7781101508] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:01:59.925906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:59.959938 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8e35357-4791-40ae-a9b1-ffca38e7f625 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1505 microversion: 2.1 time: 0.656609 Oct 04 21:01:59.977615 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1860/3649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:59 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:59.993497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb2146-c731-45c2-8494-558834adbc61", "name": "network-vif-unplugged", "status": "completed", "tag": "f66fc200-097a-4dbe-9462-a41240d23aa1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:00.019915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:00.021408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:00.022235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:00.061785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] Creating event network-vif-unplugged:f66fc200-097a-4dbe-9462-a41240d23aa1 for instance 57eb2146-c731-45c2-8494-558834adbc61 on n-h1-851029-13 Oct 04 21:02:00.077271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b77b2daf-7c7a-40a5-b75f-f93de6372dbb req-bbe7079d-b383-4efd-ad00-0ec809ba4d8b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093520 Oct 04 21:02:00.079187 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1861/3650] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:00.649030 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [c4350d11-eb33-433e-bfd3-6b7781101508] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56832. Oct 04 21:02:00.657467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd6cf014-6f23-4f53-9c9e-c10f31422317 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 23.211864 Oct 04 21:02:00.658851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1790/3651] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:01:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 23215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:02:00.684315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-248f6713-0bc8-401e-8741-2315d9cc6d62 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:00.690005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-248f6713-0bc8-401e-8741-2315d9cc6d62 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:01.014235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:01.024846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:01.054981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:01.069544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:01.077713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:01.077713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:01.083717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:01.089603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:01.144552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-248f6713-0bc8-401e-8741-2315d9cc6d62 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:01.178931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-248f6713-0bc8-401e-8741-2315d9cc6d62 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1222 microversion: 2.1 time: 0.505207 Oct 04 21:02:01.183172 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1862/3652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:00 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1222 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:02.270048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1983759876", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:02.550178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:02.553843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] validate_networks() for [('385a247c-d0ba-44c3-bd6f-77e0b4667a31', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:02:02.612198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e8b2638-830f-4d99-9c15-7dbcf2effc97 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1505 microversion: 2.1 time: 1.609737 Oct 04 21:02:02.613458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1791/3653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:00 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1505 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:03.681956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:03.684859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:03.726850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:03.728093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:03.729868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:03.731747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:03.735396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:03.736924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.256961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:02:04.257757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:02:04.267317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:02:04.268166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:02:04.271325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:02:04.297316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.298457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.299593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.301261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.302411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.305382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.351301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:04.361100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:04.368381 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c867f5b7-7e8f-4add-9e0e-0735cd53ed02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 200 len: 1448 microversion: 2.1 time: 0.712847 Oct 04 21:02:04.370139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1792/3654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:03 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 1448 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:04.375938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for user 4e16f8fc1a794af89bc061b23deb8c33 and project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:04.409403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:02:04.414742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:02:04.446577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:04.464239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:04.468744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.470124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.471647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.477761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.481736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.483581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.542571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:02:04.556180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Working on deleting snapshot 1972839d-0929-447b-885a-2acc24d5ad1a from shelved instance... Oct 04 21:02:04.698978 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:02:05.716887 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56978. Oct 04 21:02:05.737220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f59a316-f971-47f4-943c-6f6ba45e5483 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.476695 Oct 04 21:02:05.737951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1863/3655] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:02:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:02:05.744387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:05.746482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:05.758427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:05.759298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:05.765799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:05.767794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:05.770351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:05.770351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:05.777694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=66 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:06.112797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:06.141350 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5280745c-5ddf-4e70-8ed4-18ba7ceab90f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.399491 Oct 04 21:02:06.141832 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1864/3656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:05 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:06.152002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b95bed60-5759-4edc-b0d3-8d85504b838f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:06.153204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b95bed60-5759-4edc-b0d3-8d85504b838f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:06.296821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b95bed60-5759-4edc-b0d3-8d85504b838f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:06.314868 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b95bed60-5759-4edc-b0d3-8d85504b838f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1222 microversion: 2.1 time: 0.171016 Oct 04 21:02:06.316300 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1865/3657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:06 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:06.339172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1370011379"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:06.344631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:06.368709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:06.377312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:06.378813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:06.382271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:06.385449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:06.390626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:07.523550 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3eef5366-4953-4c9e-98f0-2d7f9a8e550c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 1.204634 Oct 04 21:02:07.533696 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1866/3658] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:02:06 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 21:02:07.551786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fa9bf8a-78fe-4372-a6c2-3f1efcb04552 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:07.555946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2fa9bf8a-78fe-4372-a6c2-3f1efcb04552 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:07.782151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2fa9bf8a-78fe-4372-a6c2-3f1efcb04552 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:07.837006 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fa9bf8a-78fe-4372-a6c2-3f1efcb04552 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1222 microversion: 2.1 time: 0.297881 Oct 04 21:02:07.840357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1867/3659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:07 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1222 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:07.862614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:07.870622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:07.889400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:07.896803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:07.906064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:07.910299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:07.922518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:07.923482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:08.432219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:08.450260 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-525bd7b9-44a2-4935-b499-f9258711a1ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.606348 Oct 04 21:02:08.463587 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1868/3660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:08.501495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:08.524823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:08.527327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:08.528322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:08.553775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] Creating event network-vif-unplugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:02:08.564713 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-25c52003-7cfb-4897-b410-05c8edf7e913 req-ebe18ded-b2c7-4059-8d0f-2279edbc8b8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083918 Oct 04 21:02:08.566565 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1869/3661] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:08.896774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e17b71d5-397e-4549-a28a-b0787eaa34f7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:08.898489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e17b71d5-397e-4549-a28a-b0787eaa34f7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:08.909721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Doing local delete in cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123542) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 21:02:08.909721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:08.909721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:08.909721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:08.921097 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 21:02:08.941112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] deallocate_for_instance() {{(pid=123542) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 21:02:09.019570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:09.109468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e17b71d5-397e-4549-a28a-b0787eaa34f7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:09.125291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:09.138646 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e17b71d5-397e-4549-a28a-b0787eaa34f7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1222 microversion: 2.1 time: 0.252078 Oct 04 21:02:09.149169 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1870/3662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:08 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:09.507977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:09.509467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:09.523315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:09.526063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:09.528229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:09.529873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:09.531545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:09.532581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:10.480387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:10.538139 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b256ba3d-8513-4f44-b46c-8bc942912d86 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 1.039033 Oct 04 21:02:10.546827 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1871/3663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:09 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:10.589750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66c57649-9907-4e28-b4f1-1562404e7d8e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:10.594186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66c57649-9907-4e28-b4f1-1562404e7d8e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:10.917876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66c57649-9907-4e28-b4f1-1562404e7d8e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:10.943641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66c57649-9907-4e28-b4f1-1562404e7d8e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1222 microversion: 2.1 time: 0.396912 Oct 04 21:02:10.951933 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1872/3664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:10 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1222 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:11.602396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:11.612451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:11.630189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:11.631675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:11.632821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:11.635387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:11.638704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:11.643803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:12.668987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:12.701029 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22b5d399-bbab-4356-a44d-7a6f60297432 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1686 microversion: 2.1 time: 1.107002 Oct 04 21:02:12.707170 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1873/3665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:11 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1686 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:12.728402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:12.732245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:12.756690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:12.761056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:12.767177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:12.776746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:12.778794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:12.780121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:12.781151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:13.393939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:13.436248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a4970a64-96de-4a6a-b8b8-ef27d61dd294 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1226 microversion: 2.1 time: 0.726438 Oct 04 21:02:13.457065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1874/3666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:12 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1226 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:13.514307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57eb2146-c731-45c2-8494-558834adbc61", "name": "network-vif-deleted", "tag": "f66fc200-097a-4dbe-9462-a41240d23aa1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:13.560584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:13.565041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:13.567603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:13.581491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Updating instance_info_cache with network_info: [] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:02:13.624227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_external_events [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] Unable to find a host for instance 57eb2146-c731-45c2-8494-558834adbc61. Dropping event network-vif-deleted {{(pid=123541) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:02:13.627665 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a5200f97-d1cb-4097-a17c-48286613b152 req-0fc4671f-abde-4460-923f-f261185beb52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.122135 Oct 04 21:02:13.629706 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1875/3667] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 126 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 21:02:13.763960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:13.779616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:13.934770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:13.943925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:13.944897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:13.946287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:13.956894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:13.957720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:14.336864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:15.577732 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57046e04-ce5e-4dc6-8329-3a779a3f82f6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 204 len: 0 microversion: 2.1 time: 11.149936 Oct 04 21:02:15.581997 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1793/3668] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:02:04 2022] DELETE /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 0 bytes in 11156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:02:15.614521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:15.617852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:15.667557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:15.674516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:15.676659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:15.678854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:15.680101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:15.684005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:16.545541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:16.651232 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab19256c-1288-48eb-8dbd-99150e498d42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.879907 Oct 04 21:02:16.656793 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1876/3669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:13 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:16.703415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-plugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:16.763095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:16.776970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:16.783240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:16.884832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] Creating event network-vif-plugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:02:16.890108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:16.915907 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c86dae16-e3a4-4aef-8c3c-0f485643d10b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1282 microversion: 2.1 time: 1.328441 Oct 04 21:02:16.921192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0cd5d499-d33d-4deb-9e26-6cdafbc7e2fc req-c81bac45-2087-4d22-b760-87a16e723856 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261628 Oct 04 21:02:16.933026 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1877/3670] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:16.938947 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1794/3671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:15 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1282 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:16.968376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:16.985309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:17.005006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:17.007444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:17.009637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:17.012051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:17.015229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:17.019866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:17.074380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 HTTP/1.1 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '57eb2146-c731-45c2-8494-558834adbc61'} Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:02:17.085074 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:02:17.107087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:02:17.110846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:02:17.113291 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76360d43-3fb6-4169-a11c-891128e32dd2 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 404 len: 111 microversion: 2.1 time: 0.173285 Oct 04 21:02:17.130782 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1878/3672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:16 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:02:17.553815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1018233196", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:17.854032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:02:18.865273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb22939d-853b-4445-bc6d-16d80854f55a", "tag": "91a32386-7c93-4353-8348-e0018b80666a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:18.935052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:18.936876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:18.938046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:18.986289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] Creating event network-changed:91a32386-7c93-4353-8348-e0018b80666a for instance bb22939d-853b-4445-bc6d-16d80854f55a on n-h1-851029-13 Oct 04 21:02:19.015434 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b669bf7d-4c3b-4768-8c1a-97bd47a50060 req-6ddc03c3-a404-434b-ab5f-06fbb71e7743 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.329229 Oct 04 21:02:19.017112 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1879/3673] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:19.052975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:19.057747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:19.082825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:19.084711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:19.089100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:19.093610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:19.097718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:19.099139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:20.942464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:21.235505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:21.265194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0fbdaba8-fe4d-4a2e-8326-179663bde6fe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.245136 Oct 04 21:02:21.266702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1880/3674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:19 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:21.289173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:21.299366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:21.340078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:21.341173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:21.341908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:21.349589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:21.353625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:21.354356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:22.020710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:22.099069 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6444965a-1fef-4075-8724-b587670103c0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1280 microversion: 2.1 time: 0.806468 Oct 04 21:02:22.100062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1881/3675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:21 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1280 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:22.320495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:22.322242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:22.355637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:22.368855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:22.370120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:22.374534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:22.380428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:22.382791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:23.019839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:02:23.020783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:02:23.021857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:02:23.022707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:02:23.023609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:02:23.063058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:23.064044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:23.069771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:23.071956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:23.088851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:23.090165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:23.222232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:23.248220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:23.292532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:02:23.297904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:02:23.501338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:23.533117 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9fe3e499-4725-4bb1-96d1-5b6424ad9d9f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.219352 Oct 04 21:02:23.538849 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1882/3676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:22 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:23.561763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:23.573161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:23.600817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:23.602315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:23.604698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:23.606495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:23.611765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:23.631012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:23.800110 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1206b90e-5efc-466e-b648-3147837d5163 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.254123 Oct 04 21:02:23.820703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1795/3677] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 6277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:02:23.864732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16ef0fe2-8de3-4685-968a-1d87b18c2185 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:23.877253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16ef0fe2-8de3-4685-968a-1d87b18c2185 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:24.196212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:24.276723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a65ac10b-e9b0-4227-bcf1-db14a019c509 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1280 microversion: 2.1 time: 0.729240 Oct 04 21:02:24.277919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1883/3678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:23 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1280 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:24.589482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:24.593278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:24.642003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:24.643069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:24.647866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:24.649231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:24.650710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:24.655976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:24.734521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16ef0fe2-8de3-4685-968a-1d87b18c2185 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:24.769247 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16ef0fe2-8de3-4685-968a-1d87b18c2185 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1215 microversion: 2.1 time: 0.944790 Oct 04 21:02:24.771673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1796/3679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:23 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1215 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:25.381605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:25.383080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:25.440151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:25.447281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:25.448390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:25.457309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:25.459314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:25.460510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:25.495345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:26.730463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:26.771996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e95ef95-82cd-45e0-af5d-66cae8f6b770 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.189456 Oct 04 21:02:26.775700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1884/3680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:24 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:26.787101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:26.789629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:26.809052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:26.810482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:26.811975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:26.813689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:26.814997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:26.816119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:27.534853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:27.603188 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fcd9158-585c-4d18-ad0b-1594cce356a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1211 microversion: 2.1 time: 0.811637 Oct 04 21:02:27.604350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1885/3681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:26 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1211 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:27.793917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb22939d-853b-4445-bc6d-16d80854f55a", "name": "network-vif-plugged", "status": "completed", "tag": "91a32386-7c93-4353-8348-e0018b80666a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:27.865404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:27.866409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:27.867284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:27.935239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] Creating event network-vif-plugged:91a32386-7c93-4353-8348-e0018b80666a for instance bb22939d-853b-4445-bc6d-16d80854f55a on n-h1-851029-13 Oct 04 21:02:27.957652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-51d18e88-5d1b-495b-97fc-878cd029d2c5 req-20a4e5e9-af73-425c-813f-8904c65b0c86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170855 Oct 04 21:02:27.967856 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1886/3682] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:02:27.994784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:27.996208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:28.025416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:28.026423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:28.027653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:28.029441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:28.030864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:28.031951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:28.083165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:28.223246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:28.271507 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d36845b-17ed-4513-a107-8649bb45d685 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 2.952831 Oct 04 21:02:28.275128 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1797/3683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:25 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 2963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:28.656790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:28.709636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:28.714855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:28.764720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:28.770703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:28.774499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:28.779106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:28.780594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:28.783551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:29.109176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:29.145724 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02c836e7-4e8d-42cb-897f-11b4564f46bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.171314 Oct 04 21:02:29.147214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1887/3684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:27 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:29.233606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:29.258529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0643f588-54c0-4049-8b98-dc06abd92cc7 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1275 microversion: 2.1 time: 0.604360 Oct 04 21:02:29.271880 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1798/3685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:28 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1275 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:29.324842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:29.326994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:29.354779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:29.356685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:29.358898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:29.362842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:29.364451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:29.365827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:30.215234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:30.215865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:30.248063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:30.250022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:30.251963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:30.261268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:30.264837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:30.267068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:31.224034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:31.272671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45f6c491-436b-451e-be4d-6806f933565e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 1.957793 Oct 04 21:02:31.288137 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1888/3686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:29 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:31.315799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:31.316895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:31.330043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:31.334839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:31.334839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:31.334839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:31.334839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:31.336437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:31.736756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:31.773277 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c7d04c3-812e-4e1a-8d4e-4b46b635eba3 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1273 microversion: 2.1 time: 0.483103 Oct 04 21:02:31.782377 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1889/3687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:31 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1273 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:32.066041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:32.105375 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1916237-fd37-48ff-8263-489d89726c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.895458 Oct 04 21:02:32.109400 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1799/3688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:30 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:32.328140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:32.332388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:32.363713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:32.367731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:32.371895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:32.373854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:32.379397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:32.380751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:32.840377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:32.842111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:32.864008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:32.866384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:32.867819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:32.870020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:32.871546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:32.872877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:33.169295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:33.749619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:33.891964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33dc7bd3-70a9-46ab-b5aa-1503fc6ba738 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 1.568291 Oct 04 21:02:33.897786 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1890/3689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:32 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:33.925903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:33.925903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:33.940381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:33.942544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:33.944110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:33.959548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:33.973594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:33.984108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:34.126268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:34.181718 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffaaa678-644a-4b0f-a7a8-5772579512de tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1273 microversion: 2.1 time: 1.352304 Oct 04 21:02:34.188808 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1800/3690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:32 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1273 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:34.765774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:34.955773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762b582b-c59f-444e-b629-1da410a3215a", "tag": "36a6f8dd-47ac-4278-9a0a-f513bb96f963"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:35.047620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:35.052970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:35.060689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:35.143221 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] Creating event network-changed:36a6f8dd-47ac-4278-9a0a-f513bb96f963 for instance 762b582b-c59f-444e-b629-1da410a3215a on n-h1-851029-13 Oct 04 21:02:35.169554 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8ef625a0-6c1f-4668-9d87-ead29a1488b5 req-f4af6a15-81aa-4475-86e1-15206a6fce16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.975509 Oct 04 21:02:35.172952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1801/3691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:35.213345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:35.218999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:35.249514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:35.258448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:35.260335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:35.262266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:35.263619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:35.268759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:35.942774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:35.970890 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d03e371c-00c9-4e4e-af11-63f792c3d612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.066133 Oct 04 21:02:35.978318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1891/3692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:33 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:35.996632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:36.005592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:36.032115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:36.038061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:36.040465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:36.051090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:36.052295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:36.053293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:37.078191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:37.113294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c29b0512-aa41-480f-92d8-52b47676d78b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 1.937111 Oct 04 21:02:37.116115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1802/3693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:35 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:37.156927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:37.162567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:37.193267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:37.195303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:37.196544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:37.198343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:37.199697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:37.201196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:37.341505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:37.386865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a54a1a7-494c-414a-beea-a6b27c29eb64 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.403442 Oct 04 21:02:37.392309 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1892/3694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:35 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:38.173733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:38.194697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:38.277981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.282917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.285732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:38.292068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.295007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.296575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:38.500351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:38.556186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48e1d138-23dc-445f-af12-eb2fd2c13161 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.413614 Oct 04 21:02:38.558707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1803/3695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:37 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:38.607524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:38.613669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:38.648770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.650224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.651643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:38.662882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.668573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.669912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:39.641617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:39.688682 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-907a8bba-a3e3-4ab8-9360-fceaee5ed08f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.119649 Oct 04 21:02:39.696585 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1804/3696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:38 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:39.707739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:39.715720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:39.744875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:39.751060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:39.752308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:39.761338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:39.763065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:39.764153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:39.844367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:39.877399 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-952b2d51-1a4e-4218-bda4-a12d61b242f8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 1.714463 Oct 04 21:02:39.878327 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1893/3697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:38 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:40.745240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:40.751430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:40.800875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:40.802844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:40.804223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:40.822885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:40.832954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:40.837801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:41.072097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:41.106867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-901e2c83-3828-4ef1-b34a-16f2679fe75c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.413072 Oct 04 21:02:41.111154 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1805/3698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:39 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:41.139396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:41.141563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:41.175835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:41.179228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:41.182316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:41.187524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:41.199090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:41.199090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:41.935143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:41.988550 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6afc5480-be01-422d-a613-eb461e51579a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.250494 Oct 04 21:02:41.996101 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1894/3699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:40 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:42.160750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:42.162545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:42.192652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:42.199782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:42.209015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:42.209015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:42.209015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:42.209015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:42.238366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:42.269081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-198b555e-f471-4b2e-9ed6-bd96fe37822b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 1.154460 Oct 04 21:02:42.270214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1806/3700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:41 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:43.056208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:43.057529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:43.099676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:43.101050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:43.104424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:43.115885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:43.119896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:43.121947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:45.047978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:45.117328 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b88dbb2d-c902-4ed5-b072-60b7b471eb1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.958869 Oct 04 21:02:45.123355 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1895/3701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:42 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:45.146924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:45.151198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:45.167575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=44 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:45.172315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:45.173755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:45.175205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:45.177780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:45.179589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:45.182111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:45.220827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:45.252804 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4823e3a-867a-4b14-aafb-6291455e0fb5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 2.211863 Oct 04 21:02:45.255307 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1807/3702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:43 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:45.966992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:46.004587 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-615efd78-b980-471e-bc42-0704e6e30c4b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 0.874445 Oct 04 21:02:46.005807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1896/3703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:45 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:46.181086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:46.183680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:46.235820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.236914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.236914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.243524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.244627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.245403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.311562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:46.313252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:46.327425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.329253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.331285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.333858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.335605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.337687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.158303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:47.188085 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a334d69-0012-44af-adaa-04730a82e7ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.021861 Oct 04 21:02:47.211935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1808/3704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:46 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:47.238946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:47.241620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.316719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.558403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:47.614492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9609565c-ffa8-4d6a-b10f-f01f5181e8ce tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.308343 Oct 04 21:02:47.619538 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1897/3705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:46 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:47.958085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:47.992145 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9a94e6a-8b65-4153-b69c-9fb653073962 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 0.777320 Oct 04 21:02:47.994271 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1809/3706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:47 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:48.246388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:48.253680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:48.324281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.332366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.336467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.340008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.348682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.349990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.671290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:48.678213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:48.709842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.711741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.717115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.722468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.732187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.733506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.527454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:49.623499 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89f1c22f-cf5c-43b0-a69b-7454dd8bbe26 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.380924 Oct 04 21:02:49.639421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1898/3707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:48 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:49.698709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:49.702384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:49.766336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.767897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.769326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.771075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.772333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.773516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.142547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:51.202799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b385567-74e5-4251-b52b-4f1b98ea5d7f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 2.540479 Oct 04 21:02:51.204319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1810/3708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:48 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:51.824872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762b582b-c59f-444e-b629-1da410a3215a", "name": "network-vif-plugged", "status": "completed", "tag": "36a6f8dd-47ac-4278-9a0a-f513bb96f963"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:51.842488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:51.910138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6295ee71-5289-47b2-845c-cb527fd5075e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 2.259998 Oct 04 21:02:51.927349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:51.929357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1899/3709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:49 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:51.931568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:51.936088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.972425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac164256-f49a-4ede-8e5a-a4cfa844e7b3", "tag": "e7840e4b-51d0-486a-935e-a5c69fdfae86"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:52.011582 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] Creating event network-vif-plugged:36a6f8dd-47ac-4278-9a0a-f513bb96f963 for instance 762b582b-c59f-444e-b629-1da410a3215a on n-h1-851029-13 Oct 04 21:02:52.053414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.062466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.067949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.076738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-85768da7-4abf-4a7e-b4b3-2566bab75c22 req-7a6cf388-6b3e-4e29-b9d5-cdf8ee20c20f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.862720 Oct 04 21:02:52.078433 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1811/3710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:52.102271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:52.112967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:52.140957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.143905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.143905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.152631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.156794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.157897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.184286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] Creating event network-changed:e7840e4b-51d0-486a-935e-a5c69fdfae86 for instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 on n-h2-851029-13 Oct 04 21:02:52.220341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-af8ebca6-9fa9-42ab-a7bb-149f0b7fc4de req-f4f06d7a-3e8f-4016-82f6-5750e8cf0d02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273039 Oct 04 21:02:52.226891 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1900/3711] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:52.273401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:52.290702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:52.338524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.339981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.341962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.344141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.346329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.347551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.175423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:53.216646 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01d2bb0b-9de7-403a-9692-b29b1ad0b741 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 0.955193 Oct 04 21:02:53.217859 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1901/3712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:52 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:53.239450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:53.247792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:53.269595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.275974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.277057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.286183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.286183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.286183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.597214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:53.647028 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c73d5e9b-cceb-48f5-97a3-d53fc910563c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.565483 Oct 04 21:02:53.650877 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1812/3713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:52 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:54.275005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:54.282962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:54.329294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:54.333580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:54.336380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:54.344123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:54.345085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:54.345877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:55.241640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:55.296946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-55f165e1-8462-4bae-a35f-ff249c305d7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1322 microversion: 2.1 time: 2.074029 Oct 04 21:02:55.310811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1902/3714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:53 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1322 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:55.337714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:55.341524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:55.409057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.414108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.415240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:55.421268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.425781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.426900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.821857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:56.837798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:56.845403 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e77194a-cf58-4dde-8129-2e9888d2ef24 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 2.577971 Oct 04 21:02:56.848807 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1813/3715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:54 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 2584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:56.863529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:56.865913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:56.896101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.897032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.897868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.899315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.900184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.913472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:57.623264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.653917 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-904c144e-303f-439b-93ba-681de91b03ac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 2.345750 Oct 04 21:02:57.681948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1903/3716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:55 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:57.901224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:57.903362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:57.927520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:57.934308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:57.935059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:57.936599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:57.937589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:57.940804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.839093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:58.877124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b55e14d6-0c16-46e4-9d26-8a60fce4b775 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1517 microversion: 2.1 time: 2.025764 Oct 04 21:02:58.881898 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1814/3717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:56 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1517 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:58.907252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:58.909197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:58.955707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.955707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.969238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.975426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.980797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.982085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.104692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:59.144611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:59.175834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86ed50fe-fbec-47f1-ae74-af4ed5c62cee tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.273542 Oct 04 21:02:59.192647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1904/3718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:57 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:59.225533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:59.234730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:59.262702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:59.264308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:59.271273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.282890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:59.284674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:59.286088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.424837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'flavor' on Instance uuid 762b582b-c59f-444e-b629-1da410a3215a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:00.071564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8122f68-5c81-4ef8-9416-faee2d1a7314 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action" status: 200 len: 32 microversion: 2.1 time: 0.846308 Oct 04 21:03:00.076572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1905/3719] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:02:59 2022] POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action => generated 32 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:03:00.131195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:00.139741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:00.193905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.198267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.199756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.202508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.211785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.213294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.325220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:00.369851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef498ff3-c5df-4bb3-b373-e2ddde0f34d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 1.482591 Oct 04 21:03:00.370978 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1815/3720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:58 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:00.390641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:00.402973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:00.442371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.449223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.450866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.452808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.462046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.463775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.050300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.085453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d758da7f-a73d-4002-9eca-08355792a0ab tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.992041 Oct 04 21:03:01.092042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1906/3721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:00 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:01.411303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.433870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:01.441383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:01.455255 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04bcbbf1-87a3-4b68-be82-5abaa3ee7a7c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.082461 Oct 04 21:03:01.466497 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1816/3722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:00 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:01.477464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.481620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.483176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.485852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.487150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.488376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.119390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:02.145100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:02.148868 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bc881e5-fa74-4cbf-8756-de55f59c1eae tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1681 microversion: 2.1 time: 0.730265 Oct 04 21:03:02.154208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1907/3723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:01 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1681 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:02.164655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:02.188197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=38 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:02.191749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.193002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.194174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.196165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.197403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.198445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.984703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.027181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b697e09-0fda-4058-a1b6-1d7ce6f9e639 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.889884 Oct 04 21:03:03.028763 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1817/3724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:02 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:03.067187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:03.072286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:03.102879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.105231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.111813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.112843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.114067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.116589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.120435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2cf1a973-6f55-4bd8-91d5-0aad44f39aea tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Action: 'create', calling method: .version_select at 0x7f54f5579ca0>, body: {"keypair": {"name": "tempest-keypair-1652228699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtwIOJ4yAcp5WOTsD6LOdk2Wecgr90v6G0RolgOMlGiTnb+66do8pVNypDRh0tbz9DEJGPCkTgxoC6WQC7GmD7cT4Kgec2Ueyv5rwGBzvy6+Uwp4qjVYEAKukr1wAOqlQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:03.201449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2cf1a973-6f55-4bd8-91d5-0aad44f39aea tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for project c3fde7cfcd38486abca9f10410042dba. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:03.231895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2cf1a973-6f55-4bd8-91d5-0aad44f39aea tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for user 5295950615bc43c4a5c67a9346c5a6da and project c3fde7cfcd38486abca9f10410042dba. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:03.448502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2cf1a973-6f55-4bd8-91d5-0aad44f39aea tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.974627 Oct 04 21:03:03.450298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1908/3725] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:03:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:03.481518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:03.485695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:03.572074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.573492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.574682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.577605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.579214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.580391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:04.260649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:04.305292 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da386588-1684-436d-9d42-1de50990c359 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.851902 Oct 04 21:03:04.311207 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1909/3726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:03 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:04.321154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:04.332788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:04.359884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:04.360883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:04.361644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:04.363240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:04.374207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:04.375762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.112048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:05.136501 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4385dbbb-e403-4b9c-8052-6804b163413c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 2.101168 Oct 04 21:03:05.137549 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1818/3727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:03 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:05.168238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac164256-f49a-4ede-8e5a-a4cfa844e7b3", "name": "network-vif-plugged", "status": "completed", "tag": "e7840e4b-51d0-486a-935e-a5c69fdfae86"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:05.230809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:05.232177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:05.233544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.268170 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] Creating event network-vif-plugged:e7840e4b-51d0-486a-935e-a5c69fdfae86 for instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 on n-h2-851029-13 Oct 04 21:03:05.281788 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ba5e2fb0-5639-48b1-994f-c1521e6e8d23 req-07c6aaf6-fe2d-43fb-ba72-b681875f017b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132826 Oct 04 21:03:05.283682 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1819/3728] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:06.190513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:06.193505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:06.206436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.207963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.209362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.211887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.213317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.214507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.424407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:06.446573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64cb2026-4987-434f-9702-b0d5cc97f547 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 2.130194 Oct 04 21:03:06.448753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1910/3729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:04 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:06.791768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:06.793992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:06.817273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.821059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.821059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.821059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.822265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.824697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.620160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.693954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e9ca032-021a-48cb-a333-3ea8683e2165 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1315 microversion: 2.1 time: 1.512539 Oct 04 21:03:07.702574 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1820/3730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:06 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1315 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:07.727657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:07.785484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.790286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.807452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.860391 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] Creating event network-vif-unplugged:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:03:07.881203 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8c80dc87-8c2b-4e74-aa1a-978a6097f9ec req-ffb75793-0d9e-46fc-ac4e-85059959c197 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174280 Oct 04 21:03:07.887148 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1821/3731] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:07.905871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:07.908185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:07.937818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.938777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.939611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.940886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.941724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.942521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.146457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:08.204998 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4103ab8f-c47b-47bd-8b6a-1b04bc315bdd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.426091 Oct 04 21:03:08.208866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1911/3732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:06 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:08.222456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-301f6167-b05e-4e5c-8355-e37120093913 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Action: 'create', calling method: .version_select at 0x7f54f57101f0>, body: {"keypair": {"name": "tempest-keypair-2003543347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfeRE9qOF50YD8gh3NW68Pn1RFTAP/TrRTlyYfjUYJFfDUqvA7bh1EVYdeXvA+n/DfHvt5ffzq4y9veUskuV9bmhGIfrKi+ZoqoLStocIWVFJ6rLB0StmQQW9932hzj5w=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:08.281807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-301f6167-b05e-4e5c-8355-e37120093913 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Getting quotas for project 87b0c06001b84804be084b0af17a69b1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:08.322699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-301f6167-b05e-4e5c-8355-e37120093913 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Getting quotas for user 54629f088e814651848b12e062e43bc6 and project 87b0c06001b84804be084b0af17a69b1. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:08.480265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:08.527933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72eee25e-ce0f-4dda-8e6e-a0988636ef7a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.633475 Oct 04 21:03:08.533404 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1822/3733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:07 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:08.577272 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-301f6167-b05e-4e5c-8355-e37120093913 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.365642 Oct 04 21:03:08.598825 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1912/3734] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 21:03:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 389 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:03:08.751004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:08.752226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:08.784829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.784829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.786208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.789722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.790802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.792295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.487761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:09.505960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab480222-6b97-418d-83d0-6fa9b1ff39e4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1502 microversion: 2.1 time: 0.763719 Oct 04 21:03:09.515992 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1823/3735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:08 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1502 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:09.570239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:09.588505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:09.591864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:09.607798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:09.609163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:09.610221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.612403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:09.614305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:09.616073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.626284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:09.626990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:09.627868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.721284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:03:09.990097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:10.014734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f2501bcf-f7c7-4fb9-9a20-f25236aaae25 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.439744 Oct 04 21:03:10.031140 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1824/3736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:09 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:10.066880 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2378ad4f-db24-4f8d-8351-5ae0ccd8adf0 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3/action" status: 202 len: 0 microversion: 2.1 time: 0.503560 Oct 04 21:03:10.082795 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1913/3737] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:09 2022] POST /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:10.089032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:10.091186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:10.107201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.108854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.113102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:10.115034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.116596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.117999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:10.870430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:10.896121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9dd2966-ab31-4c17-857f-56364e116307 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 0.822114 Oct 04 21:03:10.902989 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1825/3738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:10 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:11.076495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:11.079897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:11.101768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:11.103216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:11.107141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:11.109354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:11.111267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:11.112741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:11.963500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:11.966982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:11.997332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.000148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.004133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.011599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.017802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.019173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.037421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:12.072503 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a018fd9-31fa-41fa-a262-a7d6a9e5c244 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 1.005698 Oct 04 21:03:12.103044 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1914/3739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:11 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:13.150994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:13.153854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:13.185199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:13.186512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:13.187710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:13.189361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:13.190854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:13.191958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.120238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:14.151783 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bbb9f8aa-0e7c-4488-9c6f-b6dec9e58485 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 2.211767 Oct 04 21:03:14.152991 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1826/3740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:11 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:14.167936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:14.184965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:14.214163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.215705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.216481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.218543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.219599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.223234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.285173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:14.319760 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35bbd1f1-f46d-4f3f-bf1c-a7964f425bba tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 1.177045 Oct 04 21:03:14.329728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1915/3741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:13 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:15.033009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:15.060988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b81d2d51-006e-48b7-9816-a4a1bbdac4fc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.903707 Oct 04 21:03:15.067574 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1827/3742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:14 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:15.116738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:15.118224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:15.177050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.186535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.194250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:15.194993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.199390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.202179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:15.205801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:15.213178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:15.240582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.248699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.249826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:15.251585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.253306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.254407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.302988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.306770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.357320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f73eaf09-034d-4239-9f08-c8973b48cc85 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 1.159566 Oct 04 21:03:16.361190 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd42bf78-9171-4d71-a71a-484fc487d885 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.248613 Oct 04 21:03:16.367619 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1916/3743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:15 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:16.388260 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1828/3744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:15 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:16.389118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:16.390706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:16.405107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:16.409635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.412379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.415990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.423077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.423077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.423077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.440663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:16.441892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:16.466218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.493178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.493178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.493178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.493178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.493178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:17.557438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:17.586235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79afbef9-660f-4fea-8c6d-9fa706520ca8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 1.208582 Oct 04 21:03:17.588399 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1917/3745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:16 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:17.607730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:17.610027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:17.636837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:17.638297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:17.639445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:17.644410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:17.658613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:17.658613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.073295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:18.103784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-786eadcc-1184-45dc-acd2-7886b9aa8977 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.680024 Oct 04 21:03:18.105553 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1829/3746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:16 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:18.159116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:18.188701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:18.215572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.219007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.220277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.225066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.225915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.227338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.374234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:18.506779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:18.656620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9ef2e14-35ff-4c56-8a63-1072841f5a52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.512694 Oct 04 21:03:18.659499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1830/3747] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:18 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:03:18.704293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:18.707094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:18.725940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.727980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.734449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.736693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.740963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.743119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.810620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:18.842194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-05114f18-f8f3-4eba-9212-e8d300a24871 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 1.248086 Oct 04 21:03:18.844733 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1918/3748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:17 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:18.862347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:18.885804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:18.904536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.905536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.908536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:18.910112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:18.911969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:18.913061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:20.002109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.039744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd93380a-3353-450b-a6e3-1f31cfdae47a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 1.187691 Oct 04 21:03:20.045938 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1919/3749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:18 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:20.062962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:20.082121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:20.102774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:20.104006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:20.105420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:20.107366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:20.108633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:20.109775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:20.145743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:20.350925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.395105 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-072b35f3-447a-4fe7-8e9b-0f6cee16c1cf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 1.732634 Oct 04 21:03:20.397487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1831/3750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:18 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:20.782178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.822409 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f1022ddd-e419-45ae-ba9b-801606011492 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 0.772448 Oct 04 21:03:20.823945 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1920/3751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:20 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:21.069544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1231836844", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "eb9de7f7-67e8-43c5-8610-a163f59df64d"}, {"port": "93a4e256-8c57-4536-b81c-220b77c4594f", "tag": "port-1"}, {"port": "e7d5ab4f-820d-4e55-a179-5023e49c5d2a", "tag": "port-2"}, {"uuid": "8d387d29-8b4d-4cf6-adce-190932254c7e", "tag": "net-1"}, {"uuid": "8d387d29-8b4d-4cf6-adce-190932254c7e"}, {"uuid": "09d5040b-7f23-4c55-a825-30e81002149e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "09d5040b-7f23-4c55-a825-30e81002149e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "74dcd595-7aea-414a-b2db-bdb7623eb9f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d89b5bb9-c0d3-4378-b820-e2828ac7c7e7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0387b5e3-aaae-4b28-b418-93d125a06518", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1434766358"}], "key_name": "tempest-keypair-2003543347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:21.086806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:21.087886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:21.107566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:21.108965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:21.120828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:21.122467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:21.123698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:21.124711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:21.798865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] validate_networks() for [('eb9de7f7-67e8-43c5-8610-a163f59df64d', None, None, None, None, None), (None, None, '93a4e256-8c57-4536-b81c-220b77c4594f', None, None, None), (None, None, 'e7d5ab4f-820d-4e55-a179-5023e49c5d2a', None, None, None), ('8d387d29-8b4d-4cf6-adce-190932254c7e', None, None, None, None, None), ('8d387d29-8b4d-4cf6-adce-190932254c7e', None, None, None, None, None), ('09d5040b-7f23-4c55-a825-30e81002149e', '10.2.2.100', None, None, None, None), ('09d5040b-7f23-4c55-a825-30e81002149e', '10.2.2.200', None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:03:21.903150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:21.927851 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-df30882c-1aac-4f63-b006-3274a7f47c99 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 0.848989 Oct 04 21:03:21.931333 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1921/3752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:21 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:21.951268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:21.957361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:21.978529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:21.992739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:21.993965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:21.995664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:22.011164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:22.011164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:22.776519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:22.798984 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45494fe1-1e4d-460a-a338-0674e55757d7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.854732 Oct 04 21:03:22.801211 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1922/3753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:21 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:22.815934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:22.820458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:22.835147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:22.837344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:22.838599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:22.840531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:22.841880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:22.843199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:24.089560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:24.130688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2eb97810-2a1e-4275-a3b9-fa15403aaca4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 1.326309 Oct 04 21:03:24.135578 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1923/3754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:22 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:24.166493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:24.168593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:24.193181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:24.195327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:24.200189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:24.200189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:24.201848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:24.206731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:24.949769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:24.985960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-14105ba1-de50-4a30-bb86-0ca4cbc80203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.845655 Oct 04 21:03:25.004954 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1924/3755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:24 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:25.035924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:25.037873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:25.062882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.065564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.069311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.072845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.072845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.073262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.629812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:25.667667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95f9f5e2-6a52-49cf-ae22-123de8028e78 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1523 microversion: 2.1 time: 0.659941 Oct 04 21:03:25.669638 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1925/3756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:25 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1523 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:25.720307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:25.732730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:25.762457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.770611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.771632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.773607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.774467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.775303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.955833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0245695-bd2e-4ea2-9714-3f65a9eddd68 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 200 len: 322 microversion: 2.1 time: 0.283386 Oct 04 21:03:25.958517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1926/3757] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:25 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:25.986113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:25.988014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:26.004548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:26.006244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:26.007997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:26.009655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:26.010909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:26.012638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:27.041646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:27.158057 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0df46963-a2e7-4c22-a6c1-adffad2da082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 1.194954 Oct 04 21:03:27.162203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1927/3758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:25 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:27.185055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:27.187867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:27.230353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:27.237657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:27.239376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:27.248841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:27.252125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:27.256292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:27.954495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:27.977708 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c107d58f-f181-426f-a288-02a9d90d028e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.807526 Oct 04 21:03:27.980119 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1928/3759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:27 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:27.992454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:27.994699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:28.010570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.012141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.013721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.015529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.018759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.020093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.665144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:28.689012 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5470fc09-7781-404e-a91f-9a103d49fd04 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1503 microversion: 2.1 time: 0.706429 Oct 04 21:03:28.703757 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1929/3760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:27 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1503 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:28.737774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:28.739312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:28.756224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.763042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.763042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.763042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.763042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.765522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:29.450848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:29.469441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db4abf02-f315-4e7e-8398-1f7ab44f041a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.763316 Oct 04 21:03:29.472540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1930/3761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:28 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:29.483052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:29.484411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:29.498333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:29.499790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:29.500938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:29.502607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:29.503895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:29.505036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:30.379054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:30.799579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:30.817848 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6dc3ec3-6028-49fa-8879-7a8af5bdb59e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 1.342955 Oct 04 21:03:30.822096 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1931/3762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:29 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:30.833530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:30.836152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:30.863766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:30.864878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:30.865825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:30.868050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:30.869601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:30.870769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:32.110046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:32.145203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-af9c5cf6-4b6a-4ffe-963d-961067292efc tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1517 microversion: 2.1 time: 1.317535 Oct 04 21:03:32.150929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1932/3763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:30 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1517 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:32.162357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:32.164616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:32.178614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.179487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.180597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:32.181926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.182914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.184282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:32.854708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:32.874498 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff958ba8-afe8-445a-aa95-ab42e25e1997 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.721316 Oct 04 21:03:32.876244 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1933/3764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:32 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:32.896109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:32.897820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:32.916024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.917211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.917846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:32.918896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.919833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.920475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:33.699342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:33.735579 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2735be0-a7a8-444b-86e8-0f4d6295d8b4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1512 microversion: 2.1 time: 0.838838 Oct 04 21:03:33.737516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1934/3765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:32 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1512 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:33.747380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:33.759831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: fd41df83-d4b9-4525-95ee-4991b85a29ef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:33.782993 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/fd41df83-d4b9-4525-95ee-4991b85a29ef/action HTTP/1.1 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 14 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: {"rescue": {}} Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fd41df83-d4b9-4525-95ee-4991b85a29ef', 'body': {'rescue': {}}} Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:33.790790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. Oct 04 21:03:33.803287 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:33.807480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 404 to user: Instance fd41df83-d4b9-4525-95ee-4991b85a29ef could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:33.808967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49284ac6-a816-4040-a710-2809400a5373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/fd41df83-d4b9-4525-95ee-4991b85a29ef/action" status: 404 len: 111 microversion: 2.1 time: 0.068637 Oct 04 21:03:33.811140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1935/3766] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:33 2022] POST /compute/v2.1/servers/fd41df83-d4b9-4525-95ee-4991b85a29ef/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:03:33.822498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:33.824608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:33.841729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:33.842776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:33.843695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:33.845923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:33.847154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:33.848165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:34.564211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:34.821733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:03:34.822265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:03:34.823216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:03:34.823998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:03:34.824924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:03:34.860619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:34.862968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:34.863951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:34.865695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:34.867997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:34.869177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:34.938995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Getting quotas for project 87b0c06001b84804be084b0af17a69b1. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:34.953912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Getting quotas for user 54629f088e814651848b12e062e43bc6 and project 87b0c06001b84804be084b0af17a69b1. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:35.114602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:35.152224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d21e6b78-e8a7-41c2-a1e7-d68a4250745e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.338336 Oct 04 21:03:35.173580 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1936/3767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:33 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:35.213043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:35.214387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:35.243964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:35.247945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:35.247945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:35.247945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:35.247945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:35.255064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:35.628157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:35.798283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:03:35.810003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='74dcd595-7aea-414a-b2db-bdb7623eb9f3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d89b5bb9-c0d3-4378-b820-e2828ac7c7e7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0387b5e3-aaae-4b28-b418-93d125a06518',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:03:35.977092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65825f63-8109-4eed-9df5-034c0f62bfd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action" status: 202 len: 0 microversion: 2.1 time: 0.786602 Oct 04 21:03:35.986350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1937/3768] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:35 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:36.034093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:36.039349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:36.060436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.061387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.062158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.063608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.068280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.070586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:37.618089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:37.635624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ede9ce97-505b-450f-94dd-1eb939d8ace9 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1489 microversion: 2.1 time: 1.640925 Oct 04 21:03:37.649421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1938/3769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:35 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1489 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:37.794739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2093270192", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6625a5dc-d4c9-493c-a356-6d80fd39a592"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:37.969970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] validate_networks() for [('6625a5dc-d4c9-493c-a356-6d80fd39a592', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:03:38.387951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab850aaf-7dbf-438e-a82a-d88155dac8f6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 17.327882 Oct 04 21:03:38.404621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1832/3770] 10.222.0.36 () {62 vars in 1189 bytes} [Tue Oct 4 21:03:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 17336 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:03:38.420307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:38.421586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:38.466135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:38.466970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:38.467781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:38.469157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:38.470063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:38.470834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.308705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:39.326166 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-426e52ae-348d-4641-be63-5a5e11bb002d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1502 microversion: 2.1 time: 0.929226 Oct 04 21:03:39.346871 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1833/3771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:38 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1502 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:39.375159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:39.376689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:39.388774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.390981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.392129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.394064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.395273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.399014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.457377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:03:39.980673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e26d7c1-7c59-41a6-8f98-8b9e022eefad tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 204 len: 0 microversion: 2.1 time: 0.629532 Oct 04 21:03:39.982231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1834/3772] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:03:39 2022] DELETE /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:03:39.998602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:40.012140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:40.192838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:40.230984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:40.235513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:40.239278 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35784b94-6ca6-4552-8f4a-36b38312415e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1286 microversion: 2.32 time: 0.253555 Oct 04 21:03:40.241354 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1835/3773] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:39 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1286 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:40.267359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:40.270214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:40.293437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:03:40.296747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.298423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.298729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:03:40.299625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.301251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.301621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:03:40.302385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.302598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:03:40.303237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.313776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:03:40.344340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.345635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.347287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.351963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.353387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.354564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.374197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'flavor' on Instance uuid bb22939d-853b-4445-bc6d-16d80854f55a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:40.438184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Cannot 'rescue' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state paused Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action HTTP/1.1 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 14 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: {"rescue": {}} Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'rescue' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state paused Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'bb22939d-853b-4445-bc6d-16d80854f55a', 'body': {'rescue': {}}} Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb22939d-853b-4445-bc6d-16d80854f55a in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state paused Oct 04 21:03:40.442844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state paused Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 409 to user: Cannot 'rescue' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state paused {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:40.457950 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-034c25cb-abf2-41c0-a665-d25b67e019a4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action" status: 409 len: 144 microversion: 2.1 time: 0.200000 Oct 04 21:03:40.460851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:40.461063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1836/3774] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:40 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action => generated 144 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:03:40.462951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:40.478576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:40.491809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:03:40.492445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:40.496918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:03:40.516203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.518021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.521937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.523498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.526631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.529421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.761052 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bea1f98e-9cb1-4bdf-adec-ed40d8124eb4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.121820 Oct 04 21:03:40.761943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1939/3775] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:03:40.772310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:40.774647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:40.798850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.806192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.808496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:40.811587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:40.816407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:40.821852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.184847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.248292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f984631-ec0f-4cc6-8f93-cc9b81e9bbfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1495 microversion: 2.1 time: 0.774067 Oct 04 21:03:41.254405 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1837/3776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:40 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1495 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:41.278429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-adabcd2a-65de-4bad-bb79-451820eab8a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:41.284789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-adabcd2a-65de-4bad-bb79-451820eab8a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:41.386565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6746f37-428d-4c98-92a7-d0f7415efecf tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action" status: 202 len: 0 microversion: 2.1 time: 0.607993 Oct 04 21:03:41.392780 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1940/3777] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:40 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:41.433919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:41.433919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:41.485685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-adabcd2a-65de-4bad-bb79-451820eab8a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.533651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-adabcd2a-65de-4bad-bb79-451820eab8a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1215 microversion: 2.1 time: 0.270934 Oct 04 21:03:41.535024 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1838/3778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:41 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:41.572811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:41.575970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:41.611772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.613352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.616274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.619153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.622444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.627469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.082303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.120743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.123916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.132958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-adbf95f5-faa8-4407-be61-1073d1a4bc28 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1286 microversion: 2.32 time: 0.737514 Oct 04 21:03:42.169427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1941/3779] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:41 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1286 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:42.302229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:42.307785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:42.359280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.362328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.362328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.368394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.372437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.378613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.729368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.774681 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6b6cc91-8caf-4ab4-8a80-1910d993c471 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1509 microversion: 2.1 time: 1.228082 Oct 04 21:03:42.777558 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1839/3780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:41 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1509 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:42.818204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-056ab00b-cd5e-43c5-84c7-03686b32176d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:42.819940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-056ab00b-cd5e-43c5-84c7-03686b32176d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:43.211994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-056ab00b-cd5e-43c5-84c7-03686b32176d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.240915 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-056ab00b-cd5e-43c5-84c7-03686b32176d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1215 microversion: 2.1 time: 0.450779 Oct 04 21:03:43.245403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1840/3781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:42 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:43.262521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:43.273199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:43.515514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.547207 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ca55fd6-6206-45d4-b060-39e1ab45aacc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1495 microversion: 2.1 time: 1.255093 Oct 04 21:03:43.552385 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1942/3782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:42 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1495 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:43.682334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.709032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.720747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.723271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db4fdd05-bfe8-4382-823c-65eb379ac518 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1286 microversion: 2.32 time: 0.475318 Oct 04 21:03:43.731475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1841/3783] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:43 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1286 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:43.834170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:43.838595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:43.881510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.888641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.892302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.898951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.900381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.902145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.314787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:44.325382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:44.385756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.398202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.401839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.407444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.409198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.410470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.881669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:44.908664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:44.924407 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-062e9c79-53a8-428a-892c-5d1dd41535cb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1219 microversion: 2.1 time: 0.637229 Oct 04 21:03:44.930347 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1842/3784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:44 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1219 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:44.949008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:44.954587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:44.978429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.986945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.989827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.991879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.998841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.001588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.294517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.338243 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4fd9f11e-a3f3-4979-9626-75a49401ea27 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1517 microversion: 2.1 time: 1.513869 Oct 04 21:03:45.341053 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1943/3785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:43 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1517 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:45.363951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:45.369549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:45.405560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.406260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.423417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.430628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.432434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.436871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.528707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.586302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bd9147c-7907-46e9-9dbf-953304499e0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1453 microversion: 2.1 time: 0.652505 Oct 04 21:03:45.587549 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1843/3786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:44 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1453 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:45.814368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.883156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.890125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.934374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3355b62f-c862-4f3c-be17-613ea86734ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1520 microversion: 2.32 time: 0.582004 Oct 04 21:03:45.934374 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1944/3787] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:45 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1520 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:45.982907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:45.983984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:46.013699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.015133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.016294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.018907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.020283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.021391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.091878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac164256-f49a-4ede-8e5a-a4cfa844e7b3", "name": "network-vif-deleted", "tag": "e7840e4b-51d0-486a-935e-a5c69fdfae86"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:46.181758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.183452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.187750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.254389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] Creating event network-vif-deleted:e7840e4b-51d0-486a-935e-a5c69fdfae86 for instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 on n-h2-851029-13 Oct 04 21:03:46.282059 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5cac1478-9a3d-4e34-b868-3500c8022230 req-49f39c4a-6b66-4393-9aa1-e1b5f20bceea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198582 Oct 04 21:03:46.285377 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1945/3788] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:03:46.378577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:46.429310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f6914ed-f63f-407e-b13d-a50cdb21bc91 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1267 microversion: 2.1 time: 0.458455 Oct 04 21:03:46.430703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1844/3789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:45 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1267 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:46.667182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:46.671701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:46.692904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.693804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.696477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.697854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.703668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.704916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.990231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:46.992908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:47.051428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.060994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.062136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.066979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.070979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.072238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.146097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.147003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.162850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.163884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'fault' on Instance uuid ac164256-f49a-4ede-8e5a-a4cfa844e7b3 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:47.591267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:47.636010 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5800687c-8cd9-4008-a4b2-c0bf9bd5d297 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1305 microversion: 2.1 time: 0.981690 Oct 04 21:03:47.641417 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1946/3790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:46 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1305 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:47.693633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:47.695338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:47.724782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:47.746984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.748001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.748812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.760888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.767979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.768962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.957546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:48.020987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:48.052163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:48.077216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98961e1c-0224-4416-a422-6428302e0c00 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1520 microversion: 2.32 time: 1.080734 Oct 04 21:03:48.078516 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1845/3791] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:46 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1520 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:48.695477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:48.698954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:48.749988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:48.751746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:48.773284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:48.779119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:48.781693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:48.784582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:48.971546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:48.979411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:48.980369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:48.981175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'fault' on Instance uuid ac164256-f49a-4ede-8e5a-a4cfa844e7b3 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:49.483470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:49.532057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8556474-c8c9-48eb-aa77-2ab075bd6082 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 200 len: 1305 microversion: 2.1 time: 0.848783 Oct 04 21:03:49.536981 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1846/3792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:48 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 1305 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:49.576177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:49.577862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:49.633829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.638278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.644783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.645087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:49.661747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.672335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.674179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.707776 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59a275ed-00eb-4a92-a953-624398fbb540 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1285 microversion: 2.1 time: 2.061684 Oct 04 21:03:49.710800 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1947/3793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:47 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1285 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:50.250716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:50.310809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:50.324025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:50.331658 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4170561a-9b16-4e4d-8cea-8bc0e8f8273c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1584 microversion: 2.32 time: 0.789358 Oct 04 21:03:50.334586 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1847/3794] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:49 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1584 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:50.598726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:50.609187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:50.623824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:50.646332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.651055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.651055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.651055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.651719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.652473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.700908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 HTTP/1.1 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ac164256-f49a-4ede-8e5a-a4cfa844e7b3'} Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:50.705685 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2cec08b-cb6d-4e16-a72c-a36cf39b272d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 404 len: 111 microversion: 2.1 time: 0.127069 Oct 04 21:03:50.724167 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1948/3795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:50 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:03:50.786217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:50.791079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:50.808055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.809730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.811144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.812932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.814097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.815240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:51.192967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-480294240", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "abc2511d-58a3-4c61-8de4-e4c1c9608484"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:51.439273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] validate_networks() for [('abc2511d-58a3-4c61-8de4-e4c1c9608484', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:03:51.523863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:51.543931 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee320f86-0c94-4086-80d6-5b933d243b79 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1273 microversion: 2.1 time: 0.788429 Oct 04 21:03:51.558631 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1848/3796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:50 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1273 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:51.602442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:51.603852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:51.620834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:51.622327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:51.623938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:51.626555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:51.627939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:51.629303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.074153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:52.107446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:52.113538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:52.117535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:52.123649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bd39aa9-96ec-4f9c-afe3-b306a844eeb1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1594 microversion: 2.32 time: 0.562110 Oct 04 21:03:52.147818 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1849/3797] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:51 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1594 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:52.276433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:52.287273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:52.312239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.313765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.315088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.316906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.318236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.320113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.411089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'flavor' on Instance uuid bb22939d-853b-4445-bc6d-16d80854f55a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:52.486393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:52.987949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-570d0546-2a7e-4c86-b6ad-d6a1f0a67640 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action" status: 200 len: 32 microversion: 2.1 time: 0.720451 Oct 04 21:03:52.998653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1850/3798] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:52 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action => generated 32 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:03:53.032242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:53.044649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:53.068132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:53.069083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:53.069924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:53.071961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:53.072627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:53.073470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:53.654145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:53.690377 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65a82a08-3e1b-4b3c-a598-d77342a8ad50 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1273 microversion: 2.1 time: 0.679684 Oct 04 21:03:53.693329 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1851/3799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:52 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1273 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:53.739336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:53.764406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:53.795760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:53.813707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:53.815240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:53.820733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:53.822250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:53.824233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:53.829371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.364822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:55.406628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-505d57e4-7c54-4ef1-a71e-87c3d2f2ec67 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.709769 Oct 04 21:03:55.414169 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1852/3800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:53 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:55.443902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:55.446095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:55.479643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.480683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.481598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.483402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.484591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.485652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.838544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:03:55.840754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:03:55.842814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:03:55.846368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:03:55.850129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:03:55.914471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.936194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.937650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.944540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.944540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.952987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:56.090758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:03:56.125179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Getting quotas for user 6378bcb2439f49b2be3e8eae9a87b26f and project c03a10cf0a9149feb00c329db60fc040. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:03:56.201138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:03:56.208768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:03:56.620124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-651d70bc-324a-48f5-8c0b-d18d583b9733 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.435609 Oct 04 21:03:56.621370 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1949/3801] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 5439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:03:56.644397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:56.647714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:56.690954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:56.692271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:56.693386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:56.707850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:56.707850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:56.707850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:58.511585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:58.547651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:58.565424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:58.568655 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46497ff2-ee9e-494d-89ee-f99caf6b6565 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1662 microversion: 2.32 time: 3.150829 Oct 04 21:03:58.573829 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1853/3802] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:55 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1662 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:58.621925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:58.623761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:58.636978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:58.638565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:58.639732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:58.641512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:58.642709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:58.644049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.599312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.631745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75ef42b5-2ef9-4405-ad13-cbf85ad282cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 3.008161 Oct 04 21:03:59.637521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1950/3803] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:56 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 3015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:59.654030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:59.662163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:59.689639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.690884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.691968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.693585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.694747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.698964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.710022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.773291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3f6f9f9-7958-4127-98ac-cc2771686634 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.181988 Oct 04 21:03:59.785069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1854/3804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:58 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:59.808364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:59.808364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:59.823805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.825547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.827070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.829039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.831842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.833122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:00.381906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:00.418017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cdc93e49-d174-47d2-a50a-0e9a988cbc8a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1210 microversion: 2.1 time: 0.777723 Oct 04 21:04:00.419111 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1951/3805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:59 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1210 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:00.685951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:00.694393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:00.719433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.720700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.721779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:00.734426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.735874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.736985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:01.279392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.329645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.345984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.357409 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d989eebc-c0e8-42b0-bc45-6c3e6e58b27e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1662 microversion: 2.32 time: 1.569812 Oct 04 21:04:01.363576 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1855/3806] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:59 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1662 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:01.387258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:01.392252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:01.448927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:01.450456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:01.451957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:01.454035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:01.455373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:01.456577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:01.646392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.683801 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2366907-ef34-4b9a-82aa-703092edbaa4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 1.003600 Oct 04 21:04:01.702716 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1952/3807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:00 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:01.724800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:01.726062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:01.754767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:01.755880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:01.758924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:01.762647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:01.765193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:01.767578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:02.586952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:02.630229 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a07d2fb3-9879-4d85-9ceb-6ffde2639feb tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1274 microversion: 2.1 time: 0.937467 Oct 04 21:04:02.638483 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1953/3808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:01 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1274 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:02.672100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:02.679070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:02.729407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.731977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.733137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:02.735478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.745058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.746861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.342720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:03.429036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9181f263-9245-43d3-9dba-1a4a59359ee4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 2.049471 Oct 04 21:04:03.438571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1856/3809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:01 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:03.493848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:03.498238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:03.573265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.580217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.593022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.608618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.610290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.614171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.939422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:03.973226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:03.977076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:03.980637 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4dfdb8a7-f0c4-4a79-9850-3204929ec237 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1709 microversion: 2.32 time: 1.338680 Oct 04 21:04:03.981049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1954/3810] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:02 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1709 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:03.998158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:03.999972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:04.012988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:04.014212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:04.015351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:04.017599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:04.028131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:04.029410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:04.584011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:04.634344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b84d096-ce85-4cce-aa35-78ed9b676bfc tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1272 microversion: 2.1 time: 0.651228 Oct 04 21:04:04.646972 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1955/3811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:03 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:04.662926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:04.662926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:04.689821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:04.691486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:04.692778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:04.694457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:04.695698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:04.702534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:04.749392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:05.450736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.481204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.492392 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2889ccd5-37d6-4e43-9cae-094c9e164492 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 2.046933 Oct 04 21:04:05.508000 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1857/3812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:03 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:05.515597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9df8eb03-71a2-4beb-b212-927ddbfaf1c5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 0.876275 Oct 04 21:04:05.543391 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1956/3813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:04 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:05.547835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:05.551193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:05.563090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:05.587092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.587992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.588935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.590257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.591145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.601609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.685851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:05.689126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:05.721054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.723249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.728426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.730866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.734517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.741688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.016070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:06.168099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:06.232209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:06.264406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f5fade5-f702-41f7-ada8-c5b28519b45d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1272 microversion: 2.1 time: 0.586988 Oct 04 21:04:06.269557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1957/3814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:05 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1272 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:06.321666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:06.367880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:06.374403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:06.378852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-609763e4-564b-4d0f-ac73-5038c0af36d4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1709 microversion: 2.32 time: 0.866099 Oct 04 21:04:06.378852 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1858/3815] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:05 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1709 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:06.423758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45440c2-15dc-464a-b070-9d1731d35752", "tag": "20357422-2563-4cc4-961b-a43f6370f583"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:06.486513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.487712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.488183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.566938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:06.571287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:06.572964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] Creating event network-changed:20357422-2563-4cc4-961b-a43f6370f583 for instance f45440c2-15dc-464a-b070-9d1731d35752 on n-h1-851029-13 Oct 04 21:04:06.609106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-67060630-48b8-4031-bdaf-8387afa4fe4e req-fff50440-0877-4e20-8413-796b824fdf44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198473 Oct 04 21:04:06.616423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.622429 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1958/3816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:06.632485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.636301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.648354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:06.649251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.650567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.651727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.655558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:06.695829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.696751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.697603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.711621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.712710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.713577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:07.547280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:07.608189 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc7f3630-6f77-4b5a-987e-1df80c84b5bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 0.982925 Oct 04 21:04:07.610190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1959/3817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:06 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:07.616671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:07.630001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:07.642522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:07.658474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6bef074-a778-4bd6-aefb-ac915c6fc60f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.103998 Oct 04 21:04:07.660034 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1859/3818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:06 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:07.690088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:07.690918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:07.693665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:07.703466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:07.704859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:07.708865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:07.710387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:07.711977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:07.727727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:07.729351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:07.730531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:07.732310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:07.733577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:07.734832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:08.749610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.770514 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9836e2e2-30a1-4ec4-9343-02dacb40ead4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1272 microversion: 2.1 time: 1.158092 Oct 04 21:04:08.784443 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1960/3819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:07 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1272 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:08.794318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:08.798079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:08.826197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:08.826894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:08.838427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:08.840177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:08.841381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:08.842581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:08.898774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.931348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.946104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.948591 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a1f408c0-a0c7-4e87-a286-ab4706b685f5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1709 microversion: 2.32 time: 1.283926 Oct 04 21:04:08.949677 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1860/3820] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:07 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1709 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:08.970990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:08.972780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:08.993990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:08.995283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:08.996435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:09.002106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:09.003465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:09.004597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.452256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.474429 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a74e548-3bdd-4b8c-bcb3-3f7b56834606 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 1.686758 Oct 04 21:04:10.490732 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1961/3821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:08 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:10.499636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:10.507129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:10.518961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:10.520112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:10.520952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.522790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:10.523737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:10.524724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.631898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.660295 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f25bf43-13e2-4e60-bd5b-c7fe30d1d828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.708194 Oct 04 21:04:10.665634 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1861/3822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:08 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:10.673038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:10.675934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:10.713491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:10.713491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:10.713491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.713491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:10.713491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:10.714848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.466313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:11.507621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-605ddc30-c637-4ec3-902e-bc037e699b28 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.014609 Oct 04 21:04:11.509407 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1962/3823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:10 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:11.521377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:11.523383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:11.536585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.538723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.540031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.541601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.542622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.544069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.826376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:11.855421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:11.859708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:11.864177 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f066a2b-cdc7-4514-a7bf-07e8a570d31f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1756 microversion: 2.32 time: 1.198375 Oct 04 21:04:11.909272 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1862/3824] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:10 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1756 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:11.927723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:11.929635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:11.947640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.951815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.953385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.959821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.960990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.961838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:12.769665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:12.802317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a9fd0aa-2c2b-4ebc-b358-abb28f7e17cc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 1.290425 Oct 04 21:04:12.803628 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1963/3825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:11 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:12.820487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:12.821216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:12.841654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:12.848012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:12.848889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:12.850568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:12.855975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:12.858896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:13.758477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:13.780626 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-641c4f43-c0fb-4e72-ad24-8a17839f4356 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.870782 Oct 04 21:04:13.782251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1863/3826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:11 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:13.799358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:13.801677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:13.836011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.838810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.844107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:13.850530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.851826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.855136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:14.521000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:14.548602 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-637d3d56-88ee-4696-9c6d-b5e9e9a12c21 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.742921 Oct 04 21:04:14.588212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1964/3827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:12 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:14.628160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:14.629806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:14.643032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:14.644500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:14.645822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:14.648237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:14.649486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:14.650714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:15.210828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:15.252845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:15.275112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:15.283156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ad8f269-d0cd-43aa-a1fb-cc1b2c927746 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1756 microversion: 2.32 time: 1.495689 Oct 04 21:04:15.288015 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1864/3828] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:13 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1756 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:15.311844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:15.313974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:15.331768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.334288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.335909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:15.338439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.339833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.341302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:16.514434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:16.531415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:16.550523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c8c9ff3-7bb9-4bb7-9d39-e994cd0a6f7c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.258649 Oct 04 21:04:16.553245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:16.554889 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1865/3829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:15 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:16.586830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:16.587314 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a85ba94-d50a-43f9-bdc9-5d84c805026a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 1.979033 Oct 04 21:04:16.594458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:16.594712 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1965/3830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:14 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:16.599521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45440c2-15dc-464a-b070-9d1731d35752", "name": "network-vif-plugged", "status": "completed", "tag": "20357422-2563-4cc4-961b-a43f6370f583"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:16.599849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:16.601441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:16.602310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:16.603703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:16.604556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:16.605328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:16.650920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:16.652439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:16.653681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:16.680749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] Creating event network-vif-plugged:20357422-2563-4cc4-961b-a43f6370f583 for instance f45440c2-15dc-464a-b070-9d1731d35752 on n-h1-851029-13 Oct 04 21:04:16.698990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3e12ed12-1437-4914-9ff0-a5474ec18e65 req-f43f101d-e7b4-44a4-8d6f-f5c12af82d25 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107112 Oct 04 21:04:16.700801 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1966/3831] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:16.721914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:16.723977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:16.741890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:16.743478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:16.744570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:16.746327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:16.748346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:16.750110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.045351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:18.082506 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3226e5aa-99b9-44e2-ad94-b5384ab70212 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.524895 Oct 04 21:04:18.091197 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1866/3832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:16 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:18.104533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:18.112223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:18.127804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:18.134470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.135821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.136894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.154115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.154115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.154115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.154557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:18.155283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:18.156573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78a6c3c7-6c9b-4518-a837-b77257c6e46d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1803 microversion: 2.32 time: 1.452447 Oct 04 21:04:18.158607 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1967/3833] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:16 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1803 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:18.178103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:18.182948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:18.204688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:18.211373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.214743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.216408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.223728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.226172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.229219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.081941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.116450 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c5b6289-fe0c-4fdc-9fd7-b92c98e5b939 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1503 microversion: 2.1 time: 1.018880 Oct 04 21:04:19.117932 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1867/3834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:18 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1503 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:19.144176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4", "tag": "ece30689-60ff-4835-8175-f192cf90191e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:19.168787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.182092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.188528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.189608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.193361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47a7e22a-29f8-4e1c-ae43-91c2eab31fbd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1315 microversion: 2.1 time: 1.033076 Oct 04 21:04:19.227781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1968/3835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:18 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:19.235293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] Creating event network-changed:ece30689-60ff-4835-8175-f192cf90191e for instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 on n-h2-851029-13 Oct 04 21:04:19.242084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:19.247053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:19.259974 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a3781338-4ecc-4bc4-9010-f312065eb7cf req-aab80b58-9e56-41fb-a7a1-fcd577dbcc17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136708 Oct 04 21:04:19.273393 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1868/3836] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:19.284514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.285384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.286208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.289347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.290278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.291161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.298301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cee2d6a-6a9b-46d8-b8b1-781629507220"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:19.312768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:19.338494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.339647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.340405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.341490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.344518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.347732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.418981 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Cannot 'attach_volume' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state rescued Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/os-volume_attachments HTTP/1.1 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 74 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: {"volumeAttachment": {"volumeId": "9cee2d6a-6a9b-46d8-b8b1-781629507220"}} Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'attach_volume' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state rescued Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'bb22939d-853b-4445-bc6d-16d80854f55a', 'body': {'volumeAttachment': {'volumeId': '9cee2d6a-6a9b-46d8-b8b1-781629507220'}}} Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb22939d-853b-4445-bc6d-16d80854f55a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 21:04:19.433364 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state rescued Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state rescued Oct 04 21:04:19.438379 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:19.455560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 409 to user: Cannot 'attach_volume' instance bb22939d-853b-4445-bc6d-16d80854f55a while it is in vm_state rescued {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:19.461706 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e286ced-14ad-4cb1-a6f9-d63e2e70236b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.185916 Oct 04 21:04:19.468036 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1869/3837] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:04:19 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/os-volume_attachments => generated 152 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:04:19.477029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:19.487824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:19.513093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.514584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.515932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.517741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.520260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.522729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.216286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:20.261521 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45bcfd89-d9fc-4db9-b3d7-84ba9543f11b tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.024342 Oct 04 21:04:20.262633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1969/3838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:19 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:20.328316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:20.331255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:20.331255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:20.347838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.348374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:20.348868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.350186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.351591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.352727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.352946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:20.353935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.355271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d5595557-ee94-4666-8424-25d8000cfadd tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1850 microversion: 2.32 time: 0.884450 Oct 04 21:04:20.357202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1870/3839] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:19 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1850 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:20.366735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:20.376180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:20.404085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.413819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.415221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.417109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.419474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.425211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.816319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:20.836402 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f14b3737-458f-4493-a278-bc8af53cc8ec tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1501 microversion: 2.1 time: 0.476734 Oct 04 21:04:20.837800 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1871/3840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:20 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1501 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:20.885016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:20.897288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.903395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.903395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.003930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-532f8b5e-f482-4df9-b45c-58005f8b8f7e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action" status: 202 len: 0 microversion: 2.1 time: 0.705432 Oct 04 21:04:21.018540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1970/3841] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:20 2022] POST /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:04:21.057395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:21.062788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:21.078619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.079625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.080457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.082731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.085117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.086564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.104164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Going to try to stop instance {{(pid=123542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:04:21.639396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:21.657697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb3b526d-6e6d-40fb-94bf-e4f15969d342 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1511 microversion: 2.1 time: 0.630549 Oct 04 21:04:21.659286 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1971/3842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:21 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1511 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:21.669293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:21.670875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:21.683338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.685031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.685952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.687515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.688587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.689774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.762160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25248da4-06c5-450c-b773-0a71b2996e27 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752/action" status: 202 len: 0 microversion: 2.1 time: 0.884352 Oct 04 21:04:21.765314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1872/3843] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:20 2022] POST /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:04:21.809692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:21.809692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:21.828221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.830836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.832975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.836675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.838977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.841270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:22.650156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.685547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ebf5778a-8677-4821-8ce8-7054f7f7f3d4 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.024569 Oct 04 21:04:22.686603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1972/3844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:21 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:22.699810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:22.703419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:22.722608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:22.722980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.724997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:22.727108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:22.728483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:22.729476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:22.730366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:22.758106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.762154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.765238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81dfbe6a-c06e-4e36-99ad-e02c7c607e81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1850 microversion: 2.32 time: 0.980007 Oct 04 21:04:22.768052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1873/3845] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:21 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1850 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:22.770794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:22.779692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:22.781542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:22.828286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:22.829222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:22.830384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:22.831752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:22.832366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:22.839847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.384130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:23.426453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd154ae7-6e4b-4e8d-885c-26e1d03691f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 0.737431 Oct 04 21:04:23.432662 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1973/3846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:22 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:23.580019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:23.618537 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b7ec665-dcc7-4999-a5fc-9e9d0543049b tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1511 microversion: 2.1 time: 0.846243 Oct 04 21:04:23.621276 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1874/3847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:22 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1511 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:23.741303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:23.744271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:23.771463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.784157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.784984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.787981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.788965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.789816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.824919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:23.826274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:23.852629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.856933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.861864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.863786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.864970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.888523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:24.755545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:24.811576 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f81e6a25-0f74-45f4-9e2b-acf5fae1d609 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 1.078151 Oct 04 21:04:24.816991 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1974/3848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:23 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:24.850820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:24.860430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:24.890999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:24.890999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:24.890999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:24.908239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:24.908239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:24.908239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.073757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.105675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.124288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.126463 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2904b902-2683-4500-b83b-1040089616ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1850 microversion: 2.32 time: 1.314835 Oct 04 21:04:25.127491 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1875/3849] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:23 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1850 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:25.179209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:25.180612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:25.193770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.194841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.196010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.197985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.199448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.200802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.497625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.530160 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2868fff-a701-4451-8588-3a8538eeac35 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 0.707355 Oct 04 21:04:25.533273 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1975/3850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:24 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:25.867202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:25.887484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:25.919839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.924303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.925574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.929975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.931273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.935040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:26.601477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:26.649209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72a6a8bd-29e9-4f45-9715-dd858ad06de3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1511 microversion: 2.1 time: 1.502083 Oct 04 21:04:26.657449 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1876/3851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:25 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1511 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:26.686086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:26.695197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:26.743524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:26.745392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:26.749237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:26.754017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:26.759457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:26.767067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:27.971037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.006684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a283e98c-37f0-4498-a2be-93d8c209c846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 2.145695 Oct 04 21:04:28.011042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1976/3852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:25 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:28.037823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:28.045811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:28.108993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.110627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.111751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.123554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.124785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.125924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.260549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.305120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.320183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.324005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06e77cb6-cb87-417b-9a0e-671f57a7063e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1850 microversion: 2.32 time: 1.664249 Oct 04 21:04:28.329253 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1877/3853] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:26 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1850 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:28.341926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:28.343743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:28.377076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.383753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.385085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.386645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.387632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.390833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.710837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:29.764629 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-789e4213-df75-4501-a5c3-b6fa29b3cd53 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1517 microversion: 2.1 time: 1.433239 Oct 04 21:04:29.766959 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1878/3854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:28 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1517 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:29.781103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "4d1ed2fc-0e45-494e-92bc-5b098ec82e93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:29.847149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.847476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:29.848161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.848161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.888840 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6511fbb7-e8b9-402b-a74a-fe38252a2d52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 1.872965 Oct 04 21:04:29.894242 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1977/3855] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:28 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:29.910790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] Creating event network-changed:4d1ed2fc-0e45-494e-92bc-5b098ec82e93 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:04:29.913066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4", "name": "network-vif-plugged", "status": "completed", "tag": "ece30689-60ff-4835-8175-f192cf90191e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:29.938391 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5ba879dc-d7e1-4523-ae31-f40155ec39d4 req-f19cb6a7-8913-4c89-a362-07adce894cf1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165783 Oct 04 21:04:29.942082 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1879/3856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:29.959960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.961455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.962721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.974530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:29.987664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:29.998839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] Creating event network-vif-plugged:ece30689-60ff-4835-8175-f192cf90191e for instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 on n-h2-851029-13 Oct 04 21:04:30.017764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.019269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.024529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.026500 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-af54fd70-8e49-4319-af39-08c7ff5ce036 req-4e642119-9639-4d74-82e2-8dbb8d4b03b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129626 Oct 04 21:04:30.029951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1978/3857] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:30.031465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.032899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.033803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.045351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:30.050399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:30.065861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.067338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.069297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.071173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.072835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.074390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:32.583693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.652287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.657292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.667225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-933b044b-a8de-4bad-ac5c-49aa2090b0f4 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1850 microversion: 2.32 time: 2.632397 Oct 04 21:04:32.674949 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1979/3858] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:30 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1850 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:32.705732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-324171154", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a768001c-6609-4c45-ac75-ddb0275e4adf"}], "security_groups": [{"name": "tempest-securitygroup--1630086010"}], "key_name": "tempest-keypair-1652228699", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6035a590-59ca-4ba3-af75-e76e2576f2c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:32.788808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.842872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3ed43a1-73b6-467f-a025-72fa5c598e02 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1314 microversion: 2.1 time: 2.886076 Oct 04 21:04:32.844269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1880/3859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:29 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1314 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:32.877653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:32.884033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:32.945444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:32.946384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:32.958852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:32.965198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:32.965198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:32.965198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:33.437978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] validate_networks() for [('a768001c-6609-4c45-ac75-ddb0275e4adf', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:04:33.935452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:34.008814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f784063-2a3c-401f-af55-1c37447f8052 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 1.159781 Oct 04 21:04:34.031797 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1881/3860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:32 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:34.056933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "93a4e256-8c57-4536-b81c-220b77c4594f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:34.118171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.131216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.134943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:34.201121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] Creating event network-changed:93a4e256-8c57-4536-b81c-220b77c4594f for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:04:34.236353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1777e25e-420f-40bb-b198-6bd52e4f99ef req-3b1499fa-ce58-4cd6-ab75-a406216a9c9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208616 Oct 04 21:04:34.237603 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1882/3861] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:34.267061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:34.268266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:34.295207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.296142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.297228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:34.298920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.303836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.304668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:35.723952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.734764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:35.749660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.756457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.765248 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ca4a351-53d6-4efb-a274-4095313640ee tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1871 microversion: 2.32 time: 1.525297 Oct 04 21:04:35.766795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1883/3862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:34 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1871 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:35.788412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:35.789540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:35.806277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:35.806869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:35.807357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:35.808287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:35.808778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:35.809226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.351891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for project c3fde7cfcd38486abca9f10410042dba. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:04:36.373305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for user 5295950615bc43c4a5c67a9346c5a6da and project c3fde7cfcd38486abca9f10410042dba. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:04:36.440548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:04:36.441871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:04:36.443439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:04:36.444636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:04:36.446003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:04:36.477054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.480519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.483934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.488881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.491442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.496872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.584328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for project c3fde7cfcd38486abca9f10410042dba. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:04:36.597727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Getting quotas for user 5295950615bc43c4a5c67a9346c5a6da and project c3fde7cfcd38486abca9f10410042dba. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:04:36.635049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:36.673348 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a8bc8c3-2247-4563-8fbd-0438b865f62c tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1501 microversion: 2.1 time: 0.901813 Oct 04 21:04:36.678333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1884/3863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:35 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1501 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:36.699865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:36.701222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:36.707690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=54 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.731818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.732817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.739891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.741701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.743041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.743260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:04:36.744480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.749174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6035a590-59ca-4ba3-af75-e76e2576f2c7',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:04:37.496473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:37.516549 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6e62021-8626-4b9c-9785-14fa538b7003 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 0.836143 Oct 04 21:04:37.517618 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1885/3864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:36 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:37.535703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a63f18ae-42ab-41d5-9c1b-2470034482c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: .version_select at 0x7f54f6cc8b80>, body: {"keypair": {"name": "tempest-keypair-355217342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBXVNeUup4sIUzrPDT5jOsySXo5foyq/JzllrXxsj6TcnaqR9HOGE2r/jzYud4u+o55utYPDnn6t8oyvwDaPZhAqXvUbVx3d1tRLZSGwQKYtShfbZayDyZYjvl3/TcUPA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:37.596356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a63f18ae-42ab-41d5-9c1b-2470034482c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:04:37.611243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a63f18ae-42ab-41d5-9c1b-2470034482c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for user 4e16f8fc1a794af89bc061b23deb8c33 and project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:04:37.738890 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0276bba7-b335-4f39-995c-986e73b2704f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.056267 Oct 04 21:04:37.741957 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1980/3865] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:04:32 2022] POST /compute/v2.1/servers => generated 407 bytes in 5066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:04:37.773887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:37.773887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:37.788767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:37.789903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:37.790781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:37.793329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:37.794720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:37.796219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:37.809431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a63f18ae-42ab-41d5-9c1b-2470034482c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.283942 Oct 04 21:04:37.813036 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1886/3866] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:04:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:37.830254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:37.835958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:37.863971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:37.872347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:37.873482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:37.881586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:37.881586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:37.881586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:37.928161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lazy-loading 'flavor' on Instance uuid ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:04:38.523481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c383cd15-8fec-4d4d-b1ce-965e2965db0a tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "POST /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4/action" status: 202 len: 0 microversion: 2.1 time: 0.764778 Oct 04 21:04:38.531601 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1981/3867] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:37 2022] POST /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:04:38.578009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c5ee0a0-47f4-43f3-a142-99dd50fde785 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:38.595681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c5ee0a0-47f4-43f3-a142-99dd50fde785 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:38.784072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3c5ee0a0-47f4-43f3-a142-99dd50fde785 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:38.802906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c5ee0a0-47f4-43f3-a142-99dd50fde785 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1121 microversion: 2.1 time: 0.257479 Oct 04 21:04:38.806742 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1982/3868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:38 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1121 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:38.820678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:38.821917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:38.841215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.843701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.846259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.848186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.849445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.852003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.891113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:38.921155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:38.923067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:38.924638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fde5c8ac-38ca-4485-aff4-86bb1e39c717 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1892 microversion: 2.32 time: 1.109114 Oct 04 21:04:38.925656 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1887/3869] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:37 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1892 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:38.936388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:38.937584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:38.957491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.960697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.964363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.966402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.968654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.970008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:39.553340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.571220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.591115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5adcb8ff-78db-46db-9f67-0af028065da4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 0.663259 Oct 04 21:04:39.597668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd3ac271-49d9-4bb6-8af9-4312a5839710 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1509 microversion: 2.1 time: 0.789925 Oct 04 21:04:39.600948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1983/3870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:38 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1509 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:39.615295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1888/3871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:38 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:39.683890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "e7d5ab4f-820d-4e55-a179-5023e49c5d2a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:39.704332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:39.706036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:39.707291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:39.730107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] Creating event network-changed:e7d5ab4f-820d-4e55-a179-5023e49c5d2a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:04:39.779980 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4b4a69bd-2aaa-40a6-8a70-d98d03f36d79 req-5da9fe93-100f-46c3-bb7f-c915aa65f3b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067856 Oct 04 21:04:39.786310 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1984/3872] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:39.857589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86898816-6369-4628-8cc8-5bc1ac41b7d8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:39.860198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86898816-6369-4628-8cc8-5bc1ac41b7d8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:39.981041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:39.984044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:40.012771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.013912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.014908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:40.017239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.018722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.024011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:40.234717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86898816-6369-4628-8cc8-5bc1ac41b7d8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:40.255495 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86898816-6369-4628-8cc8-5bc1ac41b7d8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1121 microversion: 2.1 time: 0.409239 Oct 04 21:04:40.257787 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1889/3873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:39 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1121 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:40.665416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:40.672328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:40.705831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.706829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.707661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:40.709668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.710911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.711970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:41.654970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:41.736378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:41.743252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:41.753341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:41.757963 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7b2438b-a10f-4cf4-9a80-d84264c4f677 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.787906 Oct 04 21:04:41.764197 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1985/3874] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:39 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:41.777266 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e7e5cb6-ebd1-4c28-84b7-d410823313fd tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 1.119266 Oct 04 21:04:41.796580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:41.796580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:41.796856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1890/3875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:40 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:41.803177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:41.810569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:41.812984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:41.813811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:41.818421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:41.819509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:41.825184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:41.828063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:41.853278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:41.871085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:41.872153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:41.873973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:41.874946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:41.876780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.263991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:42.283425 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8ea66b2-349f-489f-ac49-29f5162c1c1a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1219 microversion: 2.1 time: 0.490037 Oct 04 21:04:42.284866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1891/3876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:41 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1219 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:42.470964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "fca02ccb-d52e-4b3a-b636-8c6d705f39fb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:42.495933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.497264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.498615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.524178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] Creating event network-changed:fca02ccb-d52e-4b3a-b636-8c6d705f39fb for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:04:42.534994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-96e6ddd2-0da1-4baa-96a0-019191dc909a req-8a59ffd7-560c-4305-9bd6-41d6d33f8ac6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083405 Oct 04 21:04:42.538489 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1892/3877] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:04:42.822738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:42.824997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:42.827716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:42.843977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.847867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.847867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.849693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.851366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.852701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.890113 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10c6d976-c23a-4ccc-9937-542ad2c1436d tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1492 microversion: 2.1 time: 1.120868 Oct 04 21:04:42.928506 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1986/3878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:41 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1492 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:42.946600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:42.949625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:42.968268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.969086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.969857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.971230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.972337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.973399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:44.629360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:44.697727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:44.701330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:44.715709 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31c18273-1e20-4df0-beb2-7e3d750e03cf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.905907 Oct 04 21:04:44.716866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1893/3879] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:42 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:44.741531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:44.742474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:44.785531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:44.791038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:44.795606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:44.795606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:44.802486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:44.805713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:44.978871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:04:45.326447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:45.342369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-078d96e4-aceb-4ad8-ae23-31ca02541934 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 2.411885 Oct 04 21:04:45.349237 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1987/3880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:42 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:45.365839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:45.367645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:45.391373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.392787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.393934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:45.396673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.398022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.399220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:45.765086 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aae1e2b4-afc6-419b-9433-99aa8b259207 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 204 len: 0 microversion: 2.1 time: 1.045888 Oct 04 21:04:45.767232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1894/3881] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:04:44 2022] DELETE /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:04:45.786284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:45.788912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:45.801522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.805380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.805380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:45.814794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.816518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.818331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:46.017000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:46.017000 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95c1ad2a-2809-4ebd-ac46-6a65cca9ef4b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1237 microversion: 2.1 time: 0.669429 Oct 04 21:04:46.019208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1988/3882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:45 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1237 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:46.042529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:46.049312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:46.074286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:46.075831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:46.080393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:46.090768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:46.092529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:46.093881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:46.544366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:47.499153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:47.519637 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d385df6e-cc3c-49db-9f47-6eb8746f1846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1498 microversion: 2.1 time: 1.497792 Oct 04 21:04:47.526190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1989/3883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:46 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1498 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:47.532357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:47.534199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:47.550337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:47.553175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:47.554373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:47.579048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:47.579048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:47.579048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:47.870414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:47.929470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:47.941912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:47.952320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1183f498-d947-4475-b832-3b300091d6e1 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 2.176146 Oct 04 21:04:47.953488 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1895/3884] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:45 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:47.972884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:47.975120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:48.004961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:48.006084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:48.013614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:48.015125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:48.016961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:48.017851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:48.801471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:50.024682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:50.072547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9da4ad22-9acc-4a89-ac86-83ad0911fd72 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1511 microversion: 2.1 time: 2.532215 Oct 04 21:04:50.077163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1990/3885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:47 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1511 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:50.100258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:50.109882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:50.119927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:50.143124 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1371f8d3-8aeb-477a-9979-f6923ede0328 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1305 microversion: 2.1 time: 2.185984 Oct 04 21:04:50.144923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:50.150502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1896/3886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:47 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1305 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:50.155610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:50.160002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:50.162109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:50.168951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:50.171957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:50.175328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:50.177848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:50.183460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:50.225342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:50.226888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:50.228300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:50.232196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:50.238139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:50.240300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:50.251496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:50.318694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:51.051102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6378bcb2439f49b2be3e8eae9a87b26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03a10cf0a9149feb00c329db60fc040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:51.069898 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5027baea-0421-451a-8619-14d1c1e7b846 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 200 len: 1456 microversion: 2.1 time: 0.989117 Oct 04 21:04:51.071079 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1991/3887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:50 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 1456 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:51.130515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4", "name": "network-vif-deleted", "tag": "ece30689-60ff-4835-8175-f192cf90191e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:51.151599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:51.152911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:51.154177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:51.202104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] Creating event network-vif-deleted:ece30689-60ff-4835-8175-f192cf90191e for instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 on n-h2-851029-13 Oct 04 21:04:51.216072 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-75833cc2-e73a-4fe9-8154-a380e1aaa3c6 req-cbee0815-6e63-4599-8079-89ef3d9e9246 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104544 Oct 04 21:04:51.230460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1992/3888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:51.246848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:51.253051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:51.292600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:51.294268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:51.295317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:51.296999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:51.298274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:51.299435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:51.400526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:51.425993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:51.431505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:51.434469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eeb17325-30fe-494a-8134-10d5bc0ba279 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.281498 Oct 04 21:04:51.439757 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1897/3889] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:50 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:51.446143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:51.448400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:51.465365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:51.467257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:51.468418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:51.470268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:51.471627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:51.472785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.142003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:53.149415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:53.176432 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eedca3ab-3c8a-4abf-92aa-50755958ab6f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1305 microversion: 2.1 time: 1.737858 Oct 04 21:04:53.177515 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1898/3890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:51 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1305 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:53.193377 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f6481c6-cd2b-410d-ace5-d9125ff84f84 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1488 microversion: 2.1 time: 1.950619 Oct 04 21:04:53.193377 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1993/3891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:51 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1488 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:53.198298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:53.202059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:53.203143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:53.204413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:53.222286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.223542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.229405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.229405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.229405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.233174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.249662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.253355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.263658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.265504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.266459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.267683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.335064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 HTTP/1.1 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4'} Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:53.351059 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.362844 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.373881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:53.376246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b67c4506-896d-4e93-942f-e414b59d4364 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 404 len: 111 microversion: 2.1 time: 0.196888 Oct 04 21:04:53.380371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1899/3892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:53 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:53.412713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:53.416444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:53.447199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.447918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.448681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.454069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.458721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.459874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.565373 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4885408d-f060-4176-9b8c-2cfd8bc7f694 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 200 len: 147 microversion: 2.1 time: 0.181763 Oct 04 21:04:53.574593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1900/3893] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:53 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 147 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:53.602199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e7d156-a5a7-4443-960f-62916a41fc04", "tag": "a687a67b-12f6-41cd-b1f7-1ddb286f47d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:53.660080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.663165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.665903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.734183 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] Creating event network-changed:a687a67b-12f6-41cd-b1f7-1ddb286f47d5 for instance d8e7d156-a5a7-4443-960f-62916a41fc04 on n-h2-851029-13 Oct 04 21:04:53.752960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-76ae3685-e876-458d-b1c8-ce32b06d595c req-e52d665d-5ab1-4da3-9da6-2623abb54955 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182742 Oct 04 21:04:53.758009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1901/3894] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:53.796308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:53.797407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:53.859437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.860291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.861032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.870052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:53.876287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:53.877505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:53.928920 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 HTTP/1.1 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4'} Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:53.933069 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:53.941418 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:53.948293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:53.951080 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3bc7e592-45d4-4b5c-9b6e-46b34a7b5695 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 404 len: 111 microversion: 2.1 time: 0.185557 Oct 04 21:04:53.959628 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1902/3895] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:04:53 2022] DELETE /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:53.973045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:53.975123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:54.013462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.014852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.016194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.018054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.019793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.021023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.795394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:54.829126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:54.832502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:54.835471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3922d150-f4db-4ab6-b5ed-afeace3e704b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.646713 Oct 04 21:04:54.837251 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1994/3896] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:53 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:54.849998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:54.852078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:54.865739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.866748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.867609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.868987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.869891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.870596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.927997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 HTTP/1.1 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4'} Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:54.934237 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. Oct 04 21:04:54.946604 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:04:54.953670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:54.953670 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b5bc187-b1ca-468c-8dbd-cccb7eaa9b56 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4" status: 404 len: 111 microversion: 2.1 time: 0.113049 Oct 04 21:04:54.963236 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1995/3897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:54 2022] GET /compute/v2.1/servers/ef33e8b6-e0dc-4a36-ba6b-9525d0da0ad4 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:54.976804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:54.979149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:54.994827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.996453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:55.000130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:55.002472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:55.004331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:55.006164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:55.722187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:55.736763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:55.780414 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6a980a4-bb15-4851-88d1-93448ca80d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.803428 Oct 04 21:04:55.790836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1903/3898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:53 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:55.837151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "7e9671fe-e420-4d77-bc2e-58859c1d9e34"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:55.890246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:55.892690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:55.898201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:55.964107 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] Creating event network-changed:7e9671fe-e420-4d77-bc2e-58859c1d9e34 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:04:55.990932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4e671aa7-8e38-440e-a13a-059a7280393e req-22e0fda3-4c93-410e-a447-168ba416b166 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193435 Oct 04 21:04:55.995232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1904/3899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:56.042967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:56.049130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:56.079055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.081109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.086331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.092618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.094290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.097406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.175226 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 HTTP/1.1 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ac164256-f49a-4ede-8e5a-a4cfa844e7b3'} Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:56.181347 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:56.194855 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:56.210898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:56.217285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab8d3814-2e5d-464e-8c8a-2d5708c2e2e5 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 404 len: 111 microversion: 2.1 time: 0.201854 Oct 04 21:04:56.218877 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1905/3900] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:04:55 2022] DELETE /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:56.220372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:56.285672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:56.285672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:56.286942 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-972209fd-b3df-4d25-aeab-ba401c230d6b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1305 microversion: 2.1 time: 1.283894 Oct 04 21:04:56.286942 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1996/3901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:54 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1305 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:56.287292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.287292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.287533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:56.287533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:56.287684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.287756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.289626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.290580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.291391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.392827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:57.435595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:57.460467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ff2f59f-a5c9-4a54-803d-ac4e8c6a85d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.239448 Oct 04 21:04:57.472265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:57.472458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1906/3902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:56 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:57.472599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:57.489667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:57.492647 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3204730a-546d-44dc-b1bf-8ecfc2f53174 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.228663 Oct 04 21:04:57.495025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: ac164256-f49a-4ede-8e5a-a4cfa844e7b3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:57.503124 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1997/3903] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:56 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:57.517534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.523802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.524187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1409561405", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385a247c-d0ba-44c3-bd6f-77e0b4667a31"}], "security_groups": [{"name": "tempest-securitygroup--224922448"}], "key_name": "tempest-keypair-355217342", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:57.524950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.526181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.535884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.537342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.591894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 HTTP/1.1 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ac164256-f49a-4ede-8e5a-a4cfa844e7b3'} Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:57.596687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance ac164256-f49a-4ede-8e5a-a4cfa844e7b3 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7914cd7d-f17b-4961-9a7d-17840621a4ea tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3" status: 404 len: 111 microversion: 2.1 time: 0.137672 Oct 04 21:04:57.612144 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1907/3904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:57 2022] GET /compute/v2.1/servers/ac164256-f49a-4ede-8e5a-a4cfa844e7b3 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:57.626267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:57.628114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:57.641486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.642968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.644066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.645920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.647198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.648373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:58.204783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] validate_networks() for [('385a247c-d0ba-44c3-bd6f-77e0b4667a31', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:04:58.513684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:58.540155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99d5d340-f6aa-42df-a420-bd15ea8e79eb tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1305 microversion: 2.1 time: 0.921749 Oct 04 21:04:58.542523 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1908/3905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:57 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1305 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:58.563095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:58.564776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:58.605207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.607520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.608673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:58.610651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.611919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.613258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:59.082285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:59.110159 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c18161e-9d38-46fe-a446-acb6d89453c1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.559306 Oct 04 21:04:59.116482 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1909/3906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:58 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:59.164860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:59.168757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:59.203996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:59.213128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:59.227056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:59.228876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:59.234385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:59.235781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:59.334359 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 HTTP/1.1 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '57eb2146-c731-45c2-8494-558834adbc61'} Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:59.345455 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:04:59.356032 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.366636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:59.374240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-92a52287-990d-4c42-908f-ed52eded422e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 404 len: 111 microversion: 2.1 time: 0.253741 Oct 04 21:04:59.378875 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1910/3907] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:04:59 2022] DELETE /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:04:59.393567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:59.396625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:59.412548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:59.414003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:59.415681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:59.417437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:59.419210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:59.421553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:00.508704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:00.578939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:00.589842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:00.594291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f19efd2-742c-4d8f-bc49-7263cea3290d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.211403 Oct 04 21:05:00.596962 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1911/3908] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:59 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:00.609703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:00.615535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:00.615535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:00.615535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:00.615535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:00.616558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:00.618927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:00.637416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:00.639037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:00.639786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:00.657760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:00.662152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:00.663803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:00.692113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:00.695338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:00.696610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:00.719589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:00.720655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:00.721470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:00.835929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:00.869400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Getting quotas for user 4e16f8fc1a794af89bc061b23deb8c33 and project b1700e56dee9416ba9bcf23cb446b1f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:00.943325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:00.950950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:01.287463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5df6b720-744d-47fc-b7bd-efa8aa298b3a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.775780 Oct 04 21:05:01.300179 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1998/3909] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:04:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:05:01.313405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:01.332375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 57eb2146-c731-45c2-8494-558834adbc61] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:01.353114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:01.357245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:01.359512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:01.363432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:01.368367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:01.369667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:01.413359 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 HTTP/1.1 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '57eb2146-c731-45c2-8494-558834adbc61'} Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:01.416563 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. Oct 04 21:05:01.425407 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:01.435967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 57eb2146-c731-45c2-8494-558834adbc61 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:01.435967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db2b4c7e-07ac-4fa1-9619-b3aa454e979f tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61" status: 404 len: 111 microversion: 2.1 time: 0.127210 Oct 04 21:05:01.435967 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1999/3910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:01 2022] GET /compute/v2.1/servers/57eb2146-c731-45c2-8494-558834adbc61 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:01.448742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:01.450403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:01.464193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:01.465508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:01.466597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:01.468431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:01.469598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:01.470982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:02.712329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:02.743734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8770151c-82cf-4525-9316-c798e1116ca7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 2.142442 Oct 04 21:05:02.744845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1912/3911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:00 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:02.767065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "24459c03-b523-48fe-b744-d8e703f3d412"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:02.801408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:02.803067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:02.808578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:02.843499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] Creating event network-changed:24459c03-b523-48fe-b744-d8e703f3d412 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:05:02.855026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7c78cdaf-d04b-4c63-83a0-f396014d564e req-d81f5d16-b93b-44ae-8433-9c95b93a6113 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107872 Oct 04 21:05:02.856469 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1913/3912] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:02.869812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6a1f2eb-ce58-4b77-9414-6218fd49baed tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:02.871198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6a1f2eb-ce58-4b77-9414-6218fd49baed tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:03.126257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6a1f2eb-ce58-4b77-9414-6218fd49baed tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:03.158293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6a1f2eb-ce58-4b77-9414-6218fd49baed tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1245 microversion: 2.1 time: 0.292705 Oct 04 21:05:03.161353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1914/3913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:02 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1245 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:03.181950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:03.190506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:03.227750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:03.231020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:03.233165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:03.235309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:03.236403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:03.242203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:03.263723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:03.312440 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 HTTP/1.1 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c058f440-0431-4d99-a11c-bba545b6eaa5'} Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:03.323099 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:03.335256 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:03.339415 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-898c5e0c-3897-4ec9-9cd0-713f0e431bbe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 1.883258 Oct 04 21:05:03.339684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:03.339684 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2cd0eaf7-d2a6-4f17-974b-d116d4e0e9bf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 404 len: 111 microversion: 2.1 time: 0.164011 Oct 04 21:05:03.339684 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1915/3915] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:03 2022] DELETE /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:03.344992 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2000/3915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:01 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:03.374049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-700817143", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6625a5dc-d4c9-493c-a356-6d80fd39a592"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:03.378441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:03.379322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:03.425518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:03.426406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:03.428020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:03.431052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:03.432048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:03.433371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:03.678916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] validate_networks() for [('6625a5dc-d4c9-493c-a356-6d80fd39a592', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:05.004313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:05.045662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:05.049319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:05.056602 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c17234f3-1156-47d4-a782-6166377d9422 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.714269 Oct 04 21:05:05.056855 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1916/3916] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:03 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:05.920483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:05.921434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:05.922227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:05.923164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:05.923952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:05.940643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:05.941947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: c058f440-0431-4d99-a11c-bba545b6eaa5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:05.964957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.968211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:05.970185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:05.970942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.971849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:05.972658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:05.974009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.974202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.975687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:05.977279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.004243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.006017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.078939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:06.100158 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:06.106205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 HTTP/1.1 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c058f440-0431-4d99-a11c-bba545b6eaa5'} Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:06.107396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance c058f440-0431-4d99-a11c-bba545b6eaa5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:06.116137 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04f6e565-eeda-4a8e-9ed3-a075f8680c50 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5" status: 404 len: 111 microversion: 2.1 time: 1.053478 Oct 04 21:05:06.122504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1917/3917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:05 2022] GET /compute/v2.1/servers/c058f440-0431-4d99-a11c-bba545b6eaa5 => generated 111 bytes in 1059 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:06.140146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:06.146139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:06.177164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.179090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.180391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.180893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:06.183086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.185215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.186376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.195128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:06.456133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:06.472432 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c785861-e587-4f27-8555-2ab74923f06c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1297 microversion: 2.1 time: 0.352046 Oct 04 21:05:06.473833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1918/3918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:06 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1297 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:06.493657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1161414a-b7b9-44e7-9325-fc7e82033d05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.146446 Oct 04 21:05:06.495975 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2001/3919] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:05:06.507486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:06.509353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:06.522867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:06.528383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:06.553504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.555228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.556087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.557201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.560305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.561531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.562836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.563205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.564223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.565461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:06.567850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:06.568915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.537259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:07.570210 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c74cfabc-a3a0-4aff-8852-8731428a236a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 1.079715 Oct 04 21:05:07.578042 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1919/3920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:06 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:07.595852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:07.601658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:07.616663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:07.623045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:07.626287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:07.628802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.633149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:07.634740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:07.636394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.638296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:07.666946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:07.679027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:07.686534 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:07.690295 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0061758d-5b5b-42b6-9856-7648d1f2f46c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.183067 Oct 04 21:05:07.691519 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2002/3921] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:06 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:07.700754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "e5c13171-a4f5-4cc9-87ca-58d6d153e34a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 HTTP/1.1 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fa5aee88-270a-4369-b096-eb460d04e8b6'} Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:07.718488 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d019607-5e77-4242-a52f-03bab4af0da6 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 404 len: 111 microversion: 2.1 time: 0.129378 Oct 04 21:05:07.734467 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1920/3922] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:07 2022] DELETE /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:07.738008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55b39255-990f-4b7d-8080-548b41b2044b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:07.740512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55b39255-990f-4b7d-8080-548b41b2044b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:07.779773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:07.780656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:07.781491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.857343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] Creating event network-changed:e5c13171-a4f5-4cc9-87ca-58d6d153e34a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:05:07.893853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9e4f6223-8ef5-4380-ab97-4af745952fdd req-0a7eaeb5-2064-44ff-bb3a-eefae9decb8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193294 Oct 04 21:05:07.901096 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2003/3923] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:07.928106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:07.929732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:07.955948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:07.965515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:07.965967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.967698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:07.969265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:07.975894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:07.979334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55b39255-990f-4b7d-8080-548b41b2044b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:08.010476 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55b39255-990f-4b7d-8080-548b41b2044b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1214 microversion: 2.1 time: 0.291687 Oct 04 21:05:08.012899 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1921/3924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:07 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:08.067003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:08.068290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: fa5aee88-270a-4369-b096-eb460d04e8b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:08.100144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.103360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.104597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:08.110345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.112649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.112649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:08.150270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 HTTP/1.1 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fa5aee88-270a-4369-b096-eb460d04e8b6'} Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:08.154005 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. Oct 04 21:05:08.163038 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:08.165834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance fa5aee88-270a-4369-b096-eb460d04e8b6 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:08.168104 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6293ccfd-3cbf-4766-980f-13b37d83de2e tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6" status: 404 len: 111 microversion: 2.1 time: 0.150383 Oct 04 21:05:08.174706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1922/3925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:08 2022] GET /compute/v2.1/servers/fa5aee88-270a-4369-b096-eb460d04e8b6 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:08.352405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:08.381493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24adcc88-a5b2-407e-afb3-71ac0ac7f468 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1315 microversion: 2.1 time: 0.477271 Oct 04 21:05:08.396499 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2004/3926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:07 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:08.630495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:08.644127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:08.657313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.666277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.667685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:08.669627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.672778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.674100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:08.765346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:08.769749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:08.819010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.819780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.820608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:08.821963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:08.822903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:08.823738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.408935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:10.464140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:10.471463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:10.497026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8524c832-2356-4d93-8813-62954ed22e83 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.742392 Oct 04 21:05:10.498820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2005/3927] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:08 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:10.520379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:10.526607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:10.544632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:10.585784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.588550 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af096353-a77e-41b1-8355-e9af3541f144 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 1.965729 Oct 04 21:05:10.598790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.599067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1923/3928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:08 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:10.599207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.601135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:10.606719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:10.607032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.607032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.607712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.613351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.614522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.615362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.617063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.618267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.619432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:11.071070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:11.108171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bcc550c-9195-4aff-b9d6-7b0dd741bf0e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1303 microversion: 2.1 time: 0.509472 Oct 04 21:05:11.112166 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1924/3929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:10 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1303 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:11.166862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:11.201074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c71b9448-1b22-47a8-a95e-9201754057b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1266 microversion: 2.1 time: 0.697735 Oct 04 21:05:11.202552 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2006/3930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:10 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1266 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:11.565386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:11.568337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:11.581714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:11.584230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:11.585626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:11.593521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:11.600993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:11.603215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:11.642057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:11.646392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:11.696294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:11.697225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:11.709132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:11.712278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:11.717655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:11.718866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.990125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:13.034923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:13.058052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:13.064552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21ae9b8c-ddcd-4fdf-b055-f3bc8c0b7d51 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.509424 Oct 04 21:05:13.072155 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1925/3931] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:11 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:13.117747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:13.122268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:13.159501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:13.173797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:13.174623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:13.176099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:13.177683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:13.178434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.884873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:14.922432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd72d6e3-634c-4065-a63b-659375e33cde tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 3.287041 Oct 04 21:05:14.951758 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2007/3932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:11 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 3317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:14.990543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:14.993464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:15.022566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.030480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.031586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.033216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.037790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.038847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.155654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:15.203726 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18d82c4f-4060-466d-af85-af678baf1226 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1370 microversion: 2.1 time: 2.119504 Oct 04 21:05:15.207333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1926/3933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:13 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1370 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:15.263524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e7d156-a5a7-4443-960f-62916a41fc04", "name": "network-vif-plugged", "status": "completed", "tag": "a687a67b-12f6-41cd-b1f7-1ddb286f47d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:15.305988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.315726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.320688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.378641 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] Creating event network-vif-plugged:a687a67b-12f6-41cd-b1f7-1ddb286f47d5 for instance d8e7d156-a5a7-4443-960f-62916a41fc04 on n-h2-851029-13 Oct 04 21:05:15.408017 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9fba6828-0937-45e2-a34b-063feddeab94 req-540d64c8-f57a-4e04-a1a4-e7ad718a9d95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192968 Oct 04 21:05:15.410344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1927/3934] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:15.445324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:15.445324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:15.460408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.461502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.462381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.463761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.464661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.465461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.762098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:15.806260 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b6374f5-a51e-4abc-aca9-1f6ff66f03c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1272 microversion: 2.1 time: 0.851861 Oct 04 21:05:15.815986 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2008/3935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:14 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1272 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:15.979368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:15.987711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:16.019599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.044716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.053998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.058493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.059993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.065278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.068053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:16.141737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:16.988509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:17.025203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:17.079865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:17.084557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:17.085267 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c44d5d1-96d9-4eb7-be07-da0ebb32c719 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 1.108573 Oct 04 21:05:17.088084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2009/3936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:15 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:17.100837 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a15b24ac-f946-49b5-9793-1bc5cde9a43b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.678910 Oct 04 21:05:17.100837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1928/3937] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:15 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:17.108918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:17.111744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:17.117037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:17.122257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:17.125111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.126429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.128169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:17.131014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.133082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.134150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:17.151147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.152648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.153767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:17.155410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.156562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.157585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:17.206785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:17.501415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:17.525756 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebadce14-b325-4944-8a76-0739d6a9c40f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1272 microversion: 2.1 time: 0.424326 Oct 04 21:05:17.529096 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1929/3938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:17 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1272 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:18.000952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:18.027891 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a6e8588-46ac-44cc-bfda-6b2ad7035c00 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1370 microversion: 2.1 time: 0.936073 Oct 04 21:05:18.040161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2010/3939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:17 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1370 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:18.140886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:18.146338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:18.159876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:18.160792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:18.161183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:18.185666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:18.187873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:18.189660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:18.190571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:18.191188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:18.191374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:18.193266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:18.194152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:18.195014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:18.195770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:18.196615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:18.200310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.187905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:19.218552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf5874a9-672c-407e-a5f2-313cdbacf168 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1293 microversion: 2.1 time: 1.087303 Oct 04 21:05:19.224479 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1930/3940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:18 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1293 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:19.236866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:19.288908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:19.290235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:19.291368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.342945 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] Creating event network-changed:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:05:19.362711 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-06e6f6c8-86f0-460c-9c32-68b084912325 req-6947a038-c787-42fa-8de6-ccc2e53ca39b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135533 Oct 04 21:05:19.377358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1931/3941] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:19.396582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:19.401751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:19.419119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:19.420676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:19.423459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.423459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:19.424789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:19.427161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.976527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:19.999974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:20.004406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:20.007688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1c57594-af1c-4914-99c6-bbb79ed6b961 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.855287 Oct 04 21:05:20.028073 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2011/3942] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:18 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:20.061359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:20.063319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:20.077350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.079042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.080310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.082215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.084586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.085975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.092241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:20.132255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 HTTP/1.1 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '609aafb9-0bb6-4033-b54f-20b7448f7eb9'} Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:20.136616 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.145464 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.152364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:20.155096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0be9a29-3344-4abc-8694-4d0b74f5a4cf tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 404 len: 111 microversion: 2.1 time: 0.124078 Oct 04 21:05:20.164081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2012/3943] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:20 2022] DELETE /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:20.177543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:20.180294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:20.200167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.201357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.202358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.205362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.208770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.210273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.795444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:20.832788 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b657573-5cac-49c0-9397-d971082352c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 1.455299 Oct 04 21:05:20.833956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1932/3944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:19 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:20.847200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:20.849401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 609aafb9-0bb6-4033-b54f-20b7448f7eb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:20.864908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.867170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.869208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.870831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.872705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.873876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.904019 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 HTTP/1.1 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '609aafb9-0bb6-4033-b54f-20b7448f7eb9'} Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:20.907745 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 609aafb9-0bb6-4033-b54f-20b7448f7eb9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:20.915104 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d003b1d-e2c7-4622-8369-bc9b46d734c1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9" status: 404 len: 111 microversion: 2.1 time: 0.073570 Oct 04 21:05:20.917341 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1933/3945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:20 2022] GET /compute/v2.1/servers/609aafb9-0bb6-4033-b54f-20b7448f7eb9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:20.927328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:20.929017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:20.940346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.941267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.942726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.944480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.950387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.951440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.151484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:21.182942 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc86aeda-c5b5-4a3a-a3a5-5fac6105612f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1370 microversion: 2.1 time: 1.014989 Oct 04 21:05:21.186990 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2013/3946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:20 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1370 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:21.223608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:21.224563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:21.228013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:21.237939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.239753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.240542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.241839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.242714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.243477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.275880 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea HTTP/1.1 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '27b4398d-3a41-470e-a1e2-33f059982dea'} Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:21.279000 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d0fdb6a-ec6d-40e2-9532-b61c60a013a1 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 404 len: 111 microversion: 2.1 time: 0.091771 Oct 04 21:05:21.292378 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2014/3947] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:21 2022] DELETE /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:21.784091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:21.786473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:21.814357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.816565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.818908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.821020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.823009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.824812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.110803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:22.142320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1c97000-9b66-4897-a1f5-72229c9ee675 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1483 microversion: 2.1 time: 1.223099 Oct 04 21:05:22.145588 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1934/3948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:20 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1483 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:22.160356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:22.162885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] [instance: 27b4398d-3a41-470e-a1e2-33f059982dea] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:22.184295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.186373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.187819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.190151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.193590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.195500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.234753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] HTTP exception thrown: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Request method failure captured: Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea HTTP/1.1 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ2mNWoaXbwzZk-f8iFEHvFVR7fqiq3knHFqd3hJy2JhoN40wdRXavztpkp5E1ngXg45X05A2ELkmq8o4Xyv5gJJPqtKNoPe9FB1oMzVBMFGjyEa4OemMohXwcAflxfBYwIVncbYgjTXb0irdhZsiNxmvkZIsav52va6LqrQ9wznvlY Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c03a10cf0a9149feb00c329db60fc040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c03a10cf0a9149feb00c329db60fc040 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-736784144 Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6378bcb2439f49b2be3e8eae9a87b26f Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-736784144-project Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '27b4398d-3a41-470e-a1e2-33f059982dea'} Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:22.240954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. Oct 04 21:05:22.249864 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:05:22.255028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] Returning 404 to user: Instance 27b4398d-3a41-470e-a1e2-33f059982dea could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:22.258191 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d07d46be-dff1-4142-a07e-b28aa4560c63 tempest-DeleteServersTestJSON-736784144 tempest-DeleteServersTestJSON-736784144-project] 10.222.0.36 "GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea" status: 404 len: 111 microversion: 2.1 time: 0.109160 Oct 04 21:05:22.260390 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1935/3949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:22 2022] GET /compute/v2.1/servers/27b4398d-3a41-470e-a1e2-33f059982dea => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:22.277537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:22.280589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:22.299226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.300647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.303872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.305815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.307379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.308594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:23.711804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:23.732281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:23.736262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:23.740041 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87a12f8e-516f-48b6-a0e4-d987ef209d8c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 2.454759 Oct 04 21:05:23.741662 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2015/3950] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:21 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:23.752565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:23.755625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:23.784831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:23.790781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:23.791997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:23.796499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:23.800567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:23.803218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:24.179194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:24.203865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-788177a3-a326-4e7d-aec7-b82a70946612 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 1.938434 Oct 04 21:05:24.206165 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1936/3951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:22 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:24.229963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:24.232159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:24.249324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:24.250841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:24.263747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:24.263747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:24.263747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:24.263747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:24.544784 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0de30e9e-726d-43c5-8efb-4f4d4014aa13 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.799862 Oct 04 21:05:24.546121 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2016/3952] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:05:23 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04/os-interface => generated 284 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:24.810155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:24.811754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:24.827847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:24.830423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:24.831410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:24.834566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:24.835613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:24.836667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.088403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:26.118634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d20b2fb-d486-4f38-9730-5c23cbfa2b26 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1370 microversion: 2.1 time: 1.909719 Oct 04 21:05:26.135065 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1937/3953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:24 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1370 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:26.148640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:26.155695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:26.173461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.174829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.176004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.180554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.182792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.185735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.216496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:26.267096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:26.280650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:26.282548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-251310c9-9162-4e67-8472-e2ce6500e69d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.485738 Oct 04 21:05:26.284947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2017/3954] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:24 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:26.295764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "name": "network-vif-plugged", "status": "completed", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:26.339794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.340668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.341512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.400931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] Creating event network-vif-plugged:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:05:26.426464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-518df297-b3bc-48f9-96c7-e5c97bc160e2 req-f49e43be-54b6-4211-8130-2961c7a4b935 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137477 Oct 04 21:05:26.428547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2018/3955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:27.171610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:27.173135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:27.187926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.189174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.190062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:27.191532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.194945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.195287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:27.464487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:27.499396 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3fc9e42b-99af-446a-96cd-bd34a24567a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 1.361609 Oct 04 21:05:27.503366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1938/3956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:26 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:27.520734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:27.522327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:27.537183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.538126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.539413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:27.541162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.542426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.543637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:28.523627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:28.555781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c871aca-a893-449a-becb-cba24ec3c14d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1370 microversion: 2.1 time: 1.394731 Oct 04 21:05:28.558017 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2019/3957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:27 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1370 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:28.589141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:28.595480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:28.622710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:28.623683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:28.625664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:28.627163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:28.628049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:28.628906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:29.676724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.726481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.734364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.738019 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-349c8ec9-c22d-4283-8d06-9d2a278ef44a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 2.228762 Oct 04 21:05:29.740797 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1939/3958] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:27 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:29.758767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ba3572-1d9f-40b8-940e-e75ac39a0f02", "tag": "a3699fd0-7a98-415b-9d81-f721b7feabeb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:29.837712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:29.838531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:29.842400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:29.876067 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] Creating event network-changed:a3699fd0-7a98-415b-9d81-f721b7feabeb for instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 on n-h1-851029-13 Oct 04 21:05:29.909899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b97939fa-282d-46b9-8d04-b0c5722edfbf req-c3e7770d-04bb-4121-b1d1-c4912ad0fd94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163179 Oct 04 21:05:29.911571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1940/3959] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:29.920880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:29.922479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:29.939905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:29.961597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:29.964856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:29.967041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:29.968318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:29.972676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:30.542058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:30.591617 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89acf28a-f5ee-441c-9178-2fea51fa1a9a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 2.030056 Oct 04 21:05:30.618806 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2020/3960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:28 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:30.637520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:30.642366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:30.673512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:30.675256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:30.677427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:30.680588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:30.684614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:30.687504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:30.985305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:31.013498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ec3e86b-255d-44d5-b3e1-792328836f65 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1565 microversion: 2.1 time: 1.099482 Oct 04 21:05:31.014728 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1941/3961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:29 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1565 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:31.083105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e7d156-a5a7-4443-960f-62916a41fc04", "tag": "a687a67b-12f6-41cd-b1f7-1ddb286f47d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:31.127445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:31.128783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:31.132330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:31.190802 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] Creating event network-changed:a687a67b-12f6-41cd-b1f7-1ddb286f47d5 for instance d8e7d156-a5a7-4443-960f-62916a41fc04 on n-h2-851029-13 Oct 04 21:05:31.198016 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-909d94d6-7226-4dcc-b100-9851b8b560d6 req-fdcce5da-e219-4ed1-b74d-06dbe3651262 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156835 Oct 04 21:05:31.200663 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1942/3962] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:31.212914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:31.215231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:31.230286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:31.231914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:31.233354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:31.235149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:31.236505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:31.237735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:33.520653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:33.596547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f06df6ff-e3ab-46ec-891d-b78e33e06752 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1483 microversion: 2.1 time: 2.974358 Oct 04 21:05:33.619990 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2021/3963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:30 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1483 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:33.654095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:33.657685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:33.699297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:33.703948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:33.705448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:33.708739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:33.713767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:33.715792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.221626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:34.285209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:34.297382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:34.307616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ffd64a1-f8d5-4e1b-b732-9e71d9ee3335 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 3.099656 Oct 04 21:05:34.309214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1943/3964] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:31 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 3107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:34.338197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:34.343291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:34.378192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.379056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.379928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.381347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.382776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.383951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.527385 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-90a20df8-d990-47b5-9e7e-449601f97882 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.903383 Oct 04 21:05:34.539723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2022/3965] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:05:33 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-interface => generated 285 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:35.228652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:35.255082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7cd1780a-189c-4300-a1dd-f48719b48f5d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 0.941610 Oct 04 21:05:35.267553 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1944/3966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:34 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:35.363510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:35.365553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:35.402916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:35.404032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:35.407879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:35.417938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:35.420015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:35.421408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:36.324169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:36.328085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:36.343577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:36.345071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:36.346788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:36.349359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:36.350943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:36.352127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:37.094035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:37.227328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:37.256080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:37.261905 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3fe95fe7-f518-42cb-9d7b-453c408d410a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.905790 Oct 04 21:05:37.262504 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2023/3967] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:35 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:38.346296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:38.349918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:38.375642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:38.384945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:38.386544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:38.389501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:38.394830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:38.396186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:38.522000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:38.557882 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23a075f3-1c14-4a28-a864-910cccd6ae42 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 2.243121 Oct 04 21:05:38.577154 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1945/3968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:36 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:38.954347 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:05:38.956665 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 (ip 10.222.0.36) !!! Oct 04 21:05:39.625976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:39.627717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:39.657304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:39.658402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:39.660472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:39.660695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:39.662067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:39.663697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:40.391425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:40.423918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:40.453054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:40.453054 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37720352-3c2f-4536-979a-edb21f0eff9c tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 2.101047 Oct 04 21:05:40.453054 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2024/3969] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:38 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:41.505756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:41.523068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:41.553554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:41.554464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:41.555602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.557250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:41.576014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:41.577380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:41.738266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:41.771793 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9bacf0f-90d9-4803-a9f1-1438666f2cc3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 2.161229 Oct 04 21:05:41.772873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1946/3970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:39 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:42.046030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ba3572-1d9f-40b8-940e-e75ac39a0f02", "name": "network-vif-plugged", "status": "completed", "tag": "a3699fd0-7a98-415b-9d81-f721b7feabeb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:42.129739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=56 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:42.141268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:42.152734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:42.160684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:42.225722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] Creating event network-vif-plugged:a3699fd0-7a98-415b-9d81-f721b7feabeb for instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 on n-h1-851029-13 Oct 04 21:05:42.274954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4e49d814-c90e-41dd-825d-fc7c3a4fa160 req-33328ab9-8dda-4369-b3a5-e1c0749cbeb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233173 Oct 04 21:05:42.277331 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1947/3971] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:05:42.846888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:42.851955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:42.888763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:42.891487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:42.895591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:42.897519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:42.898779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:42.901454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:45.620342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:45.668962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6898825-5951-4d8e-92cd-bfd76358f1a6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1314 microversion: 2.1 time: 2.830575 Oct 04 21:05:45.690535 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1948/3972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:42 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1314 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:45.724772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:45.779684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:45.793402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:45.803430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae48b14d-cd5c-4ec7-abd8-253da99adaca tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 4.307015 Oct 04 21:05:45.822093 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2025/3973] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:41 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 4326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:45.868245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:45.976532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:45.979775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:45.984973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:46.104016 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] Creating event network-changed:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:05:46.165602 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fa4db880-63e8-40c8-a998-2e5f943cbd8f req-8ad6bfeb-5e3e-4238-8f45-c53448ae5b08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335133 Oct 04 21:05:46.176099 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1949/3974] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:46.727225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.733162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:46.747307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:46.763222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:46.764843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:46.766789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:46.768064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:46.775008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:46.891523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:46.894935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:46.913683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:46.915379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:46.917296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:46.929650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:46.931307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:46.932856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:47.000884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:47.869597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:47.891605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5949b03c-0e14-4fc1-a6bc-b0ec414ade9d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1501 microversion: 2.1 time: 1.172019 Oct 04 21:05:47.924331 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2026/3975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1501 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:47.963698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:47.964605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:47.969525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:47.985356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:47.987135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:47.987916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:48.004801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:48.008052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:48.008678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:48.020455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:48.024460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:48.031344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8e0fecb-16a4-411b-aeb5-b678def0e5a3 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.144988 Oct 04 21:05:48.035793 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1950/3976] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:46 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:49.089351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:49.097962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:49.123216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:49.123691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:49.129705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:49.131625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:49.133313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:49.134734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:49.475717 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1539d34d-3bd9-449d-9716-ba684ad31bf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 1.526937 Oct 04 21:05:49.487381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2027/3977] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:47 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:49.847846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:49.922183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:49.929631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:49.946895 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3afd4467-a20a-40c5-9b24-1663498e8371 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.849922 Oct 04 21:05:49.946895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1951/3978] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:49 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:50.510750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:50.524079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:50.561308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:50.562611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:50.563947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:50.565641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:50.567382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:50.569951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:50.610182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=78 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.737451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1cc047d6-f901-4eec-a7fe-e1085715fb67 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.236785 Oct 04 21:05:50.740802 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2028/3979] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:50 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:51.002598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:51.009717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:51.073516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:51.075280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:51.078895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:51.118931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:51.123355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:51.132032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:51.760249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:51.771822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:51.799609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=30 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:51.815852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:51.823774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:51.827212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:51.835956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:51.839045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:51.844001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:51.845274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:51.871029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:51.879835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:51.895286 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b53ba9d9-d0dd-4c25-bbba-e7d9d4837128 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.904963 Oct 04 21:05:51.938997 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1952/3980] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:50 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:51.998487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c7cd656-e92e-4c45-94fb-ce58928a9320 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.245924 Oct 04 21:05:52.001521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2029/3981] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:51 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:52.962493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:52.970226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:53.002158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.004649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.006168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.039948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.044699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:53.048087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.049943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.089997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:53.133734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.142346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.142346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.150989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.153225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.163106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.281544 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59af5783-1962-4616-8f8a-c562174e0a97 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.265141 Oct 04 21:05:53.287249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2030/3982] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:53 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:54.071123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.112910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.131614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.137267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd4ef834-f338-4e3c-ba2a-67c92fc2cff8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.185650 Oct 04 21:05:54.143782 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1953/3983] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:52 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:54.305835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:54.319463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:54.407593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:54.408708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:54.411874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:54.413881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:54.426247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:54.426247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:54.569799 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1dc08d8e-e414-4063-826c-c34f2bc38c90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.271765 Oct 04 21:05:54.594338 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2031/3984] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:54 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:05:55.235804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:55.241930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.298750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.304777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.306610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.312475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.320992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.325818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.606162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:55.620898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.660491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.666350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.669939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.673604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.677936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.681655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.844930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c864999-1123-40c0-b12d-9c735e6046af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.250245 Oct 04 21:05:55.849055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2032/3985] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:55 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:05:56.139947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.167947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.171927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.178227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27543ebf-fe88-455c-9f8f-8b77cfd99126 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.981488 Oct 04 21:05:56.195145 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1954/3986] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:55 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:56.870589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:56.879883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:56.903263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:56.904980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:56.907806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:56.910492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:56.915763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:56.917409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.019571 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2bd3194-de06-4052-9199-38a6fbc3c8c8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.159559 Oct 04 21:05:57.030516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2033/3987] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:56 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:57.236210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:57.241103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:57.265582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.267697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.270145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.285583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.285583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.285583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.873398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:57.899867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:57.907079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:57.907079 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fbedfbd-cb57-4cab-9e42-4a5a10f32a2e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.676808 Oct 04 21:05:57.908224 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1955/3988] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:57 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:58.042266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:58.048208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:58.065230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:58.066464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:58.067178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:58.068112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:58.068892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:58.069844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:58.147595 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e241f421-bb9c-4008-bc5e-b61ec82b3237 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.112596 Oct 04 21:05:58.149158 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2034/3989] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:58 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:05:58.957500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:58.979279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:59.003108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.004917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.007254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.009895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.011157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.012334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.181651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:59.186010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:59.222306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.223207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.224003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.227862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.227862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.235569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.455485 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a9f6a6f-c0c7-4510-b466-738a489b1730 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 14 microversion: 2.1 time: 0.292944 Oct 04 21:05:59.462331 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2035/3990] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:05:59 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 14 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:00.052829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.102726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.112450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.118047 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5ed686c-bdeb-4e74-85b2-7753417d760a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.165907 Oct 04 21:06:00.120697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1956/3991] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:58 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:00.481846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:00.497542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:00.532654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.533715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.534567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.536559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.537329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.538119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.699897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e1e8580-50d9-4bb0-b2aa-3f0a42df1d1f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action" status: 200 len: 8208 microversion: 2.1 time: 0.227137 Oct 04 21:06:00.703119 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2036/3992] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:00 2022] POST /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02/action => generated 8208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:00.720096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:00.721777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:00.734258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.735595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.736668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.738467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.739743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.740847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.177625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:01.182581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:01.195789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.197127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.198462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.200160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.202846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.204352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.464498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.488264 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c3731e2-f80f-4342-8cd5-652d3486a96c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.774761 Oct 04 21:06:01.515305 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1957/3993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:00 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:01.583873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:01.584912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:01.616374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.617259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.618853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.620779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.621953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.623397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.408643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:02.457730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:02.461798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:02.465671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b0a70a5-0b3f-4c8d-a729-8e5e59f16130 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.300821 Oct 04 21:06:02.467656 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2037/3994] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:01 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:02.476989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1d7ac05-6006-4afc-bff0-b7a91db9f4b8"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.482595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:02.494073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.495393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.496753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.499584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.500795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.501864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.725608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:02.755204 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c265d395-ce7d-4fc9-a95c-683081a2b425 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.189623 Oct 04 21:06:02.786432 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1958/3995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:01 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:02.833340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.837982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:02.875072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.876000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.880056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.881638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.885341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.887841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:03.431405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.453061 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c34e2a71-6872-4e19-b14b-c89f602f3ac7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.648685 Oct 04 21:06:03.454576 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1959/3996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:03.500279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:03.516193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:03.529654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:03.531177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:03.532243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:03.533678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:03.535551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:03.536647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.248452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:04.280820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9158689-643b-4759-8eb5-6a30e26ddc04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.787104 Oct 04 21:06:04.281975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1960/3997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:03 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:04.291705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.294438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.308254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.309064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.309905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.311438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.312665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.314064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.378369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb566125-e4be-4374-9a23-98e16645283f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.907837 Oct 04 21:06:04.381519 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2038/3998] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 194 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:04.399259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:04.406349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.418058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.419421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.420758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.423186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.424149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.425146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.833647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Locking {{(pid=123541) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 21:06:05.250497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.293915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.297957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.301929 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e823b2-d5d3-4772-b2db-c2dfb2df8a74 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.018157 Oct 04 21:06:05.305225 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1961/3999] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:05.387642 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81d195f0-0f00-4166-b2ca-380526640fac tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 1.002899 Oct 04 21:06:05.406428 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2039/4000] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:04 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:05.411422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:05.423654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:05.450971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.450971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.450971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:05.453226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.454334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.455369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.057259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.099104 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b264c32d-6039-45fd-9f9d-5ba1e2e85ca9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.695473 Oct 04 21:06:06.103221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1962/4001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:05 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:06.148542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:06.163643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.165084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.166297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.223424 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action HTTP/1.1 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 15 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: {"os-stop": {}} Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '320290b7-8047-476b-b477-7fdd6f02ad67', 'body': {'os-stop': {}}} Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked Oct 04 21:06:06.228334 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:06:06.247221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 409 to user: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 is locked {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:06.247221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2ca509e2-550c-4670-942e-7ed193562ec9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 409 len: 107 microversion: 2.1 time: 0.092947 Oct 04 21:06:06.248364 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2040/4002] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:06 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:06.249659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:06.254164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:06.287075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.289030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.293015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.297989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.301423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.306476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.360668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.362283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:06.383251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.396784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.399669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.405997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.408915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.413126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.772107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Unlocking {{(pid=123542) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 21:06:07.210622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e1582ac-36da-4cd2-b48d-784780096438 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.968982 Oct 04 21:06:07.218845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1963/4003] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:06 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:07.255499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:07.287700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:07.296281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.297426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.298285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.356647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:07.362206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:07.369953 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25c1ded5-4373-44b3-8c48-e2bafcfbceaf tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.022187 Oct 04 21:06:07.390536 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2041/4004] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:07.412857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Going to try to stop instance {{(pid=123542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:06:07.510013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:07.973789 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47d98090-cffc-4ef2-b6f2-13dd91a42980 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.751941 Oct 04 21:06:07.976965 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1964/4005] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:07 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:07.990752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:07.995306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:08.016722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.023868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.024878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.026416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.027635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.028575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.084936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "7e9671fe-e420-4d77-bc2e-58859c1d9e34"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:08.128919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.141571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.141571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.198912 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] Creating event network-vif-plugged:7e9671fe-e420-4d77-bc2e-58859c1d9e34 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:08.235192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-379f85ca-a9b8-4851-802b-bcb9aca22840 req-daf11b79-1991-46b5-b442-14640b684892 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157938 Oct 04 21:06:08.244952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1965/4006] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:08.437746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:08.443985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:08.476834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.480878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.486535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.486535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.490244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.492879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.648763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.674619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3801ae7d-5c6d-49a4-b2a6-a69d09ea1ba8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.692436 Oct 04 21:06:08.681463 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2042/4007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:09.201539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.286003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.301131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.308093 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f995299-fafd-43b1-a372-8eddccd08bb9 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.875513 Oct 04 21:06:09.327600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1966/4008] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:08 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:09.723316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.724541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:09.760611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.767535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.767535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.767535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.767535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.767535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.166314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:10.205386 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-690d262d-c1ff-46dd-9114-23164e6edfd3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.490105 Oct 04 21:06:10.224161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2043/4009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:10.380897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:10.382283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:10.397801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.398851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.399766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.401420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.402410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.403430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.272352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:11.277008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:11.278918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.310735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.313936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.316736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.324454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.328934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.329686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.329948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.336598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.339688 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2ebe2f6-3e13-418b-991b-9860774ced26 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 0.968644 Oct 04 21:06:11.345539 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1967/4010] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:10 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:11.396951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:11.450833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "e7d5ab4f-820d-4e55-a179-5023e49c5d2a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:11.524036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.525831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.527533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.589674 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] Creating event network-vif-plugged:e7d5ab4f-820d-4e55-a179-5023e49c5d2a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:11.603467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d30fc122-a162-4c25-a033-997deb0cae07 req-49b889de-737e-43b4-a81a-10c78c6b8440 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165769 Oct 04 21:06:11.606692 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1968/4011] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:12.185409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.204676 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e2bdb87-d761-4551-ae83-a746e62cb16e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.949907 Oct 04 21:06:12.210271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2044/4012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:11 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:12.410583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.433251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:12.484977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.490082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.491924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.494540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.496813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.500801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.270339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:13.274030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:13.329510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.335973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.341303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.350512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.359106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.362966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.702444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.763442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.780161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:13.788516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71f901dd-2994-489a-a180-8ece117da584 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.396318 Oct 04 21:06:13.789745 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1969/4013] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:14.110321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.160675 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d3d3357-ae04-49b0-90db-8cd61fdb7b83 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.891034 Oct 04 21:06:14.172795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "93a4e256-8c57-4536-b81c-220b77c4594f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:14.199567 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2045/4014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:13 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:14.230890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:14.241986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.243482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.247052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.308927 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] Creating event network-vif-plugged:93a4e256-8c57-4536-b81c-220b77c4594f for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:14.336887 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7ea21245-11a7-4b2b-abf6-3914308d7d4f req-179caecb-9ecb-42f9-8b0a-209d5b675381 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187610 Oct 04 21:06:14.340042 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1970/4015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:14.848166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:14.850567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:14.898625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.899626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.900541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.901919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.903076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.928900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.228806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.230140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:15.301921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.321632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.322530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.340761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.341713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.347289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:18.087333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.117638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74fe4a6a-a4b9-4e9e-8b75-4eb42a760b92 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 2.899554 Oct 04 21:06:18.144058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1971/4016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:15 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 2928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:18.185003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "24459c03-b523-48fe-b744-d8e703f3d412"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:18.213948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:18.219716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:18.221048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:18.272676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.280815 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] Creating event network-vif-plugged:24459c03-b523-48fe-b744-d8e703f3d412 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:18.309237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b8c87ae8-97d6-474c-b106-5aaf0bc0b86a req-936ea398-c549-480d-aae0-e566f58fec85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152389 Oct 04 21:06:18.312431 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1972/4017] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:18.384165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.414255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:18.414255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f653a92-e105-4952-9757-9671758056bc tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 3.560172 Oct 04 21:06:18.415436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2046/4018] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 3576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:19.183689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:19.185170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:19.224440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.234968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.236058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.238038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.238952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.239782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.485271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:19.486248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:19.522002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.536910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.536910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:19.536910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:19.540165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:19.541627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.493824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:20.531603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:20.535209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:20.537463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae386b47-edf7-4ab4-b148-d5a3cb362b72 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.074310 Oct 04 21:06:20.549561 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2047/4019] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:19 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:20.595330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "e5c13171-a4f5-4cc9-87ca-58d6d153e34a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:20.632488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.640318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.642101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.679915 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] Creating event network-vif-plugged:e5c13171-a4f5-4cc9-87ca-58d6d153e34a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:20.694378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4ee361a6-e230-4564-8104-a9c5b61500e6 req-571ca8b5-b65a-447a-9de5-0872ab9bc6e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106108 Oct 04 21:06:20.700093 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2048/4020] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:20.821006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:20.908451 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7ef9ee76-721d-4e65-809a-fabf40b97c2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1655 microversion: 2.1 time: 1.733838 Oct 04 21:06:20.910573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1973/4021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:19 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1655 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:20.956122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:20.969447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.970948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.972302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.031923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:06:21.496825 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2019db3-fe02-446d-aa3f-e0585e229573 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.531471 Oct 04 21:06:21.510217 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2049/4022] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:20 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:21.518187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:21.523600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:21.555748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.557281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.558471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.560163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.561590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.562885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.621970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:21.635293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:21.693476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.694379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.695272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.696629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.697511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.698313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.887516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:22.925962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9cec9e8c-20de-41a6-aa00-2a063410e787 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1664 microversion: 2.1 time: 1.408532 Oct 04 21:06:22.925962 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1974/4023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:21 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1664 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:23.083812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:23.128025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:23.143115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:23.150742 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33e2265e-cec8-4c30-a85b-1ddb511c235b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.541926 Oct 04 21:06:23.175728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2050/4024] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:21 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:23.508295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "fca02ccb-d52e-4b3a-b636-8c6d705f39fb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:23.583944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:23.587260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:23.593263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:23.677261 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] Creating event network-vif-plugged:fca02ccb-d52e-4b3a-b636-8c6d705f39fb for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:23.711205 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b8e303af-a435-49c3-b5af-94eb6db9f805 req-1ce9b518-abdb-4e8a-8ab8-4be58c299f7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206422 Oct 04 21:06:23.717327 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1975/4025] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:23.982563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:23.983640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:24.010293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=44 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:24.040575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.044416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.044416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.048910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.050302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.051180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.224163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:24.232293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:24.292943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.296400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.301205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:24.316854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:24.320535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:24.323717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.316937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.361392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9354d5a2-4831-4f27-9f3b-4599f002f7e1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1664 microversion: 2.1 time: 1.378498 Oct 04 21:06:25.361392 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2051/4026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:23 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1664 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:25.394565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.460903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.484796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:25.495410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e36e4e92-8afa-4000-8a2a-3be772c8203b tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.296687 Oct 04 21:06:25.507937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1976/4027] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:24 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:25.843142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-plugged", "status": "completed", "tag": "4d1ed2fc-0e45-494e-92bc-5b098ec82e93"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:25.900085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:25.912280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:25.913251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:25.993295 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] Creating event network-vif-plugged:4d1ed2fc-0e45-494e-92bc-5b098ec82e93 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:26.023664 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e49d32b3-40b6-4d0d-b7c3-294a10aefc8c req-062d9212-1529-4c01-a389-c65c59ecf8a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198960 Oct 04 21:06:26.027809 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2052/4028] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:26.412364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:26.416778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:26.442382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.448188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.454958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.454958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.458207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.459119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.565931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:26.573250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:26.609886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.609886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.609886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:26.609886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:26.610683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:26.611719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:27.904506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:27.925543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:27.946304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d3c207c-ef40-443b-92d8-3f6b821253b7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.538992 Oct 04 21:06:27.947834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1977/4029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:26 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:28.006225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:28.016216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:28.017783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:28.019819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:28.028128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a67db2a9-2853-494e-8091-54da4478e4b8 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.475056 Oct 04 21:06:28.035771 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2053/4030] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:26 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:28.068020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.087960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.088655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.089977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.090876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.097843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.806592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:28.839329 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-890d5860-cff2-4a7e-b85a-589ae85e2f88 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.840697 Oct 04 21:06:28.842313 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1978/4031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:27 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:28.892918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:28.894184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:28.916286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.917238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.918478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:28.920115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:28.921497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:28.922492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.131741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:29.136304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:29.151585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.152726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.154104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.156025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:29.160268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:29.164698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:29.640279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Unlocking {{(pid=123541) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 21:06:30.199631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:30.280957 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d99e9c0b-9214-48cc-b031-f94ddbd4b8e7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 1.393162 Oct 04 21:06:30.281203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:30.281388 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2054/4032] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:28 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:30.286766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:30.298067 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c3848cc-2d94-4759-ae85-67f8847dc322 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1880 microversion: 2.32 time: 1.193613 Oct 04 21:06:30.302897 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1979/4033] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:29 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1880 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:30.326079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:30.327843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:30.332197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:30.343540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:30.368242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.369428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.370333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.372934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.374333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.375988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.386476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.387586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.388427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.398485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:30.400720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:30.404371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:30.544415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'flavor' on Instance uuid f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:06:30.945934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:30.971060 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cce61f41-d5d8-4539-af61-ac80e08e02bb tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.664767 Oct 04 21:06:30.972655 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1980/4034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:30 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:31.025615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.032301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:31.057083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.058365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.059307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.062156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.063486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.066316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.667058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:31.668965 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf242e8f-37d4-4e33-831f-16057d88ccea tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/action" status: 200 len: 32 microversion: 2.1 time: 1.386331 Oct 04 21:06:31.683409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2055/4035] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:30 2022] POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/action => generated 32 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:06:31.697629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.707866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:31.718100 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7eb8033-6eb4-44f6-b0f5-805c89745499 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.709870 Oct 04 21:06:31.727023 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1981/4036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:31.746651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.749506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:31.750112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.751848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:31.754860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.760128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.763859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.765787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.769836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.771266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.772587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:31.774289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:31.775511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:31.777105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.182712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.208016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:33.225162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.230388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.233786 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6cadaa2-9e06-4900-89ee-35dcd8ce216d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2828 microversion: 2.32 time: 1.545534 Oct 04 21:06:33.235463 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2056/4037] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2828 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:33.246015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.247761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:33.261248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.262963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.264275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.266054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.267845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.269166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.600104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.683563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d34bdd4-e2f1-4d7b-aae5-def13a750f8d tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 1.947972 Oct 04 21:06:33.692266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1982/4038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:31 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:33.733410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:33.737110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:33.800197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.801169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.802035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.818501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:33.821224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:33.822001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:33.931687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:33.957584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d83ed23-133c-4d22-814c-8666e4c9e099 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.715163 Oct 04 21:06:33.966342 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2057/4039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:33 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:34.014645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:34.021051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.048916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.053405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.057034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.061651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.063205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.064564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.647579 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bfffc86-f960-4333-b02a-45e1eeb691a5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.639800 Oct 04 21:06:34.649747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2058/4040] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:34 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:06:34.687106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:34.688536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.720607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.721452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.727899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.729343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.734005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.735263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.876784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-115be593-6cd4-415c-a395-80ff6ca85ed5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.178089 Oct 04 21:06:34.879538 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1983/4041] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:06:33 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531/os-interface => generated 1830 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:34.905979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:34.916742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:34.977228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.984482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.985564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:34.993047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:34.996902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:34.998703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:35.124641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:36.351120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:36.369759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:36.373661 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15129af5-7535-4407-bade-089f21ce8993 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 1.491200 Oct 04 21:06:36.378924 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1984/4042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:34 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:36.403801 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e58b03a-79b6-4250-8e0d-70a2be183b74 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1673 microversion: 2.1 time: 1.747222 Oct 04 21:06:36.420226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2059/4043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:34 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1673 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:37.430374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:37.433482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:37.467557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.473786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.475384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:37.476500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:37.477654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:37.479209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.482506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.484289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:37.521296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.522156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.522978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:37.524361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:37.525145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:37.532963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.575401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:39.614255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b70df93b-0f20-43b4-a6d9-490485000b05 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1653 microversion: 2.1 time: 2.151058 Oct 04 21:06:39.691355 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2060/4044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:37 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1653 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:39.724536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:39.740152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:39.781119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.783115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.784810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:39.786371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:39.787537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:39.788597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.268298 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39ca3e65-3bb6-48c4-aef3-392608b0c559 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.565661 Oct 04 21:06:40.278105 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2061/4045] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:39 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:40.282481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:40.324634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:40.329331 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9676399-5f39-4040-8c68-51f41f64b165 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 2.912595 Oct 04 21:06:40.332777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:40.362426 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1985/4046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:37 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 2947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:40.393931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.399457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.402080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.413798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.418233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.421984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:42.230462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:42.239596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:42.294726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.300218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.302906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:42.307823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:42.311891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:42.316510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:43.120215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:43.160894 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-454bfece-a266-437f-8de0-a14658b5ce28 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1660 microversion: 2.1 time: 2.874731 Oct 04 21:06:43.163563 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2062/4047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:40 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1660 bytes in 2881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:44.241966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:44.243345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:44.294760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.295375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.300289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:44.304826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:44.305340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:44.311448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.078062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:45.107228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0bbbcfe-3173-43e8-965c-cac2907bf024 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 3.740949 Oct 04 21:06:45.112981 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1986/4048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:41 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 3747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:45.125616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "tag": "4d1ed2fc-0e45-494e-92bc-5b098ec82e93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:45.181002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.189497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.190853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.250602 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] Creating event network-changed:4d1ed2fc-0e45-494e-92bc-5b098ec82e93 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:06:45.271173 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-10e3db36-2088-47a0-8040-8cfc3a4df506 req-2046c4cf-699c-4d75-8a64-a56a2af06dff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152361 Oct 04 21:06:45.272412 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1987/4049] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:45.753814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:45.810969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6e8da9d7-e87c-4b82-99ac-1c19368cb96e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.604880 Oct 04 21:06:45.812747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2063/4050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:44 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:45.867344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:45.881838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:45.917927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=36 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:45.937956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.939438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.946302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:45.949383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:45.961438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:45.963156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:46.175287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:46.180671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:46.230208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:46.232660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:46.239613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:46.245151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:46.249521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:46.256026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:48.170047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:48.225540 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39b323b5-21cb-4379-851c-20d9d51c409c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 2.364012 Oct 04 21:06:48.258245 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1988/4051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:45 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:48.296702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:48.305056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:48.336653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:48.337523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:48.339352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:48.343292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:48.346294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:48.349142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:48.792128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:48.833512 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-985a7306-b29b-4b06-8096-5477d34abb3c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 2.669984 Oct 04 21:06:48.862214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2064/4052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:46 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:49.765580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:49.849040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae239b61-c497-488f-bfd9-29480e35ef11 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.549194 Oct 04 21:06:49.849040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1989/4053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:48 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:49.891473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:49.895769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:49.905197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:49.908008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:49.960772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.961034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.961200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.961326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.961446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:49.961574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:49.961686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.963508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.966713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:49.972137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:49.973643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:49.975267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.540356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.573163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-264cd734-8e2c-4055-98a0-aa120c0828a9 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 1.693855 Oct 04 21:06:51.591745 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2065/4054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:49 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:51.630508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:51.661559 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-484b123b-c8ae-4d85-8bbb-c72aace66e6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.765181 Oct 04 21:06:51.671217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1990/4055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:49 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:51.711289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.712895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:51.725496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.726869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.728028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.729722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.731601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.732719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.433468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:52.463356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77624903-717d-458e-aa8a-a0dcd9070c6e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.759332 Oct 04 21:06:52.469603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2066/4056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:52.521062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:52.523600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:52.550344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.558409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.587714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.591165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.596016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.597286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.628126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:52.629414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:52.680223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.682322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.687064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.689122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.691149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.702954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.921929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:53.956757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b210c00-0bd1-4ef1-8b1a-b159e78b50f0 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1736 microversion: 2.1 time: 1.336102 Oct 04 21:06:53.971950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2067/4057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:52 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1736 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:54.005821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:54.055457 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-238e7929-ad9c-428a-a288-651dd5e9eab9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.548648 Oct 04 21:06:54.109650 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1991/4058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:52 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:55.011798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:55.012824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:55.053135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=34 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:55.059031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.063252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.064572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:55.068519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:55.069557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:55.073205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.499194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:56.537337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b906f40e-83a6-4e97-b0fc-727c86a43ce4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1716 microversion: 2.1 time: 1.532587 Oct 04 21:06:56.556496 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2068/4059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:55 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1716 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:56.704147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:56.707018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:56.726755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.728389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.730616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.733498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.735100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.736434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.973062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Cannot 'detach_volume' instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 while it is in vm_state rescued Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments/e1d7ac05-6006-4afc-bff0-b7a91db9f4b8 HTTP/1.1 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'detach_volume' instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 while it is in vm_state rescued Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0', 'id': 'e1d7ac05-6006-4afc-bff0-b7a91db9f4b8'} Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 while it is in vm_state rescued Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:06:56.983636 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 while it is in vm_state rescued Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 409 to user: Cannot 'detach_volume' instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 while it is in vm_state rescued {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:06:56.998939 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35f0d8da-682a-4f4b-bcd7-bdc9eb559c0c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments/e1d7ac05-6006-4afc-bff0-b7a91db9f4b8" status: 409 len: 152 microversion: 2.1 time: 0.308831 Oct 04 21:06:57.003031 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1992/4060] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:06:56 2022] DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments/e1d7ac05-6006-4afc-bff0-b7a91db9f4b8 => generated 152 bytes in 324 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:06:57.013797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:57.019374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:57.052497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.058616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.061637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.083148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.084752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.098057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.655369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45f171b8-a294-4ac1-85f7-53aa1b15f563 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/action" status: 202 len: 0 microversion: 2.1 time: 0.653183 Oct 04 21:06:57.659796 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2069/4061] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:56 2022] POST /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:57.685098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:57.686348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:57.733242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.737250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.738764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.742803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.747147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.748252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:58.519315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.547739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb569fbe-a6a2-40fb-a47f-61675883c61e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1724 microversion: 2.1 time: 0.878929 Oct 04 21:06:58.551267 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1993/4062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:57 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1724 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:59.595517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:59.598059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:59.617246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.618250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.618998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.626318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.628475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.629751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.682049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:00.394528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:00.418155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94b52372-1202-4484-8bfb-0df3ad70618a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1724 microversion: 2.1 time: 0.831860 Oct 04 21:07:00.436034 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2070/4063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:59 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1724 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:01.190462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.227512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.236520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Searching by: {'deleted': False, 'project_id': 'c3fde7cfcd38486abca9f10410042dba'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:07:01.287310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.287840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.304300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.310231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.313998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.330523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.503945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.522358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:01.550472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:07:01.610895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.614957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.618236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.622922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.624511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.632106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.741797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-580a4ca0-5f6c-49c7-862c-9a764a58c99a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.560617 Oct 04 21:07:01.749226 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1994/4064] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:01.780069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.816470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.822560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Searching by: {'deleted': False, 'project_id': 'c3fde7cfcd38486abca9f10410042dba'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:07:01.858854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.869722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.869722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.869722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.873318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.876385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.959656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:07:02.112048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:02.124554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.125249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.126173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.765979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:02.813917 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5fb0415-b483-4e4a-91c4-0c72423267b4 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1724 microversion: 2.1 time: 1.351986 Oct 04 21:07:02.817121 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2071/4065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1724 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:02.936286 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6045eb06-9066-4d77-856e-365b7a6ef204 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.173403 Oct 04 21:07:02.937901 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1995/4066] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:03.001409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-885258ee-b1f4-4553-bf34-fe396395a33b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:03.083696 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-885258ee-b1f4-4553-bf34-fe396395a33b tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.089626 Oct 04 21:07:03.108371 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2072/4067] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 21:07:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:03.463680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:03.478642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:03.546525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.550247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.553866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.557785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.561076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.561076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.711699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:03.861795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:03.867564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:03.896593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.897999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.902369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.938975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.939840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.947723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.658438 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77e19bb1-5964-4fe8-b329-29da1806ffe8 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 204 len: 0 microversion: 2.1 time: 1.203592 Oct 04 21:07:04.666415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1996/4068] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:03 2022] DELETE /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 0 bytes in 1214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:04.685042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:04.691981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.692768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.709432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efeb1a86-b6c0-4be7-b722-d61263dafa9a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1730 microversion: 2.1 time: 0.855469 Oct 04 21:07:04.718089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2073/4069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:03 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1730 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:04.721912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.722748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.723793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.725176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.726085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.726906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.763557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.770939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.795146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.796144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.796601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.801158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.801993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.803674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:05.178139 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a8c80cf-0b11-43b3-b1d9-14888d543bb5 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.421463 Oct 04 21:07:05.179811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2074/4070] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-interface => generated 285 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:05.616408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:05.621517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:05.638475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7b72047b-0349-47de-9bfe-e216cb904f0a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1608 microversion: 2.1 time: 0.962107 Oct 04 21:07:05.655492 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1997/4071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1608 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:06.248275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:06.263606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.306064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.314281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.319858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.321614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.326874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.330310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.686455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.694213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.723675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.724768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.725629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.732002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.733433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.734566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.030259 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a084e3b-3ecb-4077-b6cd-0214ebb019b8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.796863 Oct 04 21:07:07.045960 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2075/4072] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:06 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:07.070431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.073332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.101364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.102863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.104032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.109722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.111274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.122344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.687031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.705437 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7d3ef9f-bc96-465f-b041-1b1516d8c353 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 1.656291 Oct 04 21:07:08.707107 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2076/4073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:09.394061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:09.424042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-200bc64d-95a0-48ee-bdc0-fed797db3dd6 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1608 microversion: 2.1 time: 2.744175 Oct 04 21:07:09.446874 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1998/4074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1608 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:09.729450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e7d156-a5a7-4443-960f-62916a41fc04", "name": "network-vif-unplugged", "status": "completed", "tag": "a687a67b-12f6-41cd-b1f7-1ddb286f47d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:09.755624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.761949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.793002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.795427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.799920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.803551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.805449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.814579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.815380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.817171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.821618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.928992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] Creating event network-vif-unplugged:a687a67b-12f6-41cd-b1f7-1ddb286f47d5 for instance d8e7d156-a5a7-4443-960f-62916a41fc04 on n-h2-851029-13 Oct 04 21:07:09.953537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4d013cda-8def-49d8-b4b8-6caae8f744cf req-dcb1a20d-0be1-41f3-b20f-ed5dbdc58eb9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230921 Oct 04 21:07:09.955323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2077/4075] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:10.327885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.360098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-600d6caa-f0c7-4556-b141-fcc3eaf323d6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 0.611816 Oct 04 21:07:10.361887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1999/4076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:10.494297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:10.496290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:10.543627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.547461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.577040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.577040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:10.577040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:10.577040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.094189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:11.137446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.143339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.148175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.246005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] Creating event network-changed:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:07:11.290483 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3767e937-4859-4b7a-9415-1f4e0113487c req-43141c58-708f-4b24-8d91-8cca555bbd67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208258 Oct 04 21:07:11.295021 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2000/4077] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:11.423448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.427748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:11.461872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.468860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.485916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.488038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.493180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.494313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.556438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:11.604983 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0d874a6-9f20-457b-8570-022386279398 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1608 microversion: 2.1 time: 1.130157 Oct 04 21:07:11.635766 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2078/4078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:10 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1608 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:11.915004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:12.107949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:12.492411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.541399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-822affe8-89dc-4db9-879b-e4381d921815 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 1.133535 Oct 04 21:07:12.546541 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2001/4079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:12.652737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:12.658209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:12.739582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.741569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.747549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.750505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:12.752335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:12.754533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.437249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:13.472909 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40e77dd1-dae9-47c5-abf9-5c895c4fe6fe tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1540 microversion: 2.1 time: 0.829462 Oct 04 21:07:13.491142 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2079/4080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:12 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1540 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:13.596982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.596982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:13.629392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.631184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.632583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.634952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.645641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.663853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:13.664921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.733492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.734369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.735269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.839268 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] Creating event network-changed:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:07:13.865756 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2815924d-c1e8-4f05-9f4d-d317fe7d692f req-2ab1e440-1b94-4d9c-a7f0-0879ae5ede51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214604 Oct 04 21:07:13.883607 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2080/4081] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:14.560348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.564807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.594341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.596306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.604077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.615076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.618132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.620820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.627195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.649327 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47113ec2-132a-41f3-a0a4-5ddecfdbb763 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1670 microversion: 2.1 time: 1.063643 Oct 04 21:07:14.652623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2002/4082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1670 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:15.088621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:15.163442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5666e33-5191-4fd0-87f1-2b7805413039 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1540 microversion: 2.1 time: 0.634929 Oct 04 21:07:15.166399 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2081/4083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:14 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1540 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:15.286134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e7d156-a5a7-4443-960f-62916a41fc04", "name": "network-vif-deleted", "tag": "a687a67b-12f6-41cd-b1f7-1ddb286f47d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:15.308380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.310481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.312046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.341693 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] Creating event network-vif-deleted:a687a67b-12f6-41cd-b1f7-1ddb286f47d5 for instance d8e7d156-a5a7-4443-960f-62916a41fc04 on n-h2-851029-13 Oct 04 21:07:15.371545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d32ee8db-7a09-4f09-8960-1b03b2521148 req-61e22521-6f19-47bb-8c87-f0067bf4f8cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081134 Oct 04 21:07:15.371545 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2003/4084] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:15.701923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.709345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.727651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.733163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.733163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.747141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.750068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.755915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.212574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:16.261642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:16.327966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:16.342400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.343676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.348750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.352393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.353301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.354071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.627025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:16.649771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ec22844e-18b5-4c0a-b7b8-8733fc7dfa0c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1675 microversion: 2.1 time: 0.957858 Oct 04 21:07:16.669525 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2082/4085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1675 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:17.258059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:17.312843 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99739311-6c8e-4e80-bc0d-77437418c7f0 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 1.118376 Oct 04 21:07:17.317660 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2004/4086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:16 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:17.703701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:17.706088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:17.739520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.746203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.754449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:17.754449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.754449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.754449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.365895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:18.368460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:18.406227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.411118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.416580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.419998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:18.421005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:18.426884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.734897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.759890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a5f44fe-e706-4d9f-a8a9-14ed9bd88543 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.405633 Oct 04 21:07:18.765164 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2005/4087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:18 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:19.137055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:19.193791 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fb79c18-e76f-4bad-9441-c407bf5633b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.498876 Oct 04 21:07:19.214837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2083/4088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:17 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:19.811070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:19.813612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:19.828662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:19.829573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:19.830356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:19.831729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:19.832599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:19.833752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:19.991503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:20.003693 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9be0a839-adef-4fc8-b0f2-3c1fd431f76d tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.201544 Oct 04 21:07:20.005396 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2006/4089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:19 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:21.053561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.054877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.068838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.069727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.070577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.072077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.072958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.073777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.352970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:21.401718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3dc13d04-f124-41d1-bbda-fa26711cea40 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.350173 Oct 04 21:07:21.408905 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2084/4090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:22.466716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:22.467989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:22.472904 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:07:22.473184 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:07:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 (ip 10.222.0.36) !!! Oct 04 21:07:22.485071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.486122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.487553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.488743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:22.489273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:22.490278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:22.763542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:22.806288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3df6aefe-cd0e-4562-a4e1-bd62730adff2 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.358090 Oct 04 21:07:22.808330 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2007/4091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:22 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:23.873319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:23.877833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:23.938418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.941433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.941433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.942264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:23.943395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:23.944814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.111306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.133458 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7ee654a-ab32-485b-b67f-2c77d9bee8dd tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.275002 Oct 04 21:07:24.136052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2085/4092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:23 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:25.188001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.192308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.216446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.219642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.222060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.236154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.236154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.236154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.456094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.481826 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ba3e327-f351-4462-8a2c-59667176109f tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.306613 Oct 04 21:07:25.493580 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2008/4093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:26.531487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.534444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.558989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:26.568555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.579263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.579263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.579263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.579263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.580886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.859028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:26.892640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cbbce3f9-83d1-4e08-912f-38b566a52add tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.371163 Oct 04 21:07:26.924998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2086/4094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:27.971407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:27.975266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.014089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.015740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.017602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.025027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.026949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.036016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.275310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.327368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e8e3dc5-223d-48e4-b29c-2711f465d8a4 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1252 microversion: 2.1 time: 0.359936 Oct 04 21:07:28.328927 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2009/4095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:27 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1252 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:29.375790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:29.380469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:29.442501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.448909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.448909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.449367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.457086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.462654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.706006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.709826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.716948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.717946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lazy-loading 'fault' on Instance uuid d8e7d156-a5a7-4443-960f-62916a41fc04 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:29.956796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5295950615bc43c4a5c67a9346c5a6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fde7cfcd38486abca9f10410042dba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:30.012539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ecdd9c2-5698-4f29-bf6e-82aee0bf55de tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 200 len: 1257 microversion: 2.1 time: 0.640776 Oct 04 21:07:30.033630 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2087/4096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:29 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 1257 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:31.080877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.090815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] [instance: d8e7d156-a5a7-4443-960f-62916a41fc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:31.146291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.148112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.155918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.158306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.159962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.161372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.212326 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] HTTP exception thrown: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Request method failure captured: Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 HTTP/1.1 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ-GXfuTRJ73dqjhwEj55l5vZFmhrl_l4UiNaTocyIq9JsN0Cj2ic8EfR_BXusC2tEGiRdIrxcDyWvI-cM5iEATOr_kaeLxZJsvY4T_1Eb3x1DbQLRH2cU5vpvhylUEhv_tBsx9g0ugdGamLVmC6tuxc0C9ZB0hUE121z1HT1S4ChJQ Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c3fde7cfcd38486abca9f10410042dba Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestBootFromVolume-1705309874 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3fde7cfcd38486abca9f10410042dba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3fde7cfcd38486abca9f10410042dba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c3fde7cfcd38486abca9f10410042dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c3fde7cfcd38486abca9f10410042dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestBootFromVolume-1705309874 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c3fde7cfcd38486abca9f10410042dba Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1705309874 Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestBootFromVolume-1705309874-project Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 5295950615bc43c4a5c67a9346c5a6da Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestBootFromVolume-1705309874-project Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd8e7d156-a5a7-4443-960f-62916a41fc04'} Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:31.218405 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. Oct 04 21:07:31.227001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:31.228866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Returning 404 to user: Instance d8e7d156-a5a7-4443-960f-62916a41fc04 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:31.229872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb73932b-26da-479e-8739-c1f143f4ed2a tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04" status: 404 len: 111 microversion: 2.1 time: 0.170904 Oct 04 21:07:31.231437 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2010/4097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:31 2022] GET /compute/v2.1/servers/d8e7d156-a5a7-4443-960f-62916a41fc04 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:07:31.249954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-444f55a5-0013-40d1-84a8-de7355b20ff3 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] Calling method '.version_select at 0x7f54f5545c10>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.428205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-444f55a5-0013-40d1-84a8-de7355b20ff3 tempest-ServersTestBootFromVolume-1705309874 tempest-ServersTestBootFromVolume-1705309874-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652228699" status: 202 len: 0 microversion: 2.1 time: 0.187527 Oct 04 21:07:31.429310 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2088/4098] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 21:07:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652228699 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:36.181940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.192620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.299958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.300722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.301491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.324130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.325167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.342808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.740653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'services' on Instance uuid f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:07:37.243603 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ab5121d-3031-463a-921f-758793d78d44 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments/e1d7ac05-6006-4afc-bff0-b7a91db9f4b8" status: 202 len: 0 microversion: 2.1 time: 1.068035 Oct 04 21:07:37.258465 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2011/4099] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:07:36 2022] DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments/e1d7ac05-6006-4afc-bff0-b7a91db9f4b8 => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:07:37.297693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:37.316013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:37.356328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.365801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.369287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.377163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:37.379166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:37.382500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.410559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:37.631106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bd2e370-54a5-4323-aac0-739c6bf0197c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.369297 Oct 04 21:07:37.635663 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2089/4100] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:37 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:38.656218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:38.660746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:38.696514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.698512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.699384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.700576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.701333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.702368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.773750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:38.828089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c15fbbf7-00c6-4891-b106-a4f33f298373 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178544 Oct 04 21:07:38.846357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2012/4101] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:38 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:39.860315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:39.863904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:39.876186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.877683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.878509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.879980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.880846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:39.881703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:39.945714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06631ee7-ba90-4d12-a1e6-d1390913c0bb tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092428 Oct 04 21:07:39.947593 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2090/4102] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:39 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:40.976082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:40.988755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:41.024348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.026460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.028223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.045814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.046887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.048954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.165273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-096f1ddb-22b6-4ed1-bd42-18e420ad31f6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204514 Oct 04 21:07:41.167641 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2013/4103] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:40 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:42.208827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:42.226451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:42.269627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.274777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.280097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.288439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:42.289332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:42.290131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.435568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6182db06-6ab4-453f-9bad-7a6e3d355173 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253711 Oct 04 21:07:42.456477 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2091/4104] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:42 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:43.484895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:43.490555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.518115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.528357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.537396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.542077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.545073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.546605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.799308 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-769bf2f5-b9f2-4a14-8ef6-7f220054c276 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.329653 Oct 04 21:07:43.814368 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2014/4105] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:43 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:44.839255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.857595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.924798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.926271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.933956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.941809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.943494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.949657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.203178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea5ecde4-d365-4530-ac56-ab34e84b97b7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.368158 Oct 04 21:07:45.210440 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2092/4106] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:46.229235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.240650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.339302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.340353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.346799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.351525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.352382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.353184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.521188 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8c4423d-5b04-454d-ace4-6bacd8a7811a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.300591 Oct 04 21:07:46.522449 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2015/4107] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:47.635422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:47.642953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:47.663769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.665135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.666391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.668276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:47.669618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:47.670810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:47.801326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b0b3d72-ee41-44f6-8412-63dd651eee8c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259833 Oct 04 21:07:47.807512 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2093/4108] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:47 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:48.827759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:48.846301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:48.888898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=24 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:48.892360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.903100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.905206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.910516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.914552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.918735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:49.092156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-82db6952-df4b-4459-b936-655885f6e9bd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.271289 Oct 04 21:07:49.104923 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2016/4109] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:50.127779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.137939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.172210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.191928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.192778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.195187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.195853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.196695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.329213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c04b88e4-969a-4cce-a263-ec6066e93240 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221837 Oct 04 21:07:50.332306 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2094/4110] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:51.265598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:51.267302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:51.356078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:51.361408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:51.378212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.389875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.392701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.393544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.402844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.404115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.405625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.406762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.407632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.409084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:51.409995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:51.410886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:51.656239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49255bfb-63d9-4bc9-85b4-b4d158148422 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.308493 Oct 04 21:07:51.658013 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2095/4111] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:51 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:52.303906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.371571 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d73df3d1-dd3e-486a-9e76-73af1027c246 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.106141 Oct 04 21:07:52.373103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2017/4112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:51 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:52.423350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.431331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.474304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.482770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.483957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.486040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.487121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.488289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.682213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:52.694198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:52.722551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.724263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.725412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.730388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:52.732060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:52.733195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.951089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-adf39633-e883-4045-bce7-1502cedc5828 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.281352 Oct 04 21:07:52.965764 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2018/4113] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:53.162334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:53.201418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5dfdcb94-4df5-4e59-b7c7-5b7f805262bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.788493 Oct 04 21:07:53.202562 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2096/4114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:52 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:53.252248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:53.257765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:53.281487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.282997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.298794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.300476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.301390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.302235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.981726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:53.985709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:53.995104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.083746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d47fdb42-32b2-4c49-ad7a-94c818f04c73 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.838722 Oct 04 21:07:54.089047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2019/4115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:54.092593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.101351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.101351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.109769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.115038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.142361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.163851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.173934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.234850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.247959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.248779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.254311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.255245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.256070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.403489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-050dc7ff-5cb6-4dd9-8c4e-fb294c1109c7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.436061 Oct 04 21:07:54.408843 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2097/4116] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 197 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:55.431231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.445675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.469636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.470718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.472190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.474103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.475559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.476437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.517531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:55.563822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed1e7f85-d3f6-42b1-8885-f309c0ec4b22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.411543 Oct 04 21:07:55.565075 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2020/4117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:54 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:55.655438 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9975300f-7720-42eb-901d-080ef9b452b6 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227945 Oct 04 21:07:55.657699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2098/4118] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0/os-volume_attachments => generated 25 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:07:55.904772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:55.911886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.928440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.929786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.930949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.932638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.933800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.936718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.073691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-545096474", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6625a5dc-d4c9-493c-a356-6d80fd39a592"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:56.110733 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Cannot 'reboot' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action HTTP/1.1 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 28 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: {"reboot": {"type": "HARD"}} Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'reboot' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '762b582b-c59f-444e-b629-1da410a3215a', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 762b582b-c59f-444e-b629-1da410a3215a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:07:56.117033 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.126366 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.129593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 409 to user: Cannot 'reboot' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:56.133323 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa7f3f42-3662-4128-89c8-1f34213ea81f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action" status: 409 len: 145 microversion: 2.1 time: 0.237988 Oct 04 21:07:56.138715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2021/4119] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:55 2022] POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action => generated 145 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:07:56.167263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:56.172714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.187238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.188348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.189148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.192548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.195797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.196662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.262522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] validate_networks() for [('6625a5dc-d4c9-493c-a356-6d80fd39a592', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:56.330547 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Cannot 'rebuild' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action HTTP/1.1 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 65 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: exception: Cannot 'rebuild' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '762b582b-c59f-444e-b629-1da410a3215a', 'body': {'rebuild': {'imageRef': '08650df2-2319-4b76-af09-4569093fd163'}}} Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 762b582b-c59f-444e-b629-1da410a3215a in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:56.342365 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 409 to user: Cannot 'rebuild' instance 762b582b-c59f-444e-b629-1da410a3215a while it is in vm_state rescued {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:56.353353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d00505e-70ce-4674-a065-032fa12e4583 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action" status: 409 len: 146 microversion: 2.1 time: 0.193458 Oct 04 21:07:56.365300 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2022/4120] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:56 2022] POST /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a/action => generated 146 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 21:07:56.385036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:56.386201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.409697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.410418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.417045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.421109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.428042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.429416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.586585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:57.319034 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afe7adc0-e27c-4805-bd18-9db0d6c3f9c3 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 204 len: 0 microversion: 2.1 time: 0.952285 Oct 04 21:07:57.320407 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2023/4121] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:56 2022] DELETE /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:57.339449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:57.340921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:57.369333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.370220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.371067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.372427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:57.373290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:57.374093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.347019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:58.363396 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b89e6d7c-01cd-43bd-b239-6c48c6184266 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1690 microversion: 2.1 time: 1.035742 Oct 04 21:07:58.365295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2024/4122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:57 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1690 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:59.067609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:59.068361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:59.069229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:59.069975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:59.071338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:59.083948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:59.139743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.142569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.150704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.153030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.155828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.157544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.211807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:59.224085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:59.260963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:59.267702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:59.413758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.414574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.451314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.454308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.458831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.466453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.466453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.466453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.621642 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2467a4c-6c31-46db-b7fb-a6f9646c1421 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.554653 Oct 04 21:07:59.635418 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2099/4123] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:59.643408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6ec335b3-3518-4d36-a703-356f33caefa1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.645233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6ec335b3-3518-4d36-a703-356f33caefa1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:01.080624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6ec335b3-3518-4d36-a703-356f33caefa1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.115653 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6ec335b3-3518-4d36-a703-356f33caefa1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1214 microversion: 2.1 time: 1.472774 Oct 04 21:08:01.125281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2100/4124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1214 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:01.719699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.757585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a51c4ace-6b18-455e-94a6-d3efd5277bf8 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1690 microversion: 2.1 time: 2.350790 Oct 04 21:08:01.767687 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2025/4125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1690 bytes in 2362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:02.179199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e66833c5-ff92-45e8-9477-8b49fa287ed0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.180551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e66833c5-ff92-45e8-9477-8b49fa287ed0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.508785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e66833c5-ff92-45e8-9477-8b49fa287ed0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.535444 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e66833c5-ff92-45e8-9477-8b49fa287ed0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1214 microversion: 2.1 time: 0.366211 Oct 04 21:08:02.550737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2101/4126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1214 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:02.829464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.835025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.877476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.881291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.882320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.889905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.894505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.896000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.588671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.589830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.654347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.671520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.673264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.678813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.679771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.680632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.232348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.278566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29eb615e-2bbd-4e65-a2b2-ca8a9b48a407 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1690 microversion: 2.1 time: 1.468681 Oct 04 21:08:04.288489 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2026/4127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1690 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:04.674964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.719375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01b746cc-3f16-48a9-96f6-0464a787c203 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1210 microversion: 2.1 time: 1.135829 Oct 04 21:08:04.727737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2102/4128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1210 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:05.340557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:05.353770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:05.407190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.415099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.424950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.431267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.438436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.443366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.309071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "name": "network-vif-unplugged", "status": "completed", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:06.375530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.378758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.381211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.436347 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] Creating event network-vif-unplugged:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:08:06.456962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-109acd73-b6ba-43cc-ab33-874f2e747d32 req-a2ad7220-8345-48e2-9715-cee6f2d84db0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.247677 Oct 04 21:08:06.458596 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2027/4129] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:06.487120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:06.489037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:06.516434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.516434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.516434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.571708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:06.573263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:06.575087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:06.668093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:06.923955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.977832 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1141a19-a27a-46d4-82ee-4a74c33fa9ff tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1274 microversion: 2.1 time: 0.496940 Oct 04 21:08:06.979333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2028/4130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:06 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:07.339048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:07.383147 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9b3e0e5-d112-4937-9ce4-2a4cfa40edf7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1690 microversion: 2.1 time: 2.051129 Oct 04 21:08:07.393750 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2103/4131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:05 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1690 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:08.035667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.036802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:08.069706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.082496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.090225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.096118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.097580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.099667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.301714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.324983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d20b90b9-b925-4a2c-b23a-e0c8d207dda2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1272 microversion: 2.1 time: 0.306906 Oct 04 21:08:08.338844 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2029/4132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:08 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:08.463827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:08.465730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:08.481556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0", "name": "network-vif-deleted", "tag": "503e39cf-83e8-4fe3-833e-01d3951b7d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:08.512310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.513630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.514730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.518054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.523615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.523615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.532832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:08.534123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:08.538913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.578939 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] Creating event network-vif-deleted:503e39cf-83e8-4fe3-833e-01d3951b7d7f for instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 on n-h2-851029-13 Oct 04 21:08:08.590515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a91ad178-fbbc-401b-9c5e-dabe130e3184 req-d24aa445-be5d-42cf-baed-9d18d9ee90ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.389192 Oct 04 21:08:08.594948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2104/4133] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:08.712093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.742356 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cece58c-3ea4-4064-972f-515bcad4893e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1623 microversion: 2.1 time: 0.295725 Oct 04 21:08:08.755624 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2030/4134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:08 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1623 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:09.377518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:09.403221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.404922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.451478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.457465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.459475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.465357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.469870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.473394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.728833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:09.752688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64a9a3cd-174c-45c7-86b8-25b177842a22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1272 microversion: 2.1 time: 0.376758 Oct 04 21:08:09.772514 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2105/4135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1272 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:09.806029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.807141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.862004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.863745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.865523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.874303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.876153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.876868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.104101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.105027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.106023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.107355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'fault' on Instance uuid f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:10.266436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.304491 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ed78197-678e-4336-8b12-90b2d379b475 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 200 len: 1335 microversion: 2.1 time: 0.505895 Oct 04 21:08:10.323132 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2031/4136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 1335 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:10.808372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:10.812597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:10.904859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.908071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.909594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.914910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:10.917253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:10.925268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.379979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.381754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.425077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.428205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.429431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.432195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.433883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.435231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.526253 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 HTTP/1.1 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0'} Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:11.543665 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 404 to user: Instance f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-125f83af-64a2-43d6-86a2-0d56d4efc54e tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0" status: 404 len: 111 microversion: 2.1 time: 0.188177 Oct 04 21:08:11.566535 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2032/4137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/f894e7ef-9fd4-4654-bc7f-5aa9e5c859e0 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:11.593194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3287190-f74c-4e7c-ad67-0a2c1293cfdd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '.version_select at 0x7f54f604d8b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.820436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:11.862549 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04d9d6e9-5294-4fd0-9250-ddf89ac415c2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 1.060594 Oct 04 21:08:11.864553 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2106/4138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:10 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:11.902342 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a3287190-f74c-4e7c-ad67-0a2c1293cfdd tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-355217342" status: 202 len: 0 microversion: 2.1 time: 0.334028 Oct 04 21:08:11.905133 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2033/4139] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 21:08:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-355217342 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:12.911305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:12.917909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:12.947639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:12.956259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.957447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.959033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.961361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:12.962806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:12.964188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.973304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=88 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:13.439529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:13.475917 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5893db10-d26a-414e-98ec-9a31beebc314 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.571988 Oct 04 21:08:13.478020 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2107/4140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:12 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:14.537778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:14.548173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:14.577505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.590907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.590907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:14.590907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:14.590907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:14.593130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.209385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.238425 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b1557f6-1441-4200-97b7-d5d5b0d98480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.710927 Oct 04 21:08:15.249388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2034/4141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:14 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:16.298867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.300009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.340729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.341626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.342414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.343855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.344760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.345560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.110848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.136549 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca70007c-dab9-4a91-838c-889369839106 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.847226 Oct 04 21:08:17.151527 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2108/4142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:18.181610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.189643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.242250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.252136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.258299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.258607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.260024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.261307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.234836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.307651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb5bb7c0-e94f-4f9e-9f6a-be26a10566c4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 1.131020 Oct 04 21:08:19.313758 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2035/4143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:19.727866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbf8f6f-595f-46aa-b46e-81a698bbc064", "tag": "f629d667-e230-4aaf-b567-a1f05d951cd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:19.794648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.797023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.804416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.882242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] Creating event network-changed:f629d667-e230-4aaf-b567-a1f05d951cd5 for instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 on n-h2-851029-13 Oct 04 21:08:19.926763 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b5ca1304-5ff9-49c5-81a8-cfd12f9d22ac req-6a43b9ba-6f94-4e59-b08c-ed5e463c5313 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635131 Oct 04 21:08:19.935155 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2109/4144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:20.378128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:20.411396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:20.425923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.427404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.428593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.430631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.432728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.433882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.225848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:21.277844 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b3c0c0f-3461-4205-803e-b6dc8c813575 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.925616 Oct 04 21:08:21.299302 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2036/4145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:20 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:22.336335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.345529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.382865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.384856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.388739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.397629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.399569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.401152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.424495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.461145 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcfc3c60-4b16-4fef-b9f9-33e13d3b2193 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 1.126370 Oct 04 21:08:23.471791 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2110/4146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:24.526972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:24.529304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:24.550216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:24.555177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.557585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.558896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.560536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:24.561678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:24.563499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.531245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:25.576647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3b64b11-091a-4a09-8675-0775dbc0ef01 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 1.061951 Oct 04 21:08:25.599209 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2037/4147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:24 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:26.653684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:26.659987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:26.678632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.680318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.681550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.683324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:26.684600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:26.686429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.335488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.368376 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15bd51b5-120c-4a94-82db-b8f49c88fe2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.733808 Oct 04 21:08:27.370937 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2111/4148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:26 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:28.429997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:28.431722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:28.497784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.500400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.509740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.516566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.522692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.529208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.203091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.233428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd2e7a97-f978-48b2-a168-0e12cc5935c7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 0.821999 Oct 04 21:08:29.244972 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2038/4149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:28 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:30.306815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:30.313998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:30.328623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:30.366234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.368388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.371152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:30.373089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.377743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.379285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:31.939641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.980767 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5bcb25a-df00-4f62-a86a-c4b039a78c7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 1.700080 Oct 04 21:08:31.994270 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2112/4150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:30 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:33.047048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.057480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.106027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.110179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.119982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.122297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.126125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.128690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.246125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbf8f6f-595f-46aa-b46e-81a698bbc064", "name": "network-vif-plugged", "status": "completed", "tag": "f629d667-e230-4aaf-b567-a1f05d951cd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:33.303187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.304520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.305717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.367205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] Creating event network-vif-plugged:f629d667-e230-4aaf-b567-a1f05d951cd5 for instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 on n-h2-851029-13 Oct 04 21:08:33.409536 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c0a2c601-74b0-4ae9-8745-5066d1900242 req-b66f556a-738f-48ee-aa39-cdd5336d2642 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205817 Oct 04 21:08:33.419578 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2113/4151] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:37.056484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.117443 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8ef9519-d509-4824-8ded-64204d7d4c0d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1314 microversion: 2.1 time: 4.079483 Oct 04 21:08:37.150106 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2039/4152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1314 bytes in 4113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:38.581331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.586030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.625510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.631143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.632511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.639858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.641658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.644517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.023128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:39.050087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:39.155763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.156942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.157631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.158891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.159630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.160270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.973681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.003042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.008396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.011475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-820634fa-59f7-41a9-88f3-a39a6653b50f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2946 microversion: 2.32 time: 2.441315 Oct 04 21:08:41.029665 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2040/4153] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2946 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:41.100494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:41.104730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.148936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.152907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.154514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.158478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.159894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.161069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.222396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:08:41.284205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.331242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74aa03f9-14cc-41f6-9059-a5ce8e5f2185 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1500 microversion: 2.1 time: 3.146529 Oct 04 21:08:41.346503 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2114/4154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1500 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:41.381892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:41.384603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.422609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.422609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.422609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.422609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.423336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.429784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.511206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:42.232496 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d17ece1-8637-4e54-afcc-4253c291af91 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 204 len: 0 microversion: 2.1 time: 1.191780 Oct 04 21:08:42.232496 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2041/4155] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:41 2022] DELETE /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:42.253341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:42.263044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.286578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.287499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.288292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.289643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.290537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.291341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.464671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0acf864f-7e0a-4aeb-95e0-2f188c891227 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.098688 Oct 04 21:08:42.480887 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2115/4156] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:08:41 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531/os-interface => generated 1830 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:42.501422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:42.513608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.539726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.549167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.551034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.567529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.569057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.580408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.995070 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.security_group_api [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Removing security group 900eb4b9-065a-45de-a6ef-208ce85f328f from port f629d667-e230-4aaf-b567-a1f05d951cd5 Oct 04 21:08:44.416914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.523961 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26031031-d97f-4136-a58c-1f28bae01dd7 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1509 microversion: 2.1 time: 2.024397 Oct 04 21:08:44.549625 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2116/4157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:42 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1509 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:44.966242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762b582b-c59f-444e-b629-1da410a3215a", "name": "network-vif-deleted", "tag": "36a6f8dd-47ac-4278-9a0a-f513bb96f963"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:45.000435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.007055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.007055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.055683 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] Creating event network-vif-deleted:36a6f8dd-47ac-4278-9a0a-f513bb96f963 for instance 762b582b-c59f-444e-b629-1da410a3215a on n-h1-851029-13 Oct 04 21:08:45.069925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0c030479-1ed8-45c8-b9a3-c05a2f1a739e req-b5b63951-0ccf-46c0-a32d-bae8afe6c123 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110830 Oct 04 21:08:45.075766 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2117/4158] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:45.590188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:45.591185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:45.615462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.616387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.617171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.618555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:45.632125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:45.640186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.048172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:46.092156 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a0ac5c4-7b32-4803-b66b-f1bf97376f57 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1293 microversion: 2.1 time: 0.509678 Oct 04 21:08:46.098164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2118/4159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:45 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1293 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:47.063353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc8f69ee-61ec-495e-b7fe-035376a3d597 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064/action" status: 202 len: 0 microversion: 2.1 time: 4.833608 Oct 04 21:08:47.070455 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2042/4160] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:42 2022] POST /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064/action => generated 0 bytes in 4839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:08:47.082776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.084094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.142484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.162018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.169479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.172178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.180633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.182078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.187264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.189902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.230157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.232930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.236042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.243448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.246726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.254242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.257367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=58 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:47.417912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.419693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.421819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.423088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'fault' on Instance uuid 762b582b-c59f-444e-b629-1da410a3215a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:08:47.571915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.627285 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b384e4f0-64d7-448e-a223-98c645ce63c9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1458 microversion: 2.1 time: 0.554505 Oct 04 21:08:47.649559 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2119/4161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1458 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.680966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbf8f6f-595f-46aa-b46e-81a698bbc064", "tag": "f629d667-e230-4aaf-b567-a1f05d951cd5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:47.707615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.713189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.714493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.715726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.742103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] Creating event network-changed:f629d667-e230-4aaf-b567-a1f05d951cd5 for instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 on n-h2-851029-13 Oct 04 21:08:47.757858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a24076a7-13f4-4901-8e78-3038b75eab23 req-118ac329-c0b3-4593-b8d9-feaeb992d361 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097436 Oct 04 21:08:47.759390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2120/4162] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:47.765230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e4d160a0-5c80-433d-bd8b-66876410227f tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 200 len: 1312 microversion: 2.1 time: 0.584910 Oct 04 21:08:47.774094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:47.776261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.786083 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2043/4163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 1312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.795250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.797286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.798440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.810718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.830134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.831963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.833082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.836679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: 762b582b-c59f-444e-b629-1da410a3215a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.871523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.872260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.877263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.884091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.884091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.886413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.968412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a HTTP/1.1 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '762b582b-c59f-444e-b629-1da410a3215a'} Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:48.978430 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:08:48.986160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 404 to user: Instance 762b582b-c59f-444e-b629-1da410a3215a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:48.993833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1eeee2be-934c-4f10-ad97-628648171462 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a" status: 404 len: 111 microversion: 2.1 time: 0.174301 Oct 04 21:08:49.002187 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2044/4164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/762b582b-c59f-444e-b629-1da410a3215a => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:49.247627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1669306332", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a6cd9541-a599-4f3f-94c5-fad267f72e3d"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:49.509757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] validate_networks() for [('a6cd9541-a599-4f3f-94c5-fad267f72e3d', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:51.788412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.811464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fba843c2-2e1a-4737-8760-74ed91fb6fde tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 4.046889 Oct 04 21:08:51.821019 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2121/4165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:47 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 4055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:51.863678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.864716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.876914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.879251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.880606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.882374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.883706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.884863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.027338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:08:52.861702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dace5fdb-555d-4b91-8831-341b0f85f59c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 204 len: 0 microversion: 2.1 time: 1.041622 Oct 04 21:08:52.871267 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2122/4166] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:51 2022] DELETE /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:52.883581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.886027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.900471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.902380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.904028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.907117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.908651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.909990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.453975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:53.454988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:53.465280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:53.465280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:53.465280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:53.515539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.515539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.544791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.544791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.544791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.544791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.638576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:53.677048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for user 70725c9735414d649b11fd73576174f0 and project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:53.738026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:53.745300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:54.160799 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [c4350d11-eb33-433e-bfd3-6b7781101508] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:08:54.699764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.743685 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9474ca6c-ce62-42eb-a183-945b4f953c17 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.869100 Oct 04 21:08:54.753091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2123/4167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:54.787303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.790151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.839381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.841145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.844594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.851750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.853060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.854565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.185397 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [c4350d11-eb33-433e-bfd3-6b7781101508] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 32858. Oct 04 21:08:55.222380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29ec6ed4-fe84-45b2-9cc8-8a53fffb816e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.210093 Oct 04 21:08:55.233732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2045/4168] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 6231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:08:55.276645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.278177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.309713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.314419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.321091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.323492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.324713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.329140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.938373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:56.969511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb1148b3-0b6f-48df-b8a2-53bf46480e39 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.714435 Oct 04 21:08:56.969511 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2046/4169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:56.974260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-730e9acc-5aed-4310-887e-2d8df675a8ac tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.975230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-730e9acc-5aed-4310-887e-2d8df675a8ac tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.036677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.067895 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4721f3fc-2c51-43be-8006-0d5e4d2e9b6c tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 2.311999 Oct 04 21:08:57.073909 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2124/4170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:57.091728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:57.096699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:57.109853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.110434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.113097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.117077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:57.121307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:57.121899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.297495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-730e9acc-5aed-4310-887e-2d8df675a8ac tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.316203 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-730e9acc-5aed-4310-887e-2d8df675a8ac tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1218 microversion: 2.1 time: 0.362943 Oct 04 21:08:57.331684 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2047/4171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:56 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:57.912599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.937603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dc387af-b710-420c-bb3a-694eb5e1f31c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.861394 Oct 04 21:08:57.949810 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2125/4172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:57 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:58.120380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.121566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.163395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.164465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.165290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.166718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.175124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.183722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.243851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-648446038", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6625a5dc-d4c9-493c-a356-6d80fd39a592"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:58.603837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] validate_networks() for [('6625a5dc-d4c9-493c-a356-6d80fd39a592', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:59.648502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.704280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9941b36f-5d4a-4a1c-a618-f45d87850b29 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1523 microversion: 2.1 time: 1.578314 Oct 04 21:08:59.705900 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2048/4173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1523 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:59.765667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:59.766830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:59.784717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:59.789107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.792430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.793748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.795611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.796769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.797728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.190509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:00.225508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0dc81050-679c-4897-8f83-cfc2af325c37 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1222 microversion: 2.1 time: 0.500017 Oct 04 21:09:00.227920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2049/4174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:59 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1222 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:00.239484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb22939d-853b-4445-bc6d-16d80854f55a", "name": "network-vif-deleted", "tag": "91a32386-7c93-4353-8348-e0018b80666a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:00.262865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.264401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.265852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.299977 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] Creating event network-vif-deleted:91a32386-7c93-4353-8348-e0018b80666a for instance bb22939d-853b-4445-bc6d-16d80854f55a on n-h1-851029-13 Oct 04 21:09:00.313629 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-451b5e66-e20a-4378-bdf2-0007f6ec768d req-f5010c05-d163-4f23-8dac-ec9d5a58fe67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081460 Oct 04 21:09:00.320903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2050/4175] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:00.755337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.756733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.798052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.802125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.804183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.806982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.808152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.809173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.985214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:00.987769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:00.989222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:00.990329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:00.992744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:01.034339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.036951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.038183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.039969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.041210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.042331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.050152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.051422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.059046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.060896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lazy-loading 'fault' on Instance uuid bb22939d-853b-4445-bc6d-16d80854f55a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:01.082057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:01.100370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:01.128728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Getting quotas for user 3f337efc1e76467a887b7a60f89eafff and project a38dd3831aa1439990b23b07b81023e6. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:01.184869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:01.200401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:01.291662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e16f8fc1a794af89bc061b23deb8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1700e56dee9416ba9bcf23cb446b1f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.319092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d0fbf95-bed0-46e1-8b85-5bda24952d2a tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 200 len: 1312 microversion: 2.1 time: 0.576267 Oct 04 21:09:01.324466 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2051/4176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 1312 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:01.341858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:01.360226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:01.387186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.388669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.390408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.392266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:01.393622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:01.394907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.559178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c040adea-416b-445d-947d-e23e15de6698 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.319832 Oct 04 21:09:01.564218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2126/4177] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:09:01.592738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-037e2c24-f8bf-40dd-b1cd-314d54d6a3af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:01.596200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-037e2c24-f8bf-40dd-b1cd-314d54d6a3af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:01.644428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.689817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78ad7cc3-6de3-48ea-a068-b6002d0c34c3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1270 microversion: 2.1 time: 0.362805 Oct 04 21:09:01.691709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2052/4178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:01 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:02.038421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-037e2c24-f8bf-40dd-b1cd-314d54d6a3af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.065219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-037e2c24-f8bf-40dd-b1cd-314d54d6a3af tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1214 microversion: 2.1 time: 0.483349 Oct 04 21:09:02.079333 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2127/4179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:01 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1214 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:02.370167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.372413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] [instance: bb22939d-853b-4445-bc6d-16d80854f55a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.408113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.409321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.410267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.411912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.413211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.414358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.474571 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] HTTP exception thrown: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Request method failure captured: Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a HTTP/1.1 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ8wi-gEqYfmSPFBr2I3cKiBeRLqU8vdLgyUXwpOZBklsgFJhr3f6dDOj-8_zLB75nQpFZq0rlYXWvSDBT1OXpNXceS15F6UKf_9YcWXvipqA0FEoRQvRGzsskFpDV1WfGa1BJoU3NjfP_BbCD9I7t2raDo3Z2GUqEfdra8ysmPzIZU Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1700e56dee9416ba9bcf23cb446b1f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: b1700e56dee9416ba9bcf23cb446b1f6 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-214237228 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e16f8fc1a794af89bc061b23deb8c33 Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-214237228-project Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'bb22939d-853b-4445-bc6d-16d80854f55a'} Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:09:02.478036 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. Oct 04 21:09:02.485592 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:09:02.491377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] Returning 404 to user: Instance bb22939d-853b-4445-bc6d-16d80854f55a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:02.497824 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e68d5f41-2399-4ab7-906b-62a8e1e50d10 tempest-ServerRescueNegativeTestJSON-214237228 tempest-ServerRescueNegativeTestJSON-214237228-project] 10.222.0.36 "GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a" status: 404 len: 111 microversion: 2.1 time: 0.130937 Oct 04 21:09:02.510027 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2053/4180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/bb22939d-853b-4445-bc6d-16d80854f55a => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:09:02.743422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.749856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.788064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.789379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.791794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.797736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.805823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.807470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.115315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d73f745-ae31-4c79-b860-a1b55b2673d2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:03.120650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d73f745-ae31-4c79-b860-a1b55b2673d2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:03.556346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:04.075783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.092060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d73f745-ae31-4c79-b860-a1b55b2673d2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.101861 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-955b6ac7-79e0-4392-a31d-937333c0b3ef tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1288 microversion: 2.1 time: 1.369563 Oct 04 21:09:04.117385 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2128/4181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1288 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:04.183379 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d73f745-ae31-4c79-b860-a1b55b2673d2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1214 microversion: 2.1 time: 1.081490 Oct 04 21:09:04.189025 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2054/4182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:03 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1214 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:05.167320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.168279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.221562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.222153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.222976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.224342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.225235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.237524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.238563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.245797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.336322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.343371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.345046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.349628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.352282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.354744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.780677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.850262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa6297dc-69a5-478a-b094-c200628a1274 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1210 microversion: 2.1 time: 0.624471 Oct 04 21:09:05.851582 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2055/4183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1210 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:06.363084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:06.428126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7c3f238-b5c8-4c51-a38b-355bd5fba28c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1276 microversion: 2.1 time: 1.265825 Oct 04 21:09:06.441732 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2129/4184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1276 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:06.903490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.911787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.938203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.943588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.944714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.954237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.955642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.972416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.489541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:07.491907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:07.535967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.538969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.538969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.546574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.548096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.549346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.011974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.042651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec9a52ef-626f-4835-87ba-346d6b774a8c tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1266 microversion: 2.1 time: 1.148039 Oct 04 21:09:08.051680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2056/4185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1266 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:08.161963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:08.205205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f57b7ab-c6d3-43da-a45a-c36aed64edb8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1276 microversion: 2.1 time: 0.723621 Oct 04 21:09:08.206316 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2130/4186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:07 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1276 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:09.100136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.100956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.171814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.173738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.175654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.181811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.183146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.185211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.260238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:09.265802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:09.301045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.320689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.323430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.328553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:09.336178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:09.340885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.029052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.066210 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13e7a945-a7d5-405d-aa9d-a4ff9bada1b4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1272 microversion: 2.1 time: 0.974205 Oct 04 21:09:10.070584 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2057/4187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1272 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:10.374494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:10.410545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f2f9418-406e-493f-b56b-d89c4545443b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.157527 Oct 04 21:09:10.424206 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2131/4188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:09 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:11.129812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:11.131471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:11.173419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.181561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.186364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.198011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.203071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.207502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.468786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:11.475650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:11.506769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:11.520455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.521914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.523391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.526940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.528865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.530153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.051096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:12.632387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.656953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:12.668004 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e2385f1-c8fd-4eaf-9189-25dcbee4f44a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.552537 Oct 04 21:09:12.672724 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2058/4189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:11 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:13.046153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:13.081421 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37c67fad-882c-4c30-a9af-3c70723c9725 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.627039 Oct 04 21:09:13.097655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2132/4190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:11 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:13.715922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:13.718106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:13.751269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.752329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.753158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.754525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.755475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.756297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.162422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:14.166401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:14.173850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:14.214456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.216151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.218117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.220167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:14.221615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:14.223233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.717033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.763115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8dc0207-9bd0-401d-8718-273d524b77f4 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 2.053027 Oct 04 21:09:15.769920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2059/4191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:13 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:15.790290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.821319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ad2298d-f277-4f9d-80ef-016f26ba96a3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.688287 Oct 04 21:09:15.832052 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2133/4192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:14 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:16.432889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1ca71c-c7fb-4655-87fc-5b6b1e34feda", "tag": "e9779edb-550a-4455-9e36-68b34483c74a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:16.502484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.509692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.510788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.602626 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] Creating event network-changed:e9779edb-550a-4455-9e36-68b34483c74a for instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda on n-h2-851029-13 Oct 04 21:09:16.629075 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b7fdd261-d770-4c33-9fb3-0f03cefe380c req-b83c20ee-29ff-42d6-b768-ede0baf86db6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202034 Oct 04 21:09:16.630586 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2060/4193] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:16.817405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.821876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.855839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.863452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.865066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.866910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.874296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.875831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.885350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.892953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.928640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.931045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.932168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.933781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.935005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.941777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.057660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.084565 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d94eaec-bea9-4901-883e-6b236ceb1edc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.209047 Oct 04 21:09:18.099577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2061/4194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:18.122301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8564591d-3dd5-4cf8-988f-46fbb245f01f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Action: 'create', calling method: .version_select at 0x7f54f61c6550>, body: {"keypair": {"name": "tempest-keypair-1708472453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV3l7cVzAajB6Q1kooxbZ/ABkJBI1pOewQF0af8nAXPsPfeE924tQnZvZ+AHP5ejgPYyC10Fd5aYYwOonKbXoG1/PCWBvyTOH0LIVE7ZyqWCojA79KXEmuW/noA+MtmXA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:18.166822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.219783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-023f8a8c-6048-41b9-bfb6-3a3f9f0f67f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.386446 Oct 04 21:09:18.219783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2134/4195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:18.221055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8564591d-3dd5-4cf8-988f-46fbb245f01f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Getting quotas for project 2c00a4bd820a4e97ad4255a474beaeee. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:18.260858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8564591d-3dd5-4cf8-988f-46fbb245f01f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Getting quotas for user 5eb6c4a90cee48bc965601aef1eacba7 and project 2c00a4bd820a4e97ad4255a474beaeee. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:18.685260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8564591d-3dd5-4cf8-988f-46fbb245f01f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.582536 Oct 04 21:09:18.701082 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2062/4196] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 21:09:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 586 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:09:19.160775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.161733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.182505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.187493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.189008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.191309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.192644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.195542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.209517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:19.275318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.278299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.335639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.340936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.343163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.345939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.353207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.356706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.699803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.742899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fb68906-8c04-4515-b246-d7b354ff628f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.469547 Oct 04 21:09:20.760176 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2063/4197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:20.783061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea66a1f-1c46-4451-83a6-5c8bd7c50d03", "tag": "2cf67303-c10a-4139-856c-d79d4f70b25e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:20.826458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.827928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.829218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.853671 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] Creating event network-changed:2cf67303-c10a-4139-856c-d79d4f70b25e for instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 on n-h1-851029-13 Oct 04 21:09:20.866109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6d3d4b4f-3d1a-4e56-b189-69af13d644f9 req-ada3cb28-1eb3-468a-9ca2-496ba613c34c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113762 Oct 04 21:09:20.874331 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2064/4198] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:20.886807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.925288 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a543f80-20b7-4640-b17c-d11fc49154bb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.770870 Oct 04 21:09:20.925288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2135/4199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.807215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.808686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:21.848221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.850511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.851695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.857191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.858417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.862597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.971890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.976006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.015063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.016327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.017376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.018990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.020141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.026378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.433610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.450893 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc213e60-8590-451b-a371-945e63092ae6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.486220 Oct 04 21:09:23.455807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2136/4200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:23.468828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.500107 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e559bbd8-45c3-455d-aaf2-2cc712c80f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.702660 Oct 04 21:09:23.516104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2065/4201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:24.507800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.508949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.541629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.546212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.549094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.553774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.557635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.559214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.601092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.602068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.669556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.671063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.671881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.673215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.674095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.688311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.848049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:25.901112 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ef3ed58-2fb5-45cb-90d7-b32cba83c23d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.410511 Oct 04 21:09:25.926631 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2137/4202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:25.979373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:26.015909 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f846f83a-96ed-4ba4-9188-288db769d9f7 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.442683 Oct 04 21:09:26.017671 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2066/4203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:26.961603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:26.962973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:26.998193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:26.999144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:26.999984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.001505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.002397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.003255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.066406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:27.067705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:27.099114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.107052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.107052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.107052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.107052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.108020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.732984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.747150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.761465 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-98ba31e6-879d-4127-bb72-85ad665a4f2b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 0.807368 Oct 04 21:09:27.766986 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c554150-752c-42f6-8075-27945768e3d0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 0.707604 Oct 04 21:09:27.768486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2067/4205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:27 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:27.772282 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2138/4204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:26 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.626053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ca71c-c7fb-4655-87fc-5b6b1e34feda", "name": "network-vif-plugged", "status": "completed", "tag": "e9779edb-550a-4455-9e36-68b34483c74a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:28.702480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:28.710005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.710978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.711813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.771836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] Creating event network-vif-plugged:e9779edb-550a-4455-9e36-68b34483c74a for instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda on n-h2-851029-13 Oct 04 21:09:28.798556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8c611688-a06d-4229-9134-71fbf2a4c2b0 req-294bdad8-369f-4231-9869-e60d5906ed45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179328 Oct 04 21:09:28.802611 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2068/4206] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:28.817231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.818366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.829596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.833916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.862402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.866358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.867278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.868535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.875595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.876208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.890167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.891075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.893878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.898826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.899744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.900592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:29.979105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:29.999875 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-573f6102-ef62-41e3-b927-4d83ecda1748 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.190946 Oct 04 21:09:30.001585 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2069/4207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:30.005938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:30.032402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97fea11b-9e37-4d7d-b48e-4fda7300995b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.233130 Oct 04 21:09:30.043583 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2139/4208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:30.889751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea66a1f-1c46-4451-83a6-5c8bd7c50d03", "name": "network-vif-plugged", "status": "completed", "tag": "2cf67303-c10a-4139-856c-d79d4f70b25e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:30.956878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.958271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.959429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.002010 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] Creating event network-vif-plugged:2cf67303-c10a-4139-856c-d79d4f70b25e for instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 on n-h1-851029-13 Oct 04 21:09:31.014890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7a30026d-d8cf-4e12-822d-a9373f1375e6 req-bc9be129-16b7-48e5-9d8f-c7c9a6951e57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133391 Oct 04 21:09:31.016879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2070/4209] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:31.048881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.050408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.073370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.075584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.077310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.096010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.099175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.100877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.106869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.109924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.168020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.169484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.175140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.180085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.182197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.183069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.360374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.388855 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da8c8d68-8218-486e-b294-9e168bd50b60 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1318 microversion: 2.1 time: 1.307372 Oct 04 21:09:32.391972 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2071/4210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1318 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:32.658742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.684784 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6246f9ba-4a37-41bf-8f85-30250ef02d13 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1314 microversion: 2.1 time: 1.643551 Oct 04 21:09:32.694118 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2140/4211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1314 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:33.448365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.454050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.504326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:33.563524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.566703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.567451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.578322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.586430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.590237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.740005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.747401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.765910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:33.786446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.788159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.789571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.792869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.801187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.803763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.402507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.451574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:34.455027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4f6c8cf-14d0-4fe8-a119-ac91190717bc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1501 microversion: 2.1 time: 0.712198 Oct 04 21:09:34.457384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2141/4212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1501 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:34.480819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1135186151", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5aca4ca9-1733-427a-a453-7b0df69e4a75"}, {"port": "f0255488-6f0e-47ee-99d3-249d39b64c02", "tag": "port-1"}, {"port": "b777036e-9370-4e44-95d2-69377dd05e6b", "tag": "port-2"}, {"uuid": "5d7f608d-3e97-4f2f-af3e-31f5e0a5a305", "tag": "net-1"}, {"uuid": "5d7f608d-3e97-4f2f-af3e-31f5e0a5a305"}, {"uuid": "5d7d5955-bca0-495c-b5e5-0e11f45a82d4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5d7d5955-bca0-495c-b5e5-0e11f45a82d4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3b13da21-b14e-473c-9ceb-59d668736236", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "927f0097-418a-43a3-a8f7-c3bfaa4cc14b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f6af3808-a6fc-488b-861f-52bb0bdc1e5a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1016462639"}], "key_name": "tempest-keypair-1708472453", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:34.520005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1928affe-0845-4dfd-a32f-de2ce8a662fe tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1507 microversion: 2.1 time: 1.083540 Oct 04 21:09:34.521412 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2072/4213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1507 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:34.531469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:34.532842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:34.564280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.565215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.566227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.567865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:34.568995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:34.570629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:34.978036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-529b6252-d4b0-4199-8b4d-b946e9ee8098 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03/action" status: 202 len: 0 microversion: 2.1 time: 0.434780 Oct 04 21:09:34.985943 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2073/4214] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:34 2022] POST /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:09:35.029328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.031868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.053951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] validate_networks() for [('5aca4ca9-1733-427a-a453-7b0df69e4a75', None, None, None, None, None), (None, None, 'f0255488-6f0e-47ee-99d3-249d39b64c02', None, None, None), (None, None, 'b777036e-9370-4e44-95d2-69377dd05e6b', None, None, None), ('5d7f608d-3e97-4f2f-af3e-31f5e0a5a305', None, None, None, None, None), ('5d7f608d-3e97-4f2f-af3e-31f5e0a5a305', None, None, None, None, None), ('5d7d5955-bca0-495c-b5e5-0e11f45a82d4', '10.2.2.100', None, None, None, None), ('5d7d5955-bca0-495c-b5e5-0e11f45a82d4', '10.2.2.200', None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:35.054750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.056846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.058225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.060393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.062696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.064014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.667141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.701650 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20ccaf24-2a35-4ad9-89d3-7e0d26c16f93 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1507 microversion: 2.1 time: 0.709460 Oct 04 21:09:35.702879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2074/4215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1507 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:35.730958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:35.732223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.774134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.774907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.775698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.776973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.777788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.792088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.741252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.787086 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8cf9e71c-1c07-4fc1-ae43-fe85350bfffe tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1486 microversion: 2.1 time: 1.070984 Oct 04 21:09:36.793020 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2075/4216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:35 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1486 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:36.803756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:36.809809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.851761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.853483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.859636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.868120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.869404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.872873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.234360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:37.235360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:37.237245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:37.238562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:37.238836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:37.596959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:37.770652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:37.805697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.807287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.808458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.811129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.813189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.814458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.911521 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f85ab31-a7e5-409e-99b2-b88ac84d5309 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "POST /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda/action" status: 202 len: 1109 microversion: 2.1 time: 1.111851 Oct 04 21:09:37.913768 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2076/4217] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:36 2022] POST /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda/action => generated 1109 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:09:37.927607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:37.929053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:37.943607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.945382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.946636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.948346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.949549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.950636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.026789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lazy-loading 'flavor' on Instance uuid 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:39.146940 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3aed2a0a-8722-4781-b295-2940b3544af8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03/action" status: 202 len: 0 microversion: 2.1 time: 1.229900 Oct 04 21:09:39.149741 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2077/4218] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:37 2022] POST /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03/action => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:09:39.173719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:39.176820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:39.197116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.198697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.199851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:39.202259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:39.203591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:39.204736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.212411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.243965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e27d9776-c008-4056-8dd8-ae222a6f27f3 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 1.091295 Oct 04 21:09:40.245090 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2078/4219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:39 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.260628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.271122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:40.289589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.290501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.291370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.293809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.295181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.296208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.033724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:41.073205 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a57ae53a-417a-4b8e-b171-56123ac99067 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1492 microversion: 2.1 time: 0.819636 Oct 04 21:09:41.080015 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2079/4220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1492 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.299283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.301203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:41.316155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.317245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.318052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.319422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.320287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.321213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.196137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.225222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-523c8350-edf2-43b5-8c40-7a860aedfe1d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 0.940978 Oct 04 21:09:42.229542 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2080/4221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:42.254436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:42.257609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:42.285106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.287932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.289067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:42.290582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:42.291537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:42.293964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.327037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.405556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d5a708ed-d084-4c28-840f-b5921b5aa889 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1513 microversion: 2.1 time: 1.166522 Oct 04 21:09:43.407047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2081/4222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:42 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1513 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:43.418870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:43.421333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:43.440206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.441368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.444176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.448003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.453022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.454616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.161584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:44.194856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-235d5bea-463e-4d46-bad4-65de34a4f51b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 0.785228 Oct 04 21:09:44.198244 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2082/4223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:43 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:44.424766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=41 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.468262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:44.469657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:44.503939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.505419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.509027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.514514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.529403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.529403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.273122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.300160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a472c583-1cf0-43bd-8a1d-dbb407e6a435 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1513 microversion: 2.1 time: 0.848829 Oct 04 21:09:45.307083 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2083/4224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:44 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1513 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:45.324585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:45.336691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:45.354050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.355617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.356835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.359699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.364014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.365348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.734871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:45.735927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:45.736875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:45.737613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:45.738653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:45.808195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.809907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.817853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.820127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.823109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.833374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.912173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:45.932754 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b6ff517-dabd-40e3-9a0d-3d38998343b7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 0.619493 Oct 04 21:09:45.937003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2084/4225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:45 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:45.954553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Getting quotas for project 2c00a4bd820a4e97ad4255a474beaeee. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:45.972307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Getting quotas for user 5eb6c4a90cee48bc965601aef1eacba7 and project 2c00a4bd820a4e97ad4255a474beaeee. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:46.359241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.365564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.445036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.452987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.455199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.467835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.471325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.477716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.490539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:46.535317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3b13da21-b14e-473c-9ceb-59d668736236',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='927f0097-418a-43a3-a8f7-c3bfaa4cc14b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6af3808-a6fc-488b-861f-52bb0bdc1e5a',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:47.518838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:47.538844 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5a4df3f-d766-4450-beb6-828899f03a95 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.194880 Oct 04 21:09:47.541609 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2085/4226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:47.575171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:47.580434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:47.632842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.635679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.636415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.639983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.640819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.643918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.005887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.031633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f049cb7e-a663-4bc9-9b08-db901796db07 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 1.486261 Oct 04 21:09:49.045698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2086/4227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:47 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:49.088974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.097322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.127501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.131352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.138007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.145693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.147668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.149086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.487374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6e197ba7-4727-4188-9105-c24d72a40d30 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.025595 Oct 04 21:09:49.505546 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2142/4228] 10.222.0.36 () {62 vars in 1189 bytes} [Tue Oct 4 21:09:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 15047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:09:49.557110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.589169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.953281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.995839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.998214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.004123 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1ad6810-f30c-4ecf-8882-43748cf69c43 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1286 microversion: 2.42 time: 0.483510 Oct 04 21:09:50.041336 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2143/4229] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1286 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:50.052337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.083881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:50.084874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:50.094978 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9075a87f-606d-41ac-ae13-f36795676955 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.041754 Oct 04 21:09:50.098570 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2087/4230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:50.132105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.132105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.132105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.134258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.136733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.137567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.208825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea66a1f-1c46-4451-83a6-5c8bd7c50d03", "name": "network-vif-plugged", "status": "completed", "tag": "2cf67303-c10a-4139-856c-d79d4f70b25e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:50.255386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:50.258147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:50.260315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:50.369083 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] Creating event network-vif-plugged:2cf67303-c10a-4139-856c-d79d4f70b25e for instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 on n-h1-851029-13 Oct 04 21:09:50.392683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c603f640-b590-4e74-88ed-e42c8b60699b req-9e759dfa-4649-43e4-a78e-7aa0fe83e5d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198144 Oct 04 21:09:50.405533 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2088/4231] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:51.053325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.084143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.089332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.107742 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0afce38c-cf1f-4f9d-aa53-f416a359159f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 1.036458 Oct 04 21:09:51.116558 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2144/4232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:50 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:51.152297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.171418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.207481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.217017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.221980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.224863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.229067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.230440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.393008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.434634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.457669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.470367 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aec74b64-1f0d-43a8-b4e6-59aedee36003 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1286 microversion: 2.42 time: 0.399977 Oct 04 21:09:51.474101 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2089/4233] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1286 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:51.840389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.878176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-038b1820-ce4e-45dc-8c1c-37ae17f770e8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 0.725912 Oct 04 21:09:51.880038 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2145/4234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:52.171141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.172221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:52.212260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.213190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.220994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.223017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.227481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.236493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.629329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.630564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.687521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.747818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.751323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.753711 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef6c47a0-e22b-4ae9-b29b-95ad90f1ee73 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1286 microversion: 2.42 time: 1.231676 Oct 04 21:09:53.784549 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2146/4235] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1286 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:53.802655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:53.807395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.866272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.874372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.877420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.884353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.884590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.885647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.034824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:54.077366 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e026acfc-3569-40db-9584-347d6ebd6281 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 1.915848 Oct 04 21:09:54.079701 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2090/4236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:54.637429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:54.693003 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2211bdbc-dde7-486c-865c-dfd88d4f64e0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 0.902950 Oct 04 21:09:54.722879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2147/4237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:53 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:54.849950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:54.854546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:54.879497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.886684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.890487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.890487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.890487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.890487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.127327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.130257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.156654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.167868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.169070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.171329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.175773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.176790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.185996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.230390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.238518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:55.241163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c857ef9d-45b3-47c5-aa73-3fe8ec57f172 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1528 microversion: 2.42 time: 0.407154 Oct 04 21:09:55.248181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2091/4238] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:54 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:09:55.776610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.785036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.851227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.852142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.853025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.854467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.861460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.862269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.910333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:56.009347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:56.433977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:56.599027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db4d1fd0-bb29-429f-b2e3-09d61f954b77 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 1.479477 Oct 04 21:09:56.617474 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2148/4239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:56.652147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:56.653366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:56.684362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.685318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.688942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:56.690339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:56.699583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:56.701899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.490873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.506829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.506829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.506829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:57.506829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a207fb81-087c-4c28-9570-4b3561c58b5c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1576 microversion: 2.42 time: 0.465671 Oct 04 21:09:57.506829 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2149/4240] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:56 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1576 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:57.510007 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f761603-5bff-4f4e-8ffc-e21d5e3bc92d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.371539 Oct 04 21:09:57.510007 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2092/4241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:57.653522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:57.655680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:57.685493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.692473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.693740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.695440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.703406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.704834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.077825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.094615 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d87e5a3-ccf5-49fb-9c08-7126b04806af tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 0.447129 Oct 04 21:09:58.095981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2150/4242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:57 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:58.544861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.546271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.572116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:58.574653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:58.588028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.589177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.590100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.591679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.595132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.596444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.608197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.611578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.611967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.616807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:58.619348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:58.621786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:58.809474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.845199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.851483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:58.854982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f1f1d11-b4f2-4473-9b1f-4afaa14e5e36 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1576 microversion: 2.42 time: 0.325377 Oct 04 21:09:58.857482 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2093/4243] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1576 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:59.144900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:59.148577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:59.174066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.178566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.195509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.197520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.206792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.208497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.258136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:59.323740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0cc026d-8e04-49e1-bdc0-92637e816f7b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 0.778696 Oct 04 21:09:59.334917 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2151/4244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:58 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:59.947014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:59.952592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:59.972307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.974641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.977897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:59.990976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:59.995858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:59.998206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.687641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.722815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.726093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:00.735438 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-05502677-5c86-42c4-ae1b-4564750bbd4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1584 microversion: 2.42 time: 0.811488 Oct 04 21:10:00.736550 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2152/4245] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:59 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1584 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:00.758753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:00.759936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:00.783518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.784460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.785556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:00.792209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:00.806037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:00.808465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:01.412323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:01.567758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:01.596235 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c6b03c2-6e36-42ce-8a64-38d85921410a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1514 microversion: 2.1 time: 2.458843 Oct 04 21:10:01.617032 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2094/4246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:59 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1514 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:01.797952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:01.802300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:01.859007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.859007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.859007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:01.865483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:01.873574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:01.874694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.495930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.563328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.574203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:02.589729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a0aa848-2382-44a5-9ad3-b5e56c821b98 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1594 microversion: 2.42 time: 0.800521 Oct 04 21:10:02.596327 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2095/4247] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:01 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1594 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:02.660704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:02.662462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:02.706693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.708354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.709668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:02.711804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:02.713002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:02.715357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.630600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:03.663330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36c19c53-b01c-49ec-b5dd-c9b08529db22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 2.924722 Oct 04 21:10:03.667841 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2153/4248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:00 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 2930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:03.695158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:03.718255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:03.725928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:03.754354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.755825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.757319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:03.764993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:03.766308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:03.767510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.347086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.367079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.372125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.379106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9900f2da-34af-427d-84ae-45c0280cb87a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1594 microversion: 2.42 time: 0.707995 Oct 04 21:10:04.380087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2154/4249] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:03 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1594 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:04.714642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:04.725715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:04.747690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:04.754166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.755711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.756984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.758920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:04.760806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:04.761999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:04.811389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:04.845903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97623b1f-7c12-4339-af88-83c7c52f2648 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1520 microversion: 2.1 time: 2.203094 Oct 04 21:10:04.873269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2096/4250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:02 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1520 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:05.443433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:05.461453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:05.487685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=56 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:05.506013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.511912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.511912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:05.511912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:05.511912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:05.518105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.072622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.140104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.146513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.149059 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04c2df9e-f4ab-4d95-8a93-3c163156f965 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1594 microversion: 2.42 time: 0.719699 Oct 04 21:10:06.163142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2097/4251] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:05 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1594 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:06.197099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:06.201419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:06.214284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:06.244365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.257256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.258592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.268058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:06.269377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:06.270464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:06.283620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aceb2d82-7e02-4734-8738-1f326f7e3ae5 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.583025 Oct 04 21:10:06.287915 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2155/4252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:04 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:07.261382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:07.268824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:07.385429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.390486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.397510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:07.406583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:07.416039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:07.423111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:08.915554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.953578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.973065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.980197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:08.987158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c36d2ff-0007-44fb-9196-b9bf6ae99659 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1594 microversion: 2.42 time: 1.771311 Oct 04 21:10:08.994447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2156/4253] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:07 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1594 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:09.021774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:09.025177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.053347 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f463eb2f-73cf-49e4-bc89-02d6b188798e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1520 microversion: 2.1 time: 2.884543 Oct 04 21:10:09.054281 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2098/4254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:06 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1520 bytes in 2891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:09.055576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.057394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.062834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.067149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.069391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.076076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.099144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ca71c-c7fb-4655-87fc-5b6b1e34feda", "name": "network-vif-unplugged", "status": "completed", "tag": "e9779edb-550a-4455-9e36-68b34483c74a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:09.184637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.185500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.186251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.290105 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] Creating event network-vif-unplugged:e9779edb-550a-4455-9e36-68b34483c74a for instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda on n-h2-851029-13 Oct 04 21:10:09.326905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-74847b92-d209-4dd0-946d-0612c3ac3ba7 req-bd1eaa91-b17d-4d93-8c4a-c0af50854d6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.270217 Oct 04 21:10:09.345195 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2099/4255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:10.065527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:10.067018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:10.089685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:10.096116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:10.105498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:10.105498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:10.105498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:10.105498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:11.937576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.991749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:12.001225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:12.014066 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecd1effc-14dc-458e-9722-92b8617bd3b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1662 microversion: 2.42 time: 1.956623 Oct 04 21:10:12.015108 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2100/4256] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:10 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1662 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:12.036892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:12.039313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:12.065401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.068164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.069175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.076185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.079968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.079968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.830156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:12.875758 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99c23f5f-d5aa-470d-a1ab-37d41c5d7347 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 3.875869 Oct 04 21:10:12.880332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2157/4257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:08 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 3885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:13.071853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.076790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.116225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.124599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.126216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.128333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.129702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.132609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.088311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.156378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.158437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.162572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.167650 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bee69c16-54ac-4889-aa69-19e122aa77a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1662 microversion: 2.42 time: 1.101225 Oct 04 21:10:14.183823 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2158/4258] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:13 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1662 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:14.211611 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f458c36-9872-4219-8aef-419f0533eddc tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1520 microversion: 2.1 time: 2.181487 Oct 04 21:10:14.211611 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2101/4259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:12 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1520 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:14.227968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:14.229793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:14.257908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.259478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.260962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.263284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:14.266426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:14.271129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.024357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:15.059080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=91 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:15.077719 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80748f1c-4dc8-4339-82e8-c3753e92de2a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 0.880731 Oct 04 21:10:15.091710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2159/4260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:14 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:15.225181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.226369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.264722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.270041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.295085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.303905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.304743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.306090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.307003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.307806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.323284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.323284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.323284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.323903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.344796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.347802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.149976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.216261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.224188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.245827 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3aa3975-c3d9-492d-abfc-324ba84d8b6c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1662 microversion: 2.42 time: 3.027895 Oct 04 21:10:18.265430 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2102/4261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1662 bytes in 3044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:18.300142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:18.315477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:18.343084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.355963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.359763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.368089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.369743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.379368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.945739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.988670 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3c16213-56f7-45a0-a56f-fec271f90324 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1520 microversion: 2.1 time: 3.731246 Oct 04 21:10:18.995403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2160/4262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1520 bytes in 3739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:19.025954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ca71c-c7fb-4655-87fc-5b6b1e34feda", "name": "network-vif-plugged", "status": "completed", "tag": "e9779edb-550a-4455-9e36-68b34483c74a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:19.078336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.083969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.085935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.130486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] Creating event network-vif-plugged:e9779edb-550a-4455-9e36-68b34483c74a for instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda on n-h2-851029-13 Oct 04 21:10:19.143171 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-602eacb0-ac18-452b-9dd1-a68467bf6196 req-c7442418-b93a-461e-aa4b-f50a8f3b1feb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144071 Oct 04 21:10:19.145403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2161/4263] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:19.308757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.310441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.406780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.409746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.411881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.413834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.421981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.423490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.582017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:19.634272 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75b62bff-760f-428a-9c1c-784362c53336 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.364784 Oct 04 21:10:19.635388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2103/4264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:18 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:20.040221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:20.041465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:20.082917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.092111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.093690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.095425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:20.103792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:20.114372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.835975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.864267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.869053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:21.871923 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fcb3f10-0097-4040-b019-f2a17e81688d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1709 microversion: 2.42 time: 2.572696 Oct 04 21:10:21.873847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2162/4265] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1709 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:21.896793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.900901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.949484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.973836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.019128 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d32a5d8-296b-4d13-9d61-df8f79d08e38 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1520 microversion: 2.1 time: 1.991366 Oct 04 21:10:22.036222 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2104/4266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:20 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1520 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:22.930068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:22.935357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:22.983887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:22.985732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:22.986969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.002813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.005863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.010246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.583214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.615246 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef19675e-649f-4a94-a08e-78db5361d8e2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.731803 Oct 04 21:10:23.627838 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2163/4267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.670129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.686479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.732074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.734532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.738197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.738197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.738197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.744721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.717910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.743457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.780394 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c544b7d-1973-4447-ba6a-c15930529e76 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1505 microversion: 2.1 time: 1.145399 Oct 04 21:10:24.800893 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2164/4268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1505 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:24.815485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.841614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.842164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:24.844976 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-533887d3-8049-4e94-a27b-5aa85a5122b3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1756 microversion: 2.42 time: 1.923179 Oct 04 21:10:24.846072 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2105/4269] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:22 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1756 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:10:24.857968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.880020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.891377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.910761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.913435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.915753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.917443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.919874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.921320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.929117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.931580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.939067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.957151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.958190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.964147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.810079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:26.829988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=82 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:26.867405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e72338af-bdfc-42a3-a7dd-e2936ef53cc5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 200 len: 1505 microversion: 2.1 time: 2.005061 Oct 04 21:10:26.878996 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2106/4270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 1505 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:27.211262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2007551962", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:27.499731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:28.083320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.177257 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efafc054-2e99-4ab6-b794-b8398ea4d55a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 3.361742 Oct 04 21:10:28.191487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2165/4271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 3390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.239598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.248014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.282285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.287316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.392213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.392213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.392213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.392213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.907028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.949781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.953396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.959265 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ccdcab3-1dc7-48ed-9882-a86f891ffd80 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1756 microversion: 2.42 time: 0.765661 Oct 04 21:10:28.960423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2166/4272] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1756 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:28.972560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.973075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:29.031777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.032298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.032754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.033636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:29.034123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:29.036686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:29.177584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:30.317463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41e07a86-a483-4bb9-a702-fff851bc443c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 204 len: 0 microversion: 2.1 time: 1.352256 Oct 04 21:10:30.319059 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2167/4273] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:10:28 2022] DELETE /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 0 bytes in 1358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:10:30.365548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:30.373412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:30.401777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.409517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.414537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.417825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.427987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.436614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.607146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:30.614244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:30.614244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:30.614244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:30.614244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:30.671214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.675073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.677934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.681961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:30.687166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:30.689595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:30.745409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:30.760102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:30.790290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:30.796623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:31.124491 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c14fac54-d747-4574-852c-5c2f2f5a55f6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.237319 Oct 04 21:10:31.125733 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2107/4274] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:10:31.167287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:31.170024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:31.220749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:31.259286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.260957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.262274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.265102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:31.269729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:31.272247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:31.330352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09df24ea-0e40-490b-8e82-e1bcff02a480 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.008890 Oct 04 21:10:31.331854 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2168/4275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:30 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:31.411231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1601474005", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a6cd9541-a599-4f3f-94c5-fad267f72e3d"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:31.741278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] validate_networks() for [('a6cd9541-a599-4f3f-94c5-fad267f72e3d', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:33.530816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.632133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.647444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:33.662234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f395549c-1e62-4f7b-a06a-612ff8a063f1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1803 microversion: 2.42 time: 2.523798 Oct 04 21:10:33.667095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2108/4276] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:31 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1803 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:33.767228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f623631-c97d-4723-b44d-14615d2ce116 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:33.776326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f623631-c97d-4723-b44d-14615d2ce116 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.389901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f623631-c97d-4723-b44d-14615d2ce116 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:34.473434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f623631-c97d-4723-b44d-14615d2ce116 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1193 microversion: 2.1 time: 0.769918 Oct 04 21:10:34.487832 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2109/4277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:33 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1193 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:34.566174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:34.575163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:34.639582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.648459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.652348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:34.655242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:34.656551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:34.657651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.103955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:35.104933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:35.114354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:35.115721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:35.117519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:35.164367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.166293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.167447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.169777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:35.171435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:35.172499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:35.317151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:35.353604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for user 70725c9735414d649b11fd73576174f0 and project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:35.449181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:35.452759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:35.485108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:36.237604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1158a08b-f635-4e22-b29e-2fbfb987abc2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.872589 Oct 04 21:10:36.238919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2169/4278] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:10:36.286510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.287829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.373309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.374440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.377179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.389256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.392021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.394777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.495722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:36.554969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-387c2798-39fe-4c8b-a4a3-b15c40629dc8 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 2.046765 Oct 04 21:10:36.604682 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2110/4279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:34 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:36.634451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.636342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.649827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:36.653749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.655730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.656946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.658505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.659814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.660908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.960431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.040164 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a598caae-a076-4dbf-b2d5-8246eb61e065 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1189 microversion: 2.1 time: 0.429881 Oct 04 21:10:37.044868 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2111/4280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1189 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:37.078607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c3f2cf8-4257-40f0-b9c6-1048d484fced tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:37.082758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c3f2cf8-4257-40f0-b9c6-1048d484fced tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.089677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c3f2cf8-4257-40f0-b9c6-1048d484fced tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.147411 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c3f2cf8-4257-40f0-b9c6-1048d484fced tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1218 microversion: 2.1 time: 1.089008 Oct 04 21:10:38.153838 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2112/4281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:37 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1218 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.193609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.196007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.218985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.220444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.221761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.223704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.225131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.228152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.994785 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:10:38.994785 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:10:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 (ip 10.222.0.36) !!! Oct 04 21:10:39.517378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.583771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.601593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.604784 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ec1035b-3f95-4ea2-b9cb-0e23f79bf3da tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1803 microversion: 2.42 time: 3.349387 Oct 04 21:10:39.623196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2170/4282] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1803 bytes in 3383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:39.703697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.707501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.784592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.786157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.787511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.795845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.795845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.795845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.988101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.032980 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ab70738-f693-4e2c-9960-862c9ec2ccf3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.870700 Oct 04 21:10:40.037861 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2113/4283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.083956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1ca71c-c7fb-4655-87fc-5b6b1e34feda", "name": "network-vif-deleted", "tag": "e9779edb-550a-4455-9e36-68b34483c74a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:40.128478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.133250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.134502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.245040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] Creating event network-vif-deleted:e9779edb-550a-4455-9e36-68b34483c74a for instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda on n-h2-851029-13 Oct 04 21:10:40.266363 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-90ae9308-4883-4a46-8f6a-f0e999151417 req-a5fa217d-e181-41b5-9781-e937978ce307 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221389 Oct 04 21:10:40.270568 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2114/4284] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:40.284856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.299473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.327440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.328332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.329135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.330501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.331396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.332204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.421139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.447974 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2dac486-466d-4efe-8e52-77d61268e90c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1263 microversion: 2.1 time: 0.819255 Oct 04 21:10:40.458731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2171/4285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1263 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.586283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:40.631969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c31c8ac-0a94-4401-9e13-0e3a13c6c7a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1222 microversion: 2.1 time: 0.358686 Oct 04 21:10:40.640988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2115/4286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1222 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.671874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.676790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.724290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.725358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.733982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.737170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.738113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.757570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.096661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:41.098152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:41.110711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:41.136897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.141933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.144193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:41.148996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:41.152552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:41.155206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.080307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.120993 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d643afd7-6f8f-4fda-97b7-4e6481ad6df3 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1508 microversion: 2.1 time: 1.035102 Oct 04 21:10:42.140885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2116/4287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:41 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1508 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:42.170281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.181098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.225231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.225231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.225231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.226021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.236952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.239940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.240942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.276717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.281494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.286452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b13aed1a-e6ab-407d-8393-6ae8d17a1536 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1850 microversion: 2.42 time: 1.622833 Oct 04 21:10:42.290739 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2172/4288] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1850 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:42.302148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.308274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.351086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.354740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.360765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.364134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.379577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.380392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.619248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.653135 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ba90929-107e-43be-b7a6-6dab83b28abf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1251 microversion: 2.1 time: 0.509414 Oct 04 21:10:42.686883 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2117/4289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1251 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:42.848077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.888382 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56171a2d-28af-4e1e-bd54-549e3f0efee9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1270 microversion: 2.1 time: 0.588306 Oct 04 21:10:42.891783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2173/4290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1270 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:43.197374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:43.200699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:43.244018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.245091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.269658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.269658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.269658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.269658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.344956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:43.347449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:43.365252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.366775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.368087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.369548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.370636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.372596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.235907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:45.414183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:46.406096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.412632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.416816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:46.471313 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee04f82a-e1d8-4dd5-a701-a49b4a859289 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1505 microversion: 2.1 time: 3.297658 Oct 04 21:10:46.474718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.475915 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2118/4291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:43 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1505 bytes in 3304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:46.487435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.489567 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cfedbc2a-ab59-4b17-aaff-1fbbb8930714 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1850 microversion: 2.42 time: 3.154234 Oct 04 21:10:46.492311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2174/4292] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:43 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1850 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:46.497092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.500082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.528808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.530826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.537690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.542007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.548128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.550018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.555257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.556664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.557542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.563054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.564201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.569865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.569865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.569865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.837367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.913510 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-760565c0-b606-4e01-8f6c-05e2b31e007d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1276 microversion: 2.1 time: 0.418228 Oct 04 21:10:46.933121 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2175/4293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1276 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:47.290963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea66a1f-1c46-4451-83a6-5c8bd7c50d03", "name": "network-vif-unplugged", "status": "completed", "tag": "2cf67303-c10a-4139-856c-d79d4f70b25e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:47.313031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.314945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.316748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.390775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] Creating event network-vif-unplugged:2cf67303-c10a-4139-856c-d79d4f70b25e for instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 on n-h1-851029-13 Oct 04 21:10:47.430370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1bc6b48c-5d8e-4741-b39c-ece3d7fc11b8 req-1b4ec00e-9870-4dd6-8037-3ea33917efe3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141721 Oct 04 21:10:47.433161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2176/4294] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:47.532645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:47.544129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:47.585557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.585773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.586461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.587886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.595281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.597974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.115889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:48.245769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.272696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11806f53-75c6-4f30-ba53-f484ad26b704 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1293 microversion: 2.1 time: 1.794387 Oct 04 21:10:48.279709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2119/4295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1293 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:48.299639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:48.302368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:48.328536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.340512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.341754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:48.343486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:48.344696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:48.345799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.343585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:49.374827 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60ecdeb3-8984-43e2-87da-8d80dd1a398f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1505 microversion: 2.1 time: 1.854452 Oct 04 21:10:49.392604 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2177/4296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:47 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1505 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:49.430824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.432502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.453024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.455632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.457859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.460094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.461578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.462693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.075204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.126450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4073aea1-e7c6-47f5-ae57-1489a62709a5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1276 microversion: 2.1 time: 0.724448 Oct 04 21:10:50.142706 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2178/4297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1276 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:50.163692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "448f9e2e-3a37-4d83-bb3c-2ce30b40640b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:50.232608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.233582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.234413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.271734 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] Creating event network-changed:448f9e2e-3a37-4d83-bb3c-2ce30b40640b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:10:50.281756 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-12db8441-cd34-43dd-9dac-61b610e0113f req-602fb001-195e-48c6-8211-7f22a3e08db9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142875 Oct 04 21:10:50.302295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2179/4298] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:50.349895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:50.352104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.395592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.399867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.400872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.408461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.410871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.413459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.722518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.743622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.749844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.752689 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d56f5263-dda9-4b11-97fe-22ef5195c9a1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1850 microversion: 2.42 time: 2.470674 Oct 04 21:10:50.802410 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2120/4299] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:48 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1850 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:50.815697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:50.817349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.834774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.836206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.839114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.843407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.844612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.845700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.039025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.084971 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93190dce-7cb8-4755-a115-b52398b1bcd0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1293 microversion: 2.1 time: 1.769648 Oct 04 21:10:52.087952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2180/4300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:50 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1293 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:52.102806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:52.104275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:52.139764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.141198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.142995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.148321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.150057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.151648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.541796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.602094 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2e02775-7d01-44ea-8a68-4eee54784a36 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 200 len: 1448 microversion: 2.1 time: 1.793719 Oct 04 21:10:52.604160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2121/4301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:50 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 1448 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:52.631926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:52.636323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:52.660352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.661942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.669145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.671387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:52.673071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:52.674870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.229070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:53.259717 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20fa8924-05e4-4176-ab1e-8c72f8b37d7c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 1.169092 Oct 04 21:10:53.260842 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2181/4302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:52 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:53.282180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:53.283603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:53.303722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.310891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.312432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:53.313910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:53.321016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:53.322525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.091277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.115610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.119447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:54.124384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11ab57a2-4e12-470a-a150-fe302daa2b09 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1850 microversion: 2.42 time: 1.513471 Oct 04 21:10:54.128036 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2122/4303] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:52 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1850 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:54.143614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbd4dda-1b94-4010-a079-02b68a91dea4", "tag": "53fe7116-b114-4972-be78-5cfc2974a4fc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:54.188185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.191445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.195992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.253511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] Creating event network-changed:53fe7116-b114-4972-be78-5cfc2974a4fc for instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 on n-h1-851029-13 Oct 04 21:10:54.263589 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-be56934c-e65d-4f8b-a93a-613ccccb2446 req-c3688675-4505-441e-b54e-2025a2a02674 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132449 Oct 04 21:10:54.266016 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2123/4304] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:54.684177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:54.689636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:54.707877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.710889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.713551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.717240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:54.718595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:54.721378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:54.810543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:10:54.984653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:55.017225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e990d50-4344-4687-9d30-bb1a3bee2b10 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.744301 Oct 04 21:10:55.018315 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2182/4305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:53 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:55.050789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:55.052239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:55.113732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.121700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.126361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.131641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.137560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.139977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.401111 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86afea79-1d2b-4d84-9895-6acbe24a055d tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 204 len: 0 microversion: 2.32 time: 1.132064 Oct 04 21:10:55.403212 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2124/4306] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:10:54 2022] DELETE /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:10:55.423357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:55.435335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:55.465849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.466814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.467642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.470300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.471245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.472054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.422147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:56.428449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:56.438539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:56.453840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a79739c-2518-468f-91b4-a954046a9ddf tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 1.048056 Oct 04 21:10:56.455955 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2125/4307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:55 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:56.463610 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d7d1337-638c-4f34-8123-64496541a60c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1293 microversion: 2.1 time: 1.431143 Oct 04 21:10:56.466821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:56.468524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:56.469267 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2183/4308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:55 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1293 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:56.493466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:56.494623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:56.508124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.510707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.515257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.517116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.523889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.525119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.533132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.536502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.539845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.544627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.546797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.557244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.600034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.620913 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b47be2b4-e9de-4798-a1f9-4a8d82061a90 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.160722 Oct 04 21:10:57.645100 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2126/4309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:56 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:57.670994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:57.675520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:57.691300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.694181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.696159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.698124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.700157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.707710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.898904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.943068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.951853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.962240 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ddc253d6-8406-4f52-b5e1-9aaddb5771ea tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1871 microversion: 2.42 time: 1.484914 Oct 04 21:10:57.992013 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2184/4310] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:56 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1871 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:58.012228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:58.024144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:58.045950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:58.046642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:58.047460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:58.048857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:58.049774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:58.050607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:59.275973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:59.345852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:59.345852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:59.350410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d131df6-d474-4465-ae86-6a0761a49e9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2952 microversion: 2.32 time: 1.702344 Oct 04 21:10:59.352180 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2127/4311] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:10:57 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2952 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:10:59.376715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:59.378769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:59.414833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:59.415931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:59.416916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:59.418802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:59.419824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:59.420748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:00.653985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:00.671547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-459f151e-0294-4a32-8800-ae97a343c1d5 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 2.698415 Oct 04 21:11:00.686407 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2185/4312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:57 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:00.686407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:00.686407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:00.697318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:00.701149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:00.701149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:00.702625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:00.703976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:00.705190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.749634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:01.778959 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56f28158-1b39-4f85-87f5-2944381f2410 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1293 microversion: 2.1 time: 2.424198 Oct 04 21:11:01.786695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2128/4313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:59 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1293 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:01.823151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "f0255488-6f0e-47ee-99d3-249d39b64c02"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:01.845295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.847213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.848533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.881464 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] Creating event network-changed:f0255488-6f0e-47ee-99d3-249d39b64c02 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:01.901669 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-96fb8e32-ac88-46cd-a761-8e33b67d1adc req-27590df9-bd4d-4b5d-8e0d-76c4238e0a21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098848 Oct 04 21:11:01.907469 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2129/4314] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:01.922600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:01.924621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:01.941300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.942884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.944239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.946010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:01.947473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:01.949447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.183991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.221249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2603571-b151-43bd-89af-eefc6fbcd18b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 2.546396 Oct 04 21:11:03.264023 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2186/4315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:00 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:03.276930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.278832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.356446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.358170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.362332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.364333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.368423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.369896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.642527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.692969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.704701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.719171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53a1f43f-6746-42e9-81fa-3d37627c38c2 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1859 microversion: 2.42 time: 2.806324 Oct 04 21:11:04.734707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2130/4316] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:01 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1859 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:04.747723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.751415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.781994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.783240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.876376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.876376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.876376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.876376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.920179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.942259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.947073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.951570 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b79cc0a9-888e-4c38-acdc-19047eacb979 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2952 microversion: 2.32 time: 1.694292 Oct 04 21:11:04.953589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2187/4317] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2952 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:04.963592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd4dda-1b94-4010-a079-02b68a91dea4", "name": "network-vif-plugged", "status": "completed", "tag": "53fe7116-b114-4972-be78-5cfc2974a4fc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:04.998794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.006891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.008894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.057782 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] Creating event network-vif-plugged:53fe7116-b114-4972-be78-5cfc2974a4fc for instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 on n-h1-851029-13 Oct 04 21:11:05.076265 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-37dfd110-eb35-415a-9261-aceb05ea81ad req-52aa7e3f-dcbe-4707-a532-78c32a4f203c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114996 Oct 04 21:11:05.077712 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2188/4318] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:05.088298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.090910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.113538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.115899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.117707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.119497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.120692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.121818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.373813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.417444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e3e3460-0d7d-4e8f-a1cb-1b1e2e520172 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 1.679862 Oct 04 21:11:06.417444 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2131/4319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:06.431153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:06.433275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:06.465388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.466313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.467162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.468510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.469380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.470265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.020731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.084026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b26075b1-9e59-460f-80ff-02e781eea148 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1293 microversion: 2.1 time: 2.003880 Oct 04 21:11:07.091550 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2189/4320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1293 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:07.138489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d9fd99-af7d-4647-b7ec-e53ba426cbc6", "tag": "4ca160fc-3f68-45f1-a9df-b844e2107b19"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:07.179740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.196622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.203978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.203978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.271952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] Creating event network-changed:4ca160fc-3f68-45f1-a9df-b844e2107b19 for instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 on n-h1-851029-13 Oct 04 21:11:07.283674 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9bd7ffa6-8fbc-4d9b-a7b1-b37236b4f18e req-18d0091e-b51f-4e11-b19c-298fa259823f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182185 Oct 04 21:11:07.286323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2190/4321] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:07.303516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.307237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.322131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.323711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.324869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.326611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.328285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.329409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.851553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.880974 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2657dcbb-47ce-4b39-9dff-fe7e05c248f1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 2.467231 Oct 04 21:11:08.895207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2132/4322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:06 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:08.910225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.920340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.948407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:08.954276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.955571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.968466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.968466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.968466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.968466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:09.970056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.016378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.040075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.068121 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d408d7b-6069-4693-9233-6015a86fc3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 2.772164 Oct 04 21:11:10.082406 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2191/4323] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 2795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:10.123776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "93a4e256-8c57-4536-b81c-220b77c4594f"}, {"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "7e9671fe-e420-4d77-bc2e-58859c1d9e34"}, {"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "e7d5ab4f-820d-4e55-a179-5023e49c5d2a"}, {"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "24459c03-b523-48fe-b744-d8e703f3d412"}, {"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "e5c13171-a4f5-4cc9-87ca-58d6d153e34a"}, {"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "fca02ccb-d52e-4b3a-b636-8c6d705f39fb"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:10.155870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.157594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.158870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.186462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:93a4e256-8c57-4536-b81c-220b77c4594f for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.188160 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:7e9671fe-e420-4d77-bc2e-58859c1d9e34 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.189708 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:e7d5ab4f-820d-4e55-a179-5023e49c5d2a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.191740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:24459c03-b523-48fe-b744-d8e703f3d412 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.193219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:e5c13171-a4f5-4cc9-87ca-58d6d153e34a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.194646 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] Creating event network-vif-unplugged:fca02ccb-d52e-4b3a-b636-8c6d705f39fb for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:10.208558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d8f2e023-d99c-4fe7-83ba-3aec52dc88fb req-6d397b1d-9453-4789-b949-de63614e9e72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.122191 Oct 04 21:11:10.210272 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2192/4324] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:10.242781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.252998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.256228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.277548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.279059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.280322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.281329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.282755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.284377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.286616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.286903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:10.290167 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aed7ed3b-5c07-48c3-8ae4-b4baa5e88a9f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2931 microversion: 2.32 time: 1.392288 Oct 04 21:11:10.291930 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2133/4325] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2931 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:10.311842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:10.317038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:10.343202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.344738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.346000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:10.348589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:10.352117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:10.353461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:11.881805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:11.922198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb6dbd83-ee6a-4ccb-a9a1-5092b2a4bce1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 1.706696 Oct 04 21:11:11.927976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2193/4326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:11.953948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:11.989245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:11.991926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:11.995783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.139799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:12.148016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:11:12.166523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3299c597-0f57-4b76-aa7b-ef335fc22afd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1474 microversion: 2.1 time: 1.872324 Oct 04 21:11:12.181064 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2134/4327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:10 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1474 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:12.213553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:12.221466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:12.255830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.256596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.257334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.258702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.259558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.263880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.401113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:12.702376 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5e23e48-912e-44b1-89a8-b3abce36057b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.768579 Oct 04 21:11:12.719989 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2194/4328] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:11 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:12.768265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "b777036e-9370-4e44-95d2-69377dd05e6b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:12.848920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:12.856858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:12.856858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:12.940630 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] Creating event network-changed:b777036e-9370-4e44-95d2-69377dd05e6b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:12.989149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7689647d-4a9e-4a3b-a257-426a56cdf138 req-7fe75685-da1e-4442-8ecf-08b3feef61d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248483 Oct 04 21:11:13.000387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2195/4329] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:13.034089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:13.035484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:13.077017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:13.077621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:13.079353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:13.085085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:13.086429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:13.088757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.450485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.471413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.474585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.477073 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46cf48e9-3117-4fe4-8d49-3690b873e6b6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 3.289371 Oct 04 21:11:15.478943 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2135/4330] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:12 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 3297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:15.488250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-unplugged", "status": "completed", "tag": "4d1ed2fc-0e45-494e-92bc-5b098ec82e93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:15.533354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.542503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.545210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.546590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.576799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] Creating event network-vif-unplugged:4d1ed2fc-0e45-494e-92bc-5b098ec82e93 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:15.585596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.595076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4e40dfb1-09a5-4d64-90b5-6fb00d76ce91 req-cdcbf246-ee52-46a3-a7e5-115fff0e170c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113371 Oct 04 21:11:15.596429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:15.600090 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-990ac3bd-322e-4f2e-9126-933e5bba2845 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2931 microversion: 2.32 time: 2.591671 Oct 04 21:11:15.601614 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2136/4331] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:15.608520 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2196/4332] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:13 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2931 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:15.622846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:15.625955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1418930256", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:15.638568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:15.667962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.672098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.673663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.675497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:15.684247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:15.685608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:15.800997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:16.513008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:16.587366 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d445dffb-6dc0-45bb-84d3-91790f792db0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 0.977994 Oct 04 21:11:16.590068 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2197/4333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:15 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:16.620961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:16.624315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:16.648396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.649929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.651148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:16.653791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:16.656184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:16.657962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.108426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:19.137475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db27d149-27dd-46c4-8f67-545e8d677ea2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 2.528780 Oct 04 21:11:19.170976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2198/4334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:16 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:19.209224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:19.216814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:19.272013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.280064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.286458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:19.291534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:19.292906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:19.299040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.710066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:20.711379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:20.713781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:20.718566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:20.722597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:20.805351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.809810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.818101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.824437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:20.824437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:20.824437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:20.926983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:20.942871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:20.978111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:20.985941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:21.233590 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a1ac784-0857-479c-8822-aa188ca9389d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.629133 Oct 04 21:11:21.235080 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2137/4335] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:21.280681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.280681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.314742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.318367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.319722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.324429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.325616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.327913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.732549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.816486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.830764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.830764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-928e51e5-0366-47c3-a201-20a5abdb60df tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 2.649062 Oct 04 21:11:21.830764 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2199/4336] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:19 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:21.867658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.872315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.923514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.928533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.930536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.936255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.945787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.950217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.803792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.844390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-004c4c60-92b2-45d1-b960-d6e0f92633d9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1678 microversion: 2.1 time: 2.007956 Oct 04 21:11:23.849597 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2200/4337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1678 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:23.897277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9fd99-af7d-4647-b7ec-e53ba426cbc6", "name": "network-vif-plugged", "status": "completed", "tag": "4ca160fc-3f68-45f1-a9df-b844e2107b19"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:23.950939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:23.956425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:23.957339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.016871 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] Creating event network-vif-plugged:4ca160fc-3f68-45f1-a9df-b844e2107b19 for instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 on n-h1-851029-13 Oct 04 21:11:24.035347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ae69d8bd-69d8-453b-826a-3adf8d5359bd req-ded13d7e-4d3e-42ca-a5e8-274d092c362e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178109 Oct 04 21:11:24.056808 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2201/4338] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:24.099763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.101144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.131128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.132433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.136071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.136071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.136071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.141319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.640937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.709280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.713548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.728705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54417b7c-0ce0-4486-8761-dd35784f22b2 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2910 microversion: 2.32 time: 4.484094 Oct 04 21:11:25.731409 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2138/4339] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2910 bytes in 4496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:25.800547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.802297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.819985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.821390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.822854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.825162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.827087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.828227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.893254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:11:26.527274 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99adc226-01fa-4cb8-8054-4c9550a6b8ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7" status: 204 len: 0 microversion: 2.1 time: 0.792223 Oct 04 21:11:26.528891 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2139/4340] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:11:25 2022] DELETE /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:11:26.559601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:26.611831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.618001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.622405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.645545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.691220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d811f4e9-4d17-4784-b752-02409e7552c7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1318 microversion: 2.1 time: 2.624445 Oct 04 21:11:26.695294 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2202/4341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1318 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:26.704835 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] Creating event network-changed:fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:26.725685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.728873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.735128 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-62a4316f-545f-4f11-9f39-620441013db1 req-96e47da6-adc4-4d9b-93f5-9dcb46a9e98e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200511 Oct 04 21:11:26.741753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2140/4342] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:26.770266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.773078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.774760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.775639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.781596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.784167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.790852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.798454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.862221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.873389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.877708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.885705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.886843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.887662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.918342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:29.409249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.437809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-495af3ad-47e7-4de4-8ad5-3ffc7c407e8f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1655 microversion: 2.1 time: 2.689393 Oct 04 21:11:29.441521 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2141/4343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1655 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:29.474593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.482700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.521598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.522770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.530714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.535769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.540526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.541537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.298995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.321445 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a49df57d-1fbc-4a1f-8b24-40186a83a091 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7" status: 200 len: 1211 microversion: 2.1 time: 0.863370 Oct 04 21:11:30.346948 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2142/4344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 => generated 1211 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:30.368523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.369673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.385692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.391580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.393514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.395176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.396401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.397734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.892294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:30.962466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:31.134589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:31.177075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:31.181011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:31.185493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f37985ad-3a15-4f6d-b3eb-0b1bf2d9fa6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 4.484242 Oct 04 21:11:31.188292 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2203/4345] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 4488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:31.201222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.204730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.241523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.243462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.246373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.248512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.249820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.250914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.132705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.200040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.210294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.219501 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0736c717-df8a-41f6-b857-b07b11978912 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2816 microversion: 2.32 time: 2.862945 Oct 04 21:11:33.225939 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2143/4346] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2816 bytes in 2877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:33.244517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-deleted", "tag": "fca02ccb-d52e-4b3a-b636-8c6d705f39fb"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:33.276773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.302153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.308094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.308094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.311156 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b091b68e-ac69-45be-8495-99389ab70112 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1508 microversion: 2.1 time: 2.120502 Oct 04 21:11:33.331400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2204/4347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:31 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1508 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.366061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:33.383721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] Creating event network-vif-deleted:fca02ccb-d52e-4b3a-b636-8c6d705f39fb for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:33.418126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.418545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.419436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.426524 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5d152d58-a437-47f7-b50c-24ce4be8fc22 req-499e87b7-8c1a-4457-9b29-ebfc9c48edfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191378 Oct 04 21:11:33.431061 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2144/4348] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:33.504692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.506402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.578032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.582966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.583181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.584319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.585028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.585689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.620641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:11:33.650038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 HTTP/1.1 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7b2e363f-c67a-4079-9b97-599136b1c3c7'} Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:11:33.656908 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:11:33.671396 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:11:33.676547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:11:33.679024 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c0b8daa-358d-43d2-a906-e32da6a89083 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7" status: 404 len: 111 microversion: 2.1 time: 0.241258 Oct 04 21:11:33.683139 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2145/4349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:11:33.691161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.693015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.708049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.709284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.710788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.712419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.713683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.715349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.054406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4738474-4676-493b-8fd2-0f2848068171 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.720539 Oct 04 21:11:34.060660 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2205/4350] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:34.095417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.107702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.148601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.151984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.153303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.157914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.161405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.165941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.493835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.550074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.557391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.559772 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00b92939-4b4e-4223-b1a6-875a7778c98e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.877317 Oct 04 21:11:35.560815 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2146/4351] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:35.591657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:35.595134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:35.612151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.614546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.615748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.617356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.618211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.619084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.780725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.825648 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16e9a146-0c45-4fcc-a7d7-86f93e53053f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1508 microversion: 2.1 time: 1.761493 Oct 04 21:11:35.827417 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2206/4352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1508 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:35.903103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-649316163", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:36.075900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:37.222861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:37.250178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-813b9875-1323-4f55-aacf-71a802fa6f1e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1664 microversion: 2.1 time: 1.675386 Oct 04 21:11:37.251505 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2147/4353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:35 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1664 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:37.298332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.311656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.347144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.465795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.494767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.498088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.510246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f46a3a8a-0130-408b-99db-7020b154a075 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2816 microversion: 2.32 time: 1.219324 Oct 04 21:11:38.512802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2148/4354] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2816 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:38.522641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-deleted", "tag": "e5c13171-a4f5-4cc9-87ca-58d6d153e34a"}, {"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "0e5e760a-f01f-4572-83ba-c4b920e8ea69"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:38.603738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.607448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.609528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.652904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Creating event network-vif-deleted:e5c13171-a4f5-4cc9-87ca-58d6d153e34a for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:38.654695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] Creating event network-changed:0e5e760a-f01f-4572-83ba-c4b920e8ea69 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:38.685874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3d091cd6-4a7f-465e-9992-d952555c1ad8 req-a058c9d4-af43-487d-9c08-12614ed8408f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.170358 Oct 04 21:11:38.692411 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2149/4355] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:38.757130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:38.778562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:38.797050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.799461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.800272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.801643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:38.802518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:38.803936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.348094 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb6cb469-875f-4f82-80ec-59186142d448 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "PUT /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1080 microversion: 2.1 time: 0.639307 Oct 04 21:11:39.374700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2150/4356] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:11:38 2022] PUT /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1080 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:39.389461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.396494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.422200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:39.425549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.426398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.429651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.438751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.440696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.442097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.606404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:39.611486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:39.611486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:39.611486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:39.611486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:39.618977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:39.639098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.642093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.643394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.645211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.646110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.647055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.692158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:39.705937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:39.736440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:39.744471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:39.973554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-033545ef-29d8-406d-ba52-2d3bd6ea2897 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.089041 Oct 04 21:11:39.973554 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2207/4357] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:39.994153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "70282be4-4cea-436c-b0e0-de05f59122d4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:40.054038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.056148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.058019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.089986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] Creating event network-changed:70282be4-4cea-436c-b0e0-de05f59122d4 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:40.102584 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c992757d-0332-4385-b472-17d49c82b9c8 req-4bbc22d7-daec-4438-8d6b-ce725c26cd4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136037 Oct 04 21:11:40.105077 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2208/4358] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:40.118312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.121137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.135325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.136891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.137741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.141496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.142947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.144148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.107348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.138201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.150234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.163946 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95cd8b86-7c89-4d88-b512-6fe112c3388a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.794318 Oct 04 21:11:41.174618 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2151/4359] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:41.202907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.203878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.234995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.236029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.237135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.241391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.244969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.246060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.524706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.543476 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2865fe17-949c-426b-9d19-44101116199f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1664 microversion: 2.1 time: 1.435562 Oct 04 21:11:41.545779 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2209/4360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1664 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.616914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.618414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.658475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.665009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.668085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.676156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.694523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.697770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.243548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.272319 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67e013b6-bd8a-4660-8041-9e3add52cb9b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1506 microversion: 2.1 time: 1.095270 Oct 04 21:11:42.274457 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2152/4361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.315760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f79f5cad-cc25-49f4-9f72-297d18d67b66 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.320880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f79f5cad-cc25-49f4-9f72-297d18d67b66 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.542840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f79f5cad-cc25-49f4-9f72-297d18d67b66 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.570887 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f79f5cad-cc25-49f4-9f72-297d18d67b66 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1220 microversion: 2.1 time: 0.286424 Oct 04 21:11:42.570887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2153/4362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1220 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.595806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-deleted", "tag": "4d1ed2fc-0e45-494e-92bc-5b098ec82e93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:42.624298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.631079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:42.634223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.637170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.639423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.657437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.661426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.665132 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dfb22be5-dc4d-4d82-a400-d837f65779e5 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2655 microversion: 2.32 time: 1.116602 Oct 04 21:11:42.674175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2210/4363] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2655 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:42.675520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] Creating event network-vif-deleted:4d1ed2fc-0e45-494e-92bc-5b098ec82e93 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:42.685356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "e9d8d425-b525-4f9b-a3e6-7eeea44a6954"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:42.689938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-901543d1-7e99-4ae0-9399-83dfaeed2631 req-68ddb211-1bad-40b5-b450-57be57530219 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119330 Oct 04 21:11:42.692892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2154/4364] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:42.710995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.712138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.712857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.737643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.739122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.752138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] Creating event network-changed:e9d8d425-b525-4f9b-a3e6-7eeea44a6954 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:11:42.783022 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-061cdd5f-35c1-4bb9-b4dd-bdc79216f961 req-d5516f92-9366-49ab-878f-85e9510ac57a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105217 Oct 04 21:11:42.785258 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2211/4365] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:42.790961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.794632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.797294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.801058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.801814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.806643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.810391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.811735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.822512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.824345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.825685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.827798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.829135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.830275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.978491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.025705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.031964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c28797b-d4df-4c21-8427-e4b5ed2c8493 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1506 microversion: 2.1 time: 1.243791 Oct 04 21:11:44.039104 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2212/4366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1506 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:44.073589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.077408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.082416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.094031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.099147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9af84c64-5dae-44a8-9d3e-35eb1dad432a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.403942 Oct 04 21:11:44.101186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2155/4367] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:44.115762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.116929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.124915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.126995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.146056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.146056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.146056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.146056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.154427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.168010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.169364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.171270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.172621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.186797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.647446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.675604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1044c11c-51ad-40fb-9761-91cc8c16c1a1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1216 microversion: 2.1 time: 0.569249 Oct 04 21:11:44.677773 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2156/4368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1216 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:44.696609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.700003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.714154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.715778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.726843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.730989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.737647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.739552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.175655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.234364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ed7fdd0-b1ef-4dbe-abf6-a901350e7803 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.182240 Oct 04 21:11:45.246827 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2213/4369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:45.310373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:45.332092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:45.360881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.370800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.375107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.380345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.387016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.388668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.584579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.663605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.703604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.708810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c786e89-15e1-4b90-877b-910bc78597aa tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2323 microversion: 2.32 time: 1.020112 Oct 04 21:11:45.720041 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2157/4370] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2323 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:45.753109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-deleted", "tag": "24459c03-b523-48fe-b744-d8e703f3d412"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:45.801017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.801482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:45.803332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.806595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.817081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:45.818063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:45.818993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:45.826498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:45.843166 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] Creating event network-vif-deleted:24459c03-b523-48fe-b744-d8e703f3d412 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:45.859987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-37b0180e-1f7f-4542-9cd5-c72351c19dc8 req-77aea352-b8a0-47eb-bd89-e95f910fcfee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134920 Oct 04 21:11:45.861892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2158/4371] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:45.896045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:45.899934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:45.915829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.919774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.923003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.930797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.934036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.935433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.491420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.541918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.550163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.558810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.558810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.564281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.579048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.807616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e7864c2-29ae-4df1-8995-91c5628552cb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "POST /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6/action" status: 202 len: 1112 microversion: 2.1 time: 1.550421 Oct 04 21:11:46.816289 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2214/4372] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:45 2022] POST /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6/action => generated 1112 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:11:46.856926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:46.864267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.902374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.903728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.904906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.908755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.913986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.915332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.158745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.189057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.197190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.204272 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d5e7c87-9bf2-4c5f-a09a-ccd2fa79b92c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.338175 Oct 04 21:11:47.210778 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2159/4373] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:45 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:47.228918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:47.240143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:47.275496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.278522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.280274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.284632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.286291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.288406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.827371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.855779 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c76ca93-73bf-4b47-bc23-b081c08d8ba5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1280 microversion: 2.1 time: 0.642521 Oct 04 21:11:47.858242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2160/4374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:47 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1280 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:47.881702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:47.884166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:47.902448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.903871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.905222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.908276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.909901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.939832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:48.027914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:48.048330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:48.077397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-553ff0c1-7fea-4b3b-ac55-bcd7c7eca005 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.258401 Oct 04 21:11:48.091739 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2215/4375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:46 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:48.126750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:48.131057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:48.161280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:48.161967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:48.163226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:48.164587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:48.165707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:48.169503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:48.969103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:48.998340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:49.024291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:49.027330 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e4b8bd0-c841-4448-af22-2aaa9639944e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 2097 microversion: 2.32 time: 1.158410 Oct 04 21:11:49.029431 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2161/4376] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:47 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 2097 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:49.051656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:49.059396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:49.080446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:49.084006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:49.085244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:49.090249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:49.091811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:49.094267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:49.662451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:49.674591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:49.705003 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8473b1c-6dde-496f-a804-cbc3ad4dac2e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1517 microversion: 2.1 time: 1.610787 Oct 04 21:11:49.713341 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2216/4377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:48 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1517 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:49.722569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:49.743271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:49.782479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:49.786105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:49.791687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:49.793073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:49.797994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:49.799496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:49.806130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.027095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:50.095079 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f4b0b47-9c0c-4943-a051-9a260d5f1ba9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.058592 Oct 04 21:11:50.103138 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2162/4378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:49 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:50.153178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:50.155242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:50.198429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.215073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.216764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.218936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.221578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.226684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.453297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:50.470430 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df880a74-b92d-41f0-a4b5-1a7f80445188 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1278 microversion: 2.1 time: 0.363222 Oct 04 21:11:50.471169 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2163/4379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:50 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:50.481318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6bd581-993f-4a0d-97dd-164a80024531", "name": "network-vif-deleted", "tag": "7e9671fe-e420-4d77-bc2e-58859c1d9e34"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:50.512343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.516777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.517731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.546956 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] Creating event network-vif-deleted:7e9671fe-e420-4d77-bc2e-58859c1d9e34 for instance 9c6bd581-993f-4a0d-97dd-164a80024531 on n-h1-851029-13 Oct 04 21:11:50.578311 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-76a4301c-0e28-4dc8-82a7-0e89a90e415b req-70549a0d-1792-4162-869a-42bba1c0e61d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097964 Oct 04 21:11:50.580060 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2164/4380] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:50.595312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:50.596971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:50.617744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.619306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.620461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.621882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.622960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.623771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:51.593030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.618748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.623541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.626566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28ca3ebe-f5d8-4071-acd7-4d04f5db158f tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 1.041379 Oct 04 21:11:51.630938 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2165/4381] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:50 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:51.640008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:51.646216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:51.680278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:51.681798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:51.683908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:51.687826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:51.689228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:51.690704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:51.797155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.826553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.831291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:51.834143 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd64ecfa-9970-4b22-9155-0524edb31308 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 2.118242 Oct 04 21:11:51.835879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2217/4382] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:49 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:51.846323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:51.848021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:51.864693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:51.866456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:51.871443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:51.874272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:51.876588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:51.878252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:52.436012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:52.473062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-026844a8-c3e1-4b37-8d9c-8c9f9d0dedea tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.839894 Oct 04 21:11:52.478630 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2166/4383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:51 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:52.536067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:52.543240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:52.545789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:52.569747 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50607065-170f-4d1b-85e5-3df34f92c9e0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1517 microversion: 2.1 time: 0.730948 Oct 04 21:11:52.577013 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2218/4384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:51 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1517 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:52.587540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:52.594852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:52.596302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:52.609117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:52.616665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:52.617500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:52.618288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:52.621902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:52.629554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:52.633499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:52.635847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:52.636242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:52.637502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:52.644477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:52.644477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:53.549396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:53.629360 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67743db1-b008-49a9-a074-ca33dda3e3a2 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 1.050280 Oct 04 21:11:53.683975 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2219/4385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:52 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:53.705725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:53.709722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:53.753508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:53.754332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:53.761202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:53.762586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:53.775192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:53.776742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:53.880311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:53.922943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c9b0d5c-babd-4147-832a-609076fb0c48 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.434241 Oct 04 21:11:53.955595 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2167/4386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:52 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:53.970397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:53.971684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:53.999493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.001184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.008511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:54.013548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.019541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.021189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:54.277457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:54.303357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:54.308906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:54.312835 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-029180d3-1e42-47ba-92ea-0b0a62b0d477 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.626855 Oct 04 21:11:54.315414 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2220/4387] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:53 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:54.328939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:54.332445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:54.351074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.352847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.354245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:54.357147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:54.359215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:54.360870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.459538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:55.508332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:55.517400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:55.523518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1962d5d4-c07a-4271-8e3f-5e88f1e537a4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.563286 Oct 04 21:11:55.535600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2168/4388] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:53 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:55.570252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:55.604333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:55.605764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:55.607630 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6e0fea3-adbf-4c25-94bf-96e441603842 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1517 microversion: 2.1 time: 1.289534 Oct 04 21:11:55.613370 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2221/4389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:54 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1517 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:55.620297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.621731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.622909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.625006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.626301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.627471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.639637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:55.645791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:55.690882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:55.721467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lazy-loading 'flavor' on Instance uuid 320290b7-8047-476b-b477-7fdd6f02ad67 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:56.492575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15a7b529-a8b4-438b-8d68-b45bf6732cce tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.950209 Oct 04 21:11:56.507909 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2169/4390] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:55 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:56.532899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:56.536633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:56.600198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:56.601703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:56.603382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:56.613147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:56.615023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:56.616279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:56.841672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:56.880450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bf23136-1452-4f3c-a8cb-24066fb275dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.253279 Oct 04 21:11:56.884378 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2222/4391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:55 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:56.906955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:56.917378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:56.942063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:56.943391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:56.944491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:56.946120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:56.951945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:56.953197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:56.996495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:57.051543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:57.063497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:57.065890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2aefddb0-74f5-424b-8dcb-1c16c7534f69 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.553149 Oct 04 21:11:57.092851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2170/4392] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:56 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:57.144114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:57.145423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:57.163966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:57.165442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:57.166261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:57.167484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:57.168244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:57.168975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:58.526352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:58.601750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:58.617373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:58.622716 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9dfec6c9-920b-4cc8-aa26-64613f3cd661 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.527932 Oct 04 21:11:58.641332 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2171/4393] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:11:57 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:11:58.720616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:58.722458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:58.746456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.751802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.759420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:58.761707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.764361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.770963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:58.781098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:58.824238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c03ff318-2a3c-4110-b474-0d3d0cfe9f40 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1676 microversion: 2.1 time: 1.936877 Oct 04 21:11:58.843398 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2223/4394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:56 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1676 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:58.862183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:58.880549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:58.925813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.932600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.936445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:58.942612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:58.946219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:58.948271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.343643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.365026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.388271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a972d40-88a5-4b86-8d1c-5279003720e8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1523 microversion: 2.1 time: 1.744777 Oct 04 21:12:00.389812 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2172/4395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:58 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1523 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:00.397370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d98de37a-a3f9-43c4-a4cf-a1b1f4a6d96b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.551220 Oct 04 21:12:00.409373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2224/4396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:58 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:00.412577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:00.415304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:00.441299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:00.442481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:00.443640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.447751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:00.457416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:00.458938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.468632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9fd99-af7d-4647-b7ec-e53ba426cbc6", "name": "network-vif-unplugged", "status": "completed", "tag": "4ca160fc-3f68-45f1-a9df-b844e2107b19"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:00.521056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:00.524355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:00.528513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.654531 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] Creating event network-vif-unplugged:4ca160fc-3f68-45f1-a9df-b844e2107b19 for instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 on n-h1-851029-13 Oct 04 21:12:00.691287 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-22361104-de60-4ce4-a157-ca58ee2f7a59 req-56f19dfd-e41f-4586-a4aa-e6d9739a2354 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.279393 Oct 04 21:12:00.700675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2225/4397] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:00.720584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:00.722706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:00.740889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:00.746972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:00.746972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.746972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:00.746972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:00.748884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:00.933199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.982539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.991805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:00.999706 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e256b9d4-3fb4-46ac-8de1-4fb562ab6ce6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.605245 Oct 04 21:12:01.003172 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2173/4398] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:00 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:01.027116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:01.037687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:01.074615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:01.077685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:01.082558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:01.089090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:01.089090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:01.097997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.358936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:02.390098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:02.408645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:02.427853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b8f64d2-947c-4111-a6cb-e2e06f1b378d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1659 microversion: 2.1 time: 1.414009 Oct 04 21:12:02.433703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:02.438828 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2174/4399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:01 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1659 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:02.446763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:02.456084 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e27beec-46cd-406f-a052-b74428a27032 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.751643 Oct 04 21:12:02.476165 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2226/4400] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:00 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:02.489749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9280ab-caba-4649-aa61-443e4db87c66", "tag": "fe247625-b2cf-4939-9252-bdf93fb19961"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:02.523666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:02.524812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:02.552856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.553842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.560789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.562989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.563800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.564507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.568168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.571022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.580021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.619778 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] Creating event network-changed:fe247625-b2cf-4939-9252-bdf93fb19961 for instance ac9280ab-caba-4649-aa61-443e4db87c66 on n-h1-851029-13 Oct 04 21:12:02.638431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-85c21b77-3bb4-4ed4-9192-4e4effa47081 req-01a8a1e6-6769-439c-a9d4-324ab9cd6fe4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193696 Oct 04 21:12:02.641069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2175/4401] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:02.657312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:02.661309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:02.681074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.685505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.686153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:02.688309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:02.691495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:02.693224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.104404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.123102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.158499 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-acd92f5e-235d-4a71-b0ea-effc0c43b52e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.680347 Oct 04 21:12:04.161270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3e1f238-13a2-485a-b496-edb33dfed0a7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1523 microversion: 2.1 time: 1.517490 Oct 04 21:12:04.163444 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2227/4402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:02 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:04.171490 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2176/4403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:02 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1523 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:04.184124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:04.194313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:04.195578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.199181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.220640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.226930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.227380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.229477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.232830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.235637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.236750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.239641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.240789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.242421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.244470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.245877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.360880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:04.482455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.507060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.511384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:04.515977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-254c2c09-4d9b-4dd2-9735-c5f75a9bc366 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.345530 Oct 04 21:12:04.528146 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2228/4404] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:04 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:04.558363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:04.565366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.577401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.578755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.584701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.584701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.584701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.585444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.682019 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f09f60aa-1ce1-4a71-9ee7-4d910ce4f025 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action" status: 202 len: 0 microversion: 2.1 time: 0.507387 Oct 04 21:12:04.688192 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2177/4405] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:04 2022] POST /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:04.721931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:04.727677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:04.754533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.758752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.763695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:04.769477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:04.773377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:04.774137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.332049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:05.355254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:05.358979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:05.362015 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcf5a570-9e0f-49d5-b31e-108ac6f792e9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 0.816180 Oct 04 21:12:05.364069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2229/4406] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:04 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:05.374238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9fd99-af7d-4647-b7ec-e53ba426cbc6", "name": "network-vif-plugged", "status": "completed", "tag": "4ca160fc-3f68-45f1-a9df-b844e2107b19"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:05.398103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.399517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.400762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.427723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] Creating event network-vif-plugged:4ca160fc-3f68-45f1-a9df-b844e2107b19 for instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 on n-h1-851029-13 Oct 04 21:12:05.439668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-77344729-97cf-455a-a908-3d52c5061d73 req-8d8d9502-1ab9-4341-9cbc-6478542aa7ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072736 Oct 04 21:12:05.441861 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2230/4407] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:05.458489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.460080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:05.472545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.473936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.475145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.476521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.477429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.478167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.674351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:05.710168 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04a9398a-cf4f-4729-bfe2-7fda9f6f4d2f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1665 microversion: 2.1 time: 1.015447 Oct 04 21:12:05.716504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2178/4408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:04 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1665 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:05.733023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.735288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:05.748021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.749205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.750064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.751318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.752028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.752669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.321633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.357175 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71b51d9e-8a68-4cb6-9ea7-e52445dffaca tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1523 microversion: 2.1 time: 0.909980 Oct 04 21:12:06.361234 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2231/4409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:05 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1523 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:06.404361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:06.408152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:06.434583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.435765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.437424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.439592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.453348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.454373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.624341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.658339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0ff44c9-523a-4bcc-bcf1-60c32d2b96ee tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 0.938583 Oct 04 21:12:06.662768 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2179/4410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:05 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:06.691098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:06.693217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:06.711942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.722564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.723551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.724937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.725866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.726625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.734477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.764714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.776358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.779024 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66e165d9-7597-4744-ae44-b9edfe2f8d62 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.409426 Oct 04 21:12:06.780229 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2232/4411] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:06 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:07.348807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3bdecdb4-7aaa-4010-b71a-d729a00feead tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Action: 'create', calling method: .version_select at 0x7f54f55b0b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-902061338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmGhUBlSPEGG9s8kfKdRa/UdHb46/Xl4qEzgdKlJHWB0dXFWogS3rLaB8krRwi9X2792BGeNZq3KNQYs0c6kBMEaTCuymZbJO1pIf1cYun9WC5UuQROd3WWXG9K3jObnA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:07.387303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3bdecdb4-7aaa-4010-b71a-d729a00feead tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:07.558254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:07.558482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3bdecdb4-7aaa-4010-b71a-d729a00feead tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for user e74b98e16c47438eb09af538c57f4e6b and project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4fa858f-d3b1-42d5-8411-ccdef12b0468 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 0.768969 Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2180/4412] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:06 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.558689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.812063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3bdecdb4-7aaa-4010-b71a-d729a00feead tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.030010 Oct 04 21:12:07.828122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2233/4413] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:12:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:07.843276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.844382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:07.903885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.904948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.910405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.914826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.918331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.919749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.397715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:08.449305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afeb031d-8de7-43cd-9e4b-b43f71d1cdef tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1665 microversion: 2.1 time: 0.997897 Oct 04 21:12:08.457909 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2181/4414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1665 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.494449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:08.498775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:08.524950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.526636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.527650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.531974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.535299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.535931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.146643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:09.200185 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd7aab75-bbc8-434a-b28c-22325e1e448b tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1523 microversion: 2.1 time: 1.371253 Oct 04 21:12:09.214779 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2234/4415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1523 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:09.234889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.234889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:09.263636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.264606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.269064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.277144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.277738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.278481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.457165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:09.491218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1ea1d5f-e6ee-4f65-9d8a-5d1a8a50249b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.026427 Oct 04 21:12:09.496333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2182/4416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:08 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:09.511303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:09.556080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:09.560153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:09.571431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be67fcf5-16cc-45c5-8333-d6b3b11be093 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.365031 Oct 04 21:12:09.573575 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2235/4417] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:09 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:09.610271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.612225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:09.644146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.645667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.647519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.654375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.656120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.657499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.828651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.834944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:09.846947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.848460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.849866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.851625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.852754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.853956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.324965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.340243 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-14146a96-7036-4421-ba0f-44048c59d89a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.756805 Oct 04 21:12:10.356353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2236/4418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:09 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:10.380508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.383156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:10.391470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:10.410835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.412071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.413336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.415109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.416856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.418203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.512459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.559564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.570139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:10.578131 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f33d5473-945d-4e59-b8a3-586080281eef tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.075318 Oct 04 21:12:10.582841 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2183/4419] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:09 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:10.613835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:10.615238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:10.636427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=68 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:10.642493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.643946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.646416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:10.649549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:10.651490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:10.653161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.406227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:11.440115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:11.470610 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9500a0bc-7371-4cb2-a38c-53c4c802ec52 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1668 microversion: 2.1 time: 0.883629 Oct 04 21:12:11.473598 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dac9571a-e596-4e16-9886-7d7064dbc530 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1508 microversion: 2.1 time: 1.115154 Oct 04 21:12:11.490545 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2184/4420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1668 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:11.499548 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2237/4421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:10 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1508 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:11.513893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:11.519341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:11.521068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:11.535808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:11.544875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.546602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.548086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.551294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.552923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.558171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.609285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.616496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.617402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.618798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.620116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.620773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.787612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:11.816689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:11.826222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:11.829490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-985ca790-fc11-4565-80f7-d715fe1701e6 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.327419 Oct 04 21:12:11.851437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2238/4422] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:11 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:11.899263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:11.901445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:11.917185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.918784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.921496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:11.924780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:11.926168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:11.929826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.369861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:12.409101 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bac04676-f386-4a39-a0c5-ba509d94c20d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 0.921834 Oct 04 21:12:12.449392 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2185/4423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:11 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:12.461397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:12.462346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:12.478831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.479693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.480466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.483022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.491327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.496234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.540041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:12.567817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:12.604807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Working on deleting snapshot 95561409-3ce8-44f8-a87a-848bd6ee1003 from shelved instance... Oct 04 21:12:12.612449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b505044-28e9-4705-acf4-f2dd870ac92e tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 200 len: 1508 microversion: 2.1 time: 0.734074 Oct 04 21:12:12.614029 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2239/4424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:11 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:12.645855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:12.651753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:12.688108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.689118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.690098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:12.691614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:12.692467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:12.693235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:14.369527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:14.415933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:14.426348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:14.439609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2e887ff-1fac-4a37-af7b-c0a5b0ce27a3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.822438 Oct 04 21:12:14.444611 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2240/4425] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:12 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:14.485391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:14.486269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:14.517761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:14.518629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:14.524483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:14.525186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:14.533166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:14.534655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:14.683798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:15.506267 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c127fd80-aee6-44b9-ba44-ff7c450bf96f tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 204 len: 0 microversion: 2.1 time: 1.044063 Oct 04 21:12:15.533140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2241/4426] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:14 2022] DELETE /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:15.551269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:15.552909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:15.570649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:15.572466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:15.573627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:15.576608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:15.577821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:15.583803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:15.899197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:15.992609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:16.002812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:16.005465 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e48ed524-8da6-4b02-a0ea-d88ba584fa7e tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.467936 Oct 04 21:12:16.026496 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2242/4427] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:15 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:16.060723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:16.061764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:16.081774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.092968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.105184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.110650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.119338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.120250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.193022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:16.669767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Doing local delete in cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) {{(pid=123542) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 21:12:16.671384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.674803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.678908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.679350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 21:12:16.691570 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:12:17.036468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.062858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5e6ae4b-72b5-4fac-bba6-b6d9d231637e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 1.034020 Oct 04 21:12:17.063902 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2243/4428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:16 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.098502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.100511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.126245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.127600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.133973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.136736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.138040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.148095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.434946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:17.703161 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34962. Oct 04 21:12:17.720811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] deallocate_for_instance() {{(pid=123542) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 21:12:19.185831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.220876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.224411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.226892 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f221e7e0-582c-456b-8055-3e541027c450 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 2.161175 Oct 04 21:12:19.239185 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2244/4429] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:19.260917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-109586231", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a6cd9541-a599-4f3f-94c5-fad267f72e3d"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:19.497019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] validate_networks() for [('a6cd9541-a599-4f3f-94c5-fad267f72e3d', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:23.490273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:23.492675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:23.494689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:23.496241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:23.497258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:23.529842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.536721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.538390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:23.548001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.549361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.550896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:23.609900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Updating instance_info_cache with network_info: [] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:12:23.638319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:23.676916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Getting quotas for user 70725c9735414d649b11fd73576174f0 and project ae0b818c66f54a438cc0e6cd0d6dd69d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:23.746008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:23.753614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:24.098742 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-edfa696e-be41-415a-9822-a0525de5f0e7 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.851671 Oct 04 21:12:24.108024 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2245/4430] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:24.138743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9280ab-caba-4649-aa61-443e4db87c66", "name": "network-vif-plugged", "status": "completed", "tag": "fe247625-b2cf-4939-9252-bdf93fb19961"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:24.196762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.198947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.200025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.292056 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] Creating event network-vif-plugged:fe247625-b2cf-4939-9252-bdf93fb19961 for instance ac9280ab-caba-4649-aa61-443e4db87c66 on n-h1-851029-13 Oct 04 21:12:24.313885 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0efe709e-fdb9-492b-8949-209d81805a24 req-b3329302-72e0-4c4e-8bf1-521b2a7d0bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202785 Oct 04 21:12:24.320735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2246/4431] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:24.387722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:24.398186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:24.457000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.458613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.462004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.465059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.469408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.473663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.126426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.158902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.172390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.178179 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5a789dc-2f9b-4596-80b2-6c4249342007 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.836043 Oct 04 21:12:25.179999 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2247/4432] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:24 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:25.193729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.215102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.240112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.241538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.243786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.245591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.247890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.249032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.839371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.872633 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60ce4bc4-041e-4321-adad-70d1c31d6535 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 0.689893 Oct 04 21:12:25.876539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2248/4433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:25.900991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a454d77-dea0-492e-98b3-b0c3225d6112 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 204 len: 0 microversion: 2.1 time: 13.449069 Oct 04 21:12:25.920024 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2186/4434] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:12 2022] DELETE /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 0 bytes in 13470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:25.941443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea66a1f-1c46-4451-83a6-5c8bd7c50d03", "name": "network-vif-deleted", "tag": "2cf67303-c10a-4139-856c-d79d4f70b25e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:25.958079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.961944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.996192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.997269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.004928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.005784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.006114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.006909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.007768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.008904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.010985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.059659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:26.077023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.server_external_events [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] Unable to find a host for instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03. Dropping event network-vif-deleted {{(pid=123542) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:12:26.080919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-197fea51-d834-473b-b09a-fddec2bbdfe2 req-8f9be406-0268-497f-89e9-44d53a2a4d80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.158495 Oct 04 21:12:26.083146 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2187/4435] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 162 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 21:12:26.094232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af1cb7e2-ea48-40d0-8893-d31ee64c208a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.104613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af1cb7e2-ea48-40d0-8893-d31ee64c208a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.525158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af1cb7e2-ea48-40d0-8893-d31ee64c208a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.580790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af1cb7e2-ea48-40d0-8893-d31ee64c208a tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1217 microversion: 2.1 time: 0.495221 Oct 04 21:12:26.607918 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2188/4436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1217 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.648528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.649761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.718489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.718489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.725360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.726924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.727760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.729064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.848182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 HTTP/1.1 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8ea66a1f-1c46-4451-83a6-5c8bd7c50d03'} Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:26.852240 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 404 to user: Instance 8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:26.861017 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93933293-fc14-4878-b294-7f6a9686ad2e tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03" status: 404 len: 111 microversion: 2.1 time: 0.253245 Oct 04 21:12:26.874770 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2189/4437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/8ea66a1f-1c46-4451-83a6-5c8bd7c50d03 => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:26.887254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.892607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.903978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.904975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.905659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.907148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.907981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.909351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.001979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.069033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.074588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.077616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5948392-841c-4b60-9f5c-b4fc07f54f02 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.156438 Oct 04 21:12:27.079248 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2249/4438] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:27.093880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.104100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.128978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.136757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.138646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.140063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.141629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.142693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.143862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.158652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.162121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.165974 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25cb6eeb-85e9-4ed4-9cac-38bcbab89f81 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.293777 Oct 04 21:12:27.168151 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2190/4439] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:27.183182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.185546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.199670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.201124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.202367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.204080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.205199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.218898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.255530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:27.905436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a076bffe-6b8b-43bb-a2d7-10c01ae6dd22 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 204 len: 0 microversion: 2.1 time: 0.823223 Oct 04 21:12:27.920148 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2250/4440] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:27 2022] DELETE /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:27.950867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.971238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.972802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.981027 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5847ba3e-7c95-4ea1-9c27-e563df4b3d39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1320 microversion: 2.1 time: 0.810520 Oct 04 21:12:27.982334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2191/4441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1320 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.986147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.990545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.996201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.999602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.999602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.004098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.007102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.017563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.045243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.046163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.047021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.048503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.049413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.050227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.472240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.492734 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf822e1b-d730-4f0b-b6bf-7fc1014f3cf0 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1221 microversion: 2.1 time: 0.569071 Oct 04 21:12:28.494320 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2251/4442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1221 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:28.504512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.506263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.534495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.537071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.538458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.540221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.541525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.543501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.662067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.697642 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c20e3127-774c-4d3b-af81-4e1aed209f04 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1464 microversion: 2.1 time: 0.709713 Oct 04 21:12:28.700873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2192/4443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1464 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:28.728732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.741673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.785746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.791964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.792884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.797328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.798477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.799156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.214170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.246381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.252038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.257498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad8aa15e-6289-41dd-8277-64cc1134eb99 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1605 microversion: 2.32 time: 0.552429 Oct 04 21:12:29.272850 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2193/4444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1605 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:29.323209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d9fd99-af7d-4647-b7ec-e53ba426cbc6", "name": "network-vif-deleted", "tag": "4ca160fc-3f68-45f1-a9df-b844e2107b19"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:29.344708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.346142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.347534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.383702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] Creating event network-vif-deleted:4ca160fc-3f68-45f1-a9df-b844e2107b19 for instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 on n-h1-851029-13 Oct 04 21:12:29.414467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-22808417-b2c4-4677-a93f-8cb5a0c18cea req-f027a41b-c686-409a-847d-09a77325868f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133746 Oct 04 21:12:29.418597 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2194/4445] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:29.451062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.452434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.480210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.481026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.481853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.483269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.496184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.497071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.868916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.902283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.906770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.910162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51233acb-464d-4c7c-80aa-f0293a4bd64e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.412640 Oct 04 21:12:29.912539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2252/4446] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:29.959567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.963096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.976523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.977901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.979727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.983640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.984978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.986144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.471442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:30.567040 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23c56209-67da-4e62-ba39-cda1d88f2f27 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1269 microversion: 2.1 time: 0.633041 Oct 04 21:12:30.576236 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2253/4447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1269 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.614353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.623538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.645868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.647518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.651058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.658877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.660939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.662158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.085819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.124142 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f4a959c-1eec-4fa8-ae8c-81dfea90e8dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1501 microversion: 2.1 time: 1.683665 Oct 04 21:12:31.124142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2195/4448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1501 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:31.132919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.140362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.157506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.159050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.160311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.161996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.163292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.164508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.237237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.273241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.275241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.276080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.277578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lazy-loading 'fault' on Instance uuid 9c6bd581-993f-4a0d-97dd-164a80024531 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:31.309293 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9903c0fa-a93f-48da-93bf-2230cbac6ce0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 200 len: 1464 microversion: 2.1 time: 0.726378 Oct 04 21:12:31.311348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2254/4449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 1464 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:31.345865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.350450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.378419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.379708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.380569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.382035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.383022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.402595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.648536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.738282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.745865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54629f088e814651848b12e062e43bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0c06001b84804be084b0af17a69b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.750362 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d75d4015-abb7-4cf9-a79e-e0e423610094 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 200 len: 1610 microversion: 2.32 time: 0.624839 Oct 04 21:12:31.830073 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2196/4450] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 1610 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:31.865180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:31.866727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:31.908842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.914493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.914493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:31.919143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:31.920642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:31.922080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:33.580333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:33.720500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:34.838051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:34.884955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:34.890021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:34.892144 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2f30a79-a9c3-46bc-82c8-1da0d3b8bcd5 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 3.577967 Oct 04 21:12:34.893962 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2255/4451] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 3582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:34.931964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:34.931964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:34.937292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.939653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.940890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:34.942578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:34.943809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:34.944906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.256607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.281487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:35.281883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f7d9451-ce72-4a95-926f-54a72733ffd8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1501 microversion: 2.1 time: 3.443827 Oct 04 21:12:35.318749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d4fc184-e38f-4a5a-a72e-0957a660f0f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1275 microversion: 2.1 time: 0.402457 Oct 04 21:12:35.319953 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2197/4452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:31 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1501 bytes in 3483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.334903 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2256/4453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:34 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1275 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:35.348803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbf8f6f-595f-46aa-b46e-81a698bbc064", "name": "network-vif-deleted", "tag": "f629d667-e230-4aaf-b567-a1f05d951cd5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:35.361247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.363212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 9cbf8f6f-595f-46aa-b46e-81a698bbc064] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.388589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.389879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.391363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.401409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.401409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.406713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.412195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.412195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.418267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] Creating event network-vif-deleted:f629d667-e230-4aaf-b567-a1f05d951cd5 for instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 on n-h2-851029-13 Oct 04 21:12:35.432841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.433354 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6b1426e8-fc9c-4971-82b1-2249c6f771a6 req-252324c1-aa6d-4638-8dc3-c0ad8d73ca6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107796 Oct 04 21:12:35.437502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2198/4454] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:35.464157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.465707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.481182 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 HTTP/1.1 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9cbf8f6f-595f-46aa-b46e-81a698bbc064'} Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:35.484800 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. Oct 04 21:12:35.497851 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.506191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.506355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 404 to user: Instance 9cbf8f6f-595f-46aa-b46e-81a698bbc064 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:35.506355 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-790fd8c8-e34c-4974-ad7e-6c78ee00fca1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064" status: 404 len: 111 microversion: 2.1 time: 0.156797 Oct 04 21:12:35.506638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.506638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.506638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.507089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2257/4455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/9cbf8f6f-595f-46aa-b46e-81a698bbc064 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:35.507226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.507826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.537786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.541674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.574883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] HTTP exception thrown: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Request method failure captured: Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 HTTP/1.1 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ63yXLJ4AifGkhfKPu0JLoXCwwBDTqSAwgh_nmSMD77QZvFyW9RzFDRo-WlPyrhbgB-gRvIkRYhgalr9DjcnHuC2q9arrCVBBAbhanHSriY96VpjHAbxPo6SmD9b7Dc4v0zLD_rXgfv56mIyh4Eb0_tP_j_2G0FkiWfMnXXTnMchlg Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_87b0c06001b84804be084b0af17a69b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 54629f088e814651848b12e062e43bc6 Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9c6bd581-993f-4a0d-97dd-164a80024531'} Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.581845 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:12:35.596572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Returning 404 to user: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:35.600969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80175421-7c93-4b87-8df0-81197b27550a tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 404 len: 111 microversion: 2.32 time: 0.150194 Oct 04 21:12:35.608551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2199/4456] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:35 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:12:35.618883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.621074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.622276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.627654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.628761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.633976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.635839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:35.637117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:35.657209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.662411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.663794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.668160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:35.671787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:35.674383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:35.750492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:35.752260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:36.169508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:36.606988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:36.645539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4224ae01-16cb-4a46-b826-c52a7368f0fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 204 len: 0 microversion: 2.1 time: 1.142907 Oct 04 21:12:36.652747 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2258/4457] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:35 2022] DELETE /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:36.658435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0010f52e-0e06-4903-95c7-9ceeea9af504 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '.version_select at 0x7f54f5f368b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.714344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58c5fdfd-b9f1-45a2-9a7e-f730345bd27a tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 204 len: 0 microversion: 2.1 time: 1.103074 Oct 04 21:12:36.721254 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2200/4458] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:35 2022] DELETE /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 0 bytes in 1107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:36.732188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.734240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.755764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.757279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.758569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.760960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.762180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.763840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.826096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0010f52e-0e06-4903-95c7-9ceeea9af504 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003543347" status: 204 len: 0 microversion: 2.32 time: 0.176272 Oct 04 21:12:36.829675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2259/4459] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 21:12:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003543347 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:12:36.842469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:36.844775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:36.868053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.870059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.875840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:36.875840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:36.875840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:36.880126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.112795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:37.136396 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd871660-03c4-4e64-a80c-de2a59fbdcbd tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1275 microversion: 2.1 time: 0.304293 Oct 04 21:12:37.139296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2260/4460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:37.151277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:37.152949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:37.183342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.186166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.187702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:37.189829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:37.191562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:37.193384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.488679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.510436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.514789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:38.517695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1cfa507d-5b11-4811-b0f8-cf2f4f098551 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.793552 Oct 04 21:12:38.535462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2201/4461] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:36 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:38.567970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:38.569181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:38.594153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:39.085008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.107856 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2fdd027-8246-4c13-837f-0267537d156a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1507 microversion: 2.1 time: 1.965662 Oct 04 21:12:39.111984 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2261/4462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:37 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1507 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:39.137986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:39.140444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:39.159435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:39.169197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:39.169197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:39.169197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:39.169197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:39.169197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:39.943178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:39.971135 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c45f6f06-738f-46a8-abae-48098acaea0f tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1507 microversion: 2.1 time: 1.433001 Oct 04 21:12:39.980467 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2202/4463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:38 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1507 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:40.011819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "448f9e2e-3a37-4d83-bb3c-2ce30b40640b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:40.046407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.049462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.049462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.124664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] Creating event network-vif-plugged:448f9e2e-3a37-4d83-bb3c-2ce30b40640b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:40.143821 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-feb166ce-a06b-4fdf-a5ce-d29e589b5b84 req-0aab106f-e1f1-45e4-b441-86a507cfff57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159544 Oct 04 21:12:40.151041 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2203/4464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:40.171306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:40.207680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:40.224238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.225296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.226148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:40.228398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:40.229667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:40.230508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.186327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:41.219175 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53cc1331-76c2-4e33-990d-73f284e7ccd4 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 2.102350 Oct 04 21:12:41.220101 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2262/4465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:39 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:41.264607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:41.265798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:41.271934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:41.294766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.296019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.296651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:41.297451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:41.298243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:41.299405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:42.736171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.776384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.782150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.784635 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-397c1320-fb30-4cf1-a2b8-142281d4ceac tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 2.630033 Oct 04 21:12:42.785746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2204/4466] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:40 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:42.851660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1136592078-access_point-1053136126", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "6a3cb3a8-b4be-42ee-97a8-59d6349826e0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-902061338", "security_groups": [{"name": "tempest-secgroup_access--1511503961"}, {"name": "tempest-secgroup_general--57011307"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:42.863602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:42.944091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:42.963730 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a4bf73f-6751-46db-9d0e-6845edee02b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 200 len: 1507 microversion: 2.1 time: 1.730771 Oct 04 21:12:42.987618 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2263/4467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:41 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 1507 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:43.027691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:43.029481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:43.045290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.053271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.053271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.053271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:43.053271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:43.053271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:43.966454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] validate_networks() for [('6a3cb3a8-b4be-42ee-97a8-59d6349826e0', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:43.993087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:44.034308 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8212871d-a4c1-4ea2-84d1-9b1f496adc23 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1507 microversion: 2.1 time: 1.044157 Oct 04 21:12:44.035595 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2264/4468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:42 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1507 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:44.049277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:44.054873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:44.087867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.093581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.094815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:44.106692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:44.108049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:44.109175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:45.932984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:45.972863 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb8a3899-cb34-44ad-a525-82258e40dfe9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 1.929687 Oct 04 21:12:45.975532 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2265/4469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:44 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:46.003995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "f0255488-6f0e-47ee-99d3-249d39b64c02"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:46.038726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.053241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.055978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.117482 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] Creating event network-vif-plugged:f0255488-6f0e-47ee-99d3-249d39b64c02 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:46.148627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e9f0df10-c746-46d6-9533-5e5937c614ea req-3cba7985-d2aa-4939-830e-bea28f2c4c19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161633 Oct 04 21:12:46.150350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2266/4470] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:46.181767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9280ab-caba-4649-aa61-443e4db87c66", "name": "network-vif-deleted", "tag": "fe247625-b2cf-4939-9252-bdf93fb19961"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:46.252963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.256429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.273562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.342878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] Creating event network-vif-deleted:fe247625-b2cf-4939-9252-bdf93fb19961 for instance ac9280ab-caba-4649-aa61-443e4db87c66 on n-h1-851029-13 Oct 04 21:12:46.373453 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-36938bae-20e3-4d79-b167-590b8a2006ae req-60dc6d7b-609c-4e0d-be88-c2632d98f7a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216608 Oct 04 21:12:46.375825 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2267/4471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:46.415827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.418292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.466735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.472391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.477029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.481621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.500491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.503025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.654964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.687438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.711194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.720638 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5db7bd6d-bc6a-4e7a-80df-0a5d80f00d8a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.335728 Oct 04 21:12:47.720638 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2268/4472] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:47.733034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.734974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.754592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.757481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.759406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.762632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.763921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.765095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.810441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 HTTP/1.1 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ac9280ab-caba-4649-aa61-443e4db87c66'} Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:47.815157 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:12:47.822938 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:47.824589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:47.831647 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6aa58333-90b3-4794-8f88-c3da8491c638 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 404 len: 111 microversion: 2.1 time: 0.105753 Oct 04 21:12:47.833398 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2269/4473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:47.855563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.858239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.875678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.877238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.879023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.880928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.882964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.884867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.997835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.003823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.006220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.009449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lazy-loading 'fault' on Instance uuid 42ba3572-1d9f-40b8-940e-e75ac39a0f02 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:48.033427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:48.035175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:48.036282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:48.037334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:48.038358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:48.077885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.083718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.087795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.089565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.093461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.094719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.152165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:48.162928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for user e74b98e16c47438eb09af538c57f4e6b and project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:48.203616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:48.231992 n-d-851029-13 devstack@n-api.service[123542]: WARNING nova.utils [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1136592078-access_point-1053136126 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1136592078-ac Oct 04 21:12:48.233841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:48.302681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.332219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46cbc7a4-d283-41ee-90a3-3cc7b5fe1142 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 200 len: 1304 microversion: 2.1 time: 0.494647 Oct 04 21:12:48.385767 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2270/4474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 1304 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.417890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.419231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.436272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.437653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.439025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.441921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.444163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.445709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.780664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95800e9c-9ff2-4615-860f-40fcce6ac14c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 5.957833 Oct 04 21:12:48.795634 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2205/4475] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:42 2022] POST /compute/v2.1/servers => generated 456 bytes in 6009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:48.801195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.807638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96d0abd0-fc2b-4e2c-a4e8-d2ea5c312dd5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: .version_select at 0x7f54fa55a160>, body: {"keypair": {"name": "tempest-key-1616265096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6LrkkkZgDrxsg3noRem23xI2oq92FRQVXxvITDrnGiuGmDnrTfbsTtT0RGqjtUY+gClqnx3auHwZKK5C7K+l4phkaXG52BG8/szPLGK2u6sTqCDIDUtgFBeucp878q3Q=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:48.836162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb032fbb-db36-4c59-882b-afdf0425f913 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 0.447275 Oct 04 21:12:48.837697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2271/4476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.877851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ba3572-1d9f-40b8-940e-e75ac39a0f02", "name": "network-vif-deleted", "tag": "a3699fd0-7a98-415b-9d81-f721b7feabeb"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:48.913545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-96d0abd0-fc2b-4e2c-a4e8-d2ea5c312dd5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:48.938963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.940045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.940269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-96d0abd0-fc2b-4e2c-a4e8-d2ea5c312dd5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:48.940964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.024761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] Creating event network-vif-deleted:a3699fd0-7a98-415b-9d81-f721b7feabeb for instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 on n-h1-851029-13 Oct 04 21:12:49.068259 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-723ec899-1a98-4b63-9c41-bb55ec904846 req-f7e20a35-78d8-4659-a775-de7664457550 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216159 Oct 04 21:12:49.068259 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2272/4477] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:49.123678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "e9d8d425-b525-4f9b-a3e6-7eeea44a6954"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:49.198157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.203300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.205680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.226181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96d0abd0-fc2b-4e2c-a4e8-d2ea5c312dd5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.428128 Oct 04 21:12:49.240828 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2206/4478] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:12:48 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:49.261684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] Creating event network-vif-plugged:e9d8d425-b525-4f9b-a3e6-7eeea44a6954 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:49.267052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.268828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:49.291980 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6f9ca21a-1f05-4148-9c8c-2a1f0e59af2a req-7fd953b7-acd1-42c6-af62-7912f1ba0560 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219758 Oct 04 21:12:49.294242 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2273/4479] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:49.303151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.304801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.307364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.312294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.322381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.323988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.331295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e85f5e9c-4666-4e1c-aa02-c86352afcff1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.334745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e85f5e9c-4666-4e1c-aa02-c86352afcff1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:49.947794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e85f5e9c-4666-4e1c-aa02-c86352afcff1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:49.976390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e85f5e9c-4666-4e1c-aa02-c86352afcff1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1294 microversion: 2.1 time: 0.667582 Oct 04 21:12:49.989788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2274/4480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1294 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.999995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f319bfa-2c25-40e4-9dcb-b47a9ee2b243 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '.version_select at 0x7f54f5f4cee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.023436 n-d-851029-13 devstack@n-api.service[123541]: WARNING oslo_db.sqlalchemy.utils [None req-3f319bfa-2c25-40e4-9dcb-b47a9ee2b243 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 21:12:50.037166 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f319bfa-2c25-40e4-9dcb-b47a9ee2b243 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.045084 Oct 04 21:12:50.041637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2275/4481] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:50.097101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.101224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 42ba3572-1d9f-40b8-940e-e75ac39a0f02] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.126580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.135123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.135891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.137182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.138024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.138883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.276466 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 HTTP/1.1 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '42ba3572-1d9f-40b8-940e-e75ac39a0f02'} Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:50.290714 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. Oct 04 21:12:50.300291 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:12:50.305067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 404 to user: Instance 42ba3572-1d9f-40b8-940e-e75ac39a0f02 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:50.314160 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1324c84c-3a7a-4d00-ab54-7c33bb085149 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02" status: 404 len: 111 microversion: 2.1 time: 0.265101 Oct 04 21:12:50.319799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2276/4482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:50 2022] GET /compute/v2.1/servers/42ba3572-1d9f-40b8-940e-e75ac39a0f02 => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:50.353964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.360571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.395549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.398429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.410146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.410978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.412522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.416912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.564646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.663520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.667503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.690049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db1b4562-439d-4e26-a477-da455314b360 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.436080 Oct 04 21:12:50.707285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2207/4483] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:50.738163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:50.741738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:50.753890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.755243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.756363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.758971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.760489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.761797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.834119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:50.840165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:51.492636 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-357ad54a-3667-4cc0-b64c-2de3fe228a6b tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 204 len: 0 microversion: 2.1 time: 0.792681 Oct 04 21:12:51.495524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2208/4484] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:50 2022] DELETE /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:51.517468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1930669740", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-key-1616265096", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:51.718484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:52.724293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:52.748081 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3e94095-a9dd-4bb8-ab7d-68d6676bdcda tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 2.425393 Oct 04 21:12:52.767173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2277/4485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:50 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:52.772735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:52.774266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.788548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.790038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.791661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.793423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.795078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.796327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.301545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.328417 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8cab361-a520-4112-8d6b-eb66b93a218a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1290 microversion: 2.1 time: 0.563193 Oct 04 21:12:53.335297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2278/4486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:52 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1290 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:53.349908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "588e2193-ead0-4de7-90ec-074b16313c3e", "tag": "2b1dc33e-52d6-482f-beb0-3dcfd705663c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:53.381113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.382024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.382935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.443541 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] Creating event network-changed:2b1dc33e-52d6-482f-beb0-3dcfd705663c for instance 588e2193-ead0-4de7-90ec-074b16313c3e on n-h1-851029-13 Oct 04 21:12:53.457837 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2c7d3a4f-df3f-45a3-8c64-248dcfed625b req-e0617b02-74bd-43cb-94ef-5a8fdf22631b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120223 Oct 04 21:12:53.468122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2279/4487] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:53.486385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "0e5e760a-f01f-4572-83ba-c4b920e8ea69"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:53.537107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.538247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.539138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.573571 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] Creating event network-vif-plugged:0e5e760a-f01f-4572-83ba-c4b920e8ea69 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:53.608657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-46b5b590-9f11-40ad-90db-01c780887838 req-47616534-daf3-48eb-bbb7-d00b5f54dd7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137928 Oct 04 21:12:53.615138 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2280/4488] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:53.632250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:53.640850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:53.668513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.674590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.693397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.693397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:53.693397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:53.693397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.846860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:55.875926 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a99a55a-d8ef-4250-b637-1cab915e505d tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1494 microversion: 2.1 time: 2.247707 Oct 04 21:12:55.875926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2281/4489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:53 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1494 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:55.879544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.890722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.906736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.908301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.909570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.913800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.916255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.917655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.292935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:56.293750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:56.294895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:56.295845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:56.297220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:56.325090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.325575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.326613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.328142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.328646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.329253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.368428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:56.380394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:56.409721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:56.414982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:56.634884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f9a4e89-31ad-4261-87f7-cb9d6b130b94 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.135882 Oct 04 21:12:56.641989 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2209/4490] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 5145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:56.653595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:56.663692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:56.692655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.692655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.693463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:56.696842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:56.698851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:56.699936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.269677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.321622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.329383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.331861 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1fcb7f4-b831-4e56-af33-82d73b3c24ce tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.459959 Oct 04 21:12:57.344686 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2282/4491] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:12:57.361205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.363581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.400855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.401804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.402633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.405731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.406824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.409391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.497358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.783290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.838634 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-addbeab3-8890-4ceb-910f-caa7f91cf687 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1364 microversion: 2.1 time: 0.481879 Oct 04 21:12:57.843951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2283/4492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.874826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687"}, {"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "70282be4-4cea-436c-b0e0-de05f59122d4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:57.905954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.908558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.909777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.953350 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Creating event network-vif-plugged:fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:57.956012 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] Creating event network-vif-plugged:70282be4-4cea-436c-b0e0-de05f59122d4 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:12:57.973888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9b424754-5ed4-4a6a-8c76-30bf9afc6b50 req-cc43b987-264c-4a94-96bc-642a71d3d570 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122509 Oct 04 21:12:57.976888 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2284/4493] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:57.996963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9eb6e16-6615-43f5-8866-201b4597ec23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.002347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9eb6e16-6615-43f5-8866-201b4597ec23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.225533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9eb6e16-6615-43f5-8866-201b4597ec23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.246407 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9eb6e16-6615-43f5-8866-201b4597ec23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1229 microversion: 2.1 time: 0.264547 Oct 04 21:12:58.262797 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2285/4494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1229 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.265121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.274152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.283270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.283617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.285123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.286350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.286999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.288118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.850834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.881184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77cef272-58bf-4382-b5a0-11727a7acb71 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 2.236868 Oct 04 21:12:58.883458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2210/4495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:56 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.927614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.929858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.951103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.957903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.957903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.957903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.957903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.958583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.150079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:59.199683 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5c9a25e-9710-4327-8b10-2edd7da840cf tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1494 microversion: 2.1 time: 0.948906 Oct 04 21:12:59.200773 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2286/4496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1494 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:59.233267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.237511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.260673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.261604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.262423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.263936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.264860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.265689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.630524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:59.661573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20af8374-d146-471c-a5eb-a96cc76bb5b3 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1352 microversion: 2.1 time: 0.449563 Oct 04 21:12:59.666225 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2287/4497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1352 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:59.679157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:59.682135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:59.697418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.699057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.700345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:59.702124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:59.709219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:59.711076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.132387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.158978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f835a92f-86ce-477f-b856-075169d9bd58 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1225 microversion: 2.1 time: 0.488986 Oct 04 21:13:00.160529 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2288/4498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:59 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1225 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:00.170949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:00.172346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:00.186282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.187258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.188112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.190069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.191170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.192015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.620747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.672862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.686850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:00.695619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3f5b722-a33f-4356-a2d6-81674df3a47c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.783834 Oct 04 21:13:00.697717 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2211/4499] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:00.723884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-plugged", "status": "completed", "tag": "b777036e-9370-4e44-95d2-69377dd05e6b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:00.792516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.794332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.796945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.832098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] Creating event network-vif-plugged:b777036e-9370-4e44-95d2-69377dd05e6b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:13:00.847136 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-91e18163-68f7-4d4e-a244-4427741699fd req-601e78d5-ec88-483d-bbfc-9ad99d0e95f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142418 Oct 04 21:13:00.849677 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2212/4500] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:00.893203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:00.901574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:00.949150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.951313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.952874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:00.955162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:00.957699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:00.960274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.039180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] HTTP exception thrown: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Request method failure captured: Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 HTTP/1.1 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ63yXLJ4AifGkhfKPu0JLoXCwwBDTqSAwgh_nmSMD77QZvFyW9RzFDRo-WlPyrhbgB-gRvIkRYhgalr9DjcnHuC2q9arrCVBBAbhanHSriY96VpjHAbxPo6SmD9b7Dc4v0zLD_rXgfv56mIyh4Eb0_tP_j_2G0FkiWfMnXXTnMchlg Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_87b0c06001b84804be084b0af17a69b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 54629f088e814651848b12e062e43bc6 Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9c6bd581-993f-4a0d-97dd-164a80024531'} Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:01.044183 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Returning 404 to user: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-599ba968-808d-45b8-b456-fb22f700fb01 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 404 len: 111 microversion: 2.32 time: 0.200850 Oct 04 21:13:01.063642 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2213/4501] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:13:00 2022] DELETE /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:01.104218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.105262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.136960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.138112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.138981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.140425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.141308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.142136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.162872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.193172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-354152b9-3c49-4f1f-a125-7dbdd49698aa tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 1.030463 Oct 04 21:13:01.194373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2289/4502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:00 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.222516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45440c2-15dc-464a-b070-9d1731d35752", "name": "network-vif-deleted", "tag": "20357422-2563-4cc4-961b-a43f6370f583"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:01.258784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.260614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.261820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.297090 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] Creating event network-vif-deleted:20357422-2563-4cc4-961b-a43f6370f583 for instance f45440c2-15dc-464a-b070-9d1731d35752 on n-h1-851029-13 Oct 04 21:13:01.309989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.310911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.311770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.312588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lazy-loading 'fault' on Instance uuid f45440c2-15dc-464a-b070-9d1731d35752 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:01.329343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6175c9c5-8122-45e4-9f37-99b71f456597 req-e48a1a6c-b7c9-4551-b6d9-7e85c0ffebca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124138 Oct 04 21:13:01.333023 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2290/4503] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:01.351765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.352424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.377336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.379211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.380530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.385102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.386493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.389510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.732383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.732767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:01.760426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55ce1926-37e9-44b9-9dc2-a28b20bc9d77 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 200 len: 1305 microversion: 2.1 time: 0.697053 Oct 04 21:13:01.764616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2214/4504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 1305 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.784729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.785997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] [instance: 9c6bd581-993f-4a0d-97dd-164a80024531] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.817707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-924dfb38-47fa-49e8-b52c-db0607575048 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1352 microversion: 2.1 time: 0.468239 Oct 04 21:13:01.820775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2291/4505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1352 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.823341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.824525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.831842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.833826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.835034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.839038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.873573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.875497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.899441 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] HTTP exception thrown: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.904044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Request method failure captured: Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 HTTP/1.1 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPJ63yXLJ4AifGkhfKPu0JLoXCwwBDTqSAwgh_nmSMD77QZvFyW9RzFDRo-WlPyrhbgB-gRvIkRYhgalr9DjcnHuC2q9arrCVBBAbhanHSriY96VpjHAbxPo6SmD9b7Dc4v0zLD_rXgfv56mIyh4Eb0_tP_j_2G0FkiWfMnXXTnMchlg Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/87b0c06001b84804be084b0af17a69b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_87b0c06001b84804be084b0af17a69b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 87b0c06001b84804be084b0af17a69b1 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1646466691 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 54629f088e814651848b12e062e43bc6 Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TaggedBootDevicesTest-1646466691-project Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9c6bd581-993f-4a0d-97dd-164a80024531'} Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.905830 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] Returning 404 to user: Instance 9c6bd581-993f-4a0d-97dd-164a80024531 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:01.924871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84862156-f90b-4ba1-9645-5b0848a75296 tempest-TaggedBootDevicesTest-1646466691 tempest-TaggedBootDevicesTest-1646466691-project] 10.222.0.36 "GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531" status: 404 len: 111 microversion: 2.32 time: 0.143054 Oct 04 21:13:01.927645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.927645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.927645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.927645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.927645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.931262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2215/4506] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/9c6bd581-993f-4a0d-97dd-164a80024531 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:13:01.937014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:01.938066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:01.968604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.968604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.968604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.968604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.975969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.976559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.207482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:02.222021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d576c003-22a2-4c70-8226-f90fb6e3e35a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1289 microversion: 2.1 time: 0.375086 Oct 04 21:13:02.223016 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2292/4507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1289 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:02.255960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:02.257350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:02.271272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.272560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.273499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:02.306702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:02.308044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:02.311726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.817210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.819594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.885138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-355ebe6b-0811-41c9-a720-6391678cc9a8 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 1.633355 Oct 04 21:13:03.887182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2293/4508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:02 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:03.892658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.903854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:03.908599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.909836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e8c741c-bd9e-4be1-a12f-c5c02c5bf63f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1880 microversion: 2.42 time: 1.978237 Oct 04 21:13:03.911690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: f45440c2-15dc-464a-b070-9d1731d35752] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.913316 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2216/4509] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:01 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1880 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:03.950517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.955999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.958940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.960099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.961955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.968079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.970282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.975310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.981365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.984012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.985799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.988796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.990166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.995660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.040371 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 HTTP/1.1 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'f45440c2-15dc-464a-b070-9d1731d35752'} Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:04.056274 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. Oct 04 21:13:04.065094 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:04.068364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 404 to user: Instance f45440c2-15dc-464a-b070-9d1731d35752 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:04.070814 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bf5c3f5-dc31-4f51-b9b3-f1f0ab6faf48 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752" status: 404 len: 111 microversion: 2.1 time: 0.181138 Oct 04 21:13:04.072423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2294/4510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/f45440c2-15dc-464a-b070-9d1731d35752 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:04.081942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.083953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.097240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.101111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.103333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.105207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.106213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.107186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.371258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.397211 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd44d975-5819-4c6a-8b49-33510f70f7c4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1352 microversion: 2.1 time: 0.478044 Oct 04 21:13:04.398625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2217/4511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1352 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.408877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588e2193-ead0-4de7-90ec-074b16313c3e", "name": "network-vif-plugged", "status": "completed", "tag": "2b1dc33e-52d6-482f-beb0-3dcfd705663c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:04.428557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.429463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.430572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.458048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] Creating event network-vif-plugged:2b1dc33e-52d6-482f-beb0-3dcfd705663c for instance 588e2193-ead0-4de7-90ec-074b16313c3e on n-h1-851029-13 Oct 04 21:13:04.468750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c90f6d49-4618-4fe2-9c8a-a182dd63f515 req-402dd5ab-dee0-4a5c-9405-594db0993dea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067297 Oct 04 21:13:04.476022 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2218/4512] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:04.486855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.488195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.501307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.503027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.504249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.506219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.507505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.509412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.591989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.598034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:04.628804 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bc90d1a-f330-454f-b16e-09b648c2664b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1287 microversion: 2.1 time: 0.553979 Oct 04 21:13:04.629725 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2295/4513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:04 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1287 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.953091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:04.958590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:04.991263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.993846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.994885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.996595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:04.997530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:04.998348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.237440 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb412298-0ee3-4a31-9a45-90096e9a1ce1 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 204 len: 0 microversion: 2.1 time: 0.757099 Oct 04 21:13:05.245718 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2219/4514] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:04 2022] DELETE /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:05.257752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:05.261127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.277112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.278599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.280244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.282141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.283748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.285038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.925476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:05.951146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5eb325f3-cddf-4a43-9b48-716ce5e954b6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1317 microversion: 2.1 time: 1.009707 Oct 04 21:13:05.952741 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2296/4515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:04 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:05.962000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:05.972296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.976672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.978555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.979656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.981893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.983099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.984422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.166218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.209589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.214276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.217558 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b40ad03e-3853-4d47-8f2a-bfe5d11f4bbc tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2836 microversion: 2.42 time: 0.968509 Oct 04 21:13:06.231284 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2220/4516] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:05 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2836 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:06.293957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:06.296925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:06.354349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:06.357917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.359239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.360338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.362026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.363267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.364349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.420778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:06.974220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.001262 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b8ff774-8f31-4100-b268-8ea432ffe9b6 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1674 microversion: 2.1 time: 1.045846 Oct 04 21:13:07.003782 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2297/4517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:05 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1674 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:07.042732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.046148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.071432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.073184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.075272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.077084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.078189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.080135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.329152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.362053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c0e113c-5259-42b7-834b-ca57f0238b72 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1287 microversion: 2.1 time: 0.345200 Oct 04 21:13:07.364384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2298/4518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1287 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:07.371731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.394603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.399809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.404639 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-868c71bf-c980-4c2f-b86a-02f7658cf57d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.170849 Oct 04 21:13:07.415938 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2221/4519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:06 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:07.430976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.434428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.434428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.434855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.434855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.436329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.438353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.440820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.465143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.468859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.468859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.468859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.468859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.469716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.233586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:08.283804 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7aac051b-babd-4da5-bfe4-ea2cf593d72f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.911724 Oct 04 21:13:08.284867 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2299/4520] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7/os-interface => generated 1829 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:08.306815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:08.309053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:08.350335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.353626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.357152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.361200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.372485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.374702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.647942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:08.684517 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-110633db-701f-4ebd-8b22-2e451d154227 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1506 microversion: 2.1 time: 1.266147 Oct 04 21:13:08.704633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2222/4521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1506 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:08.708214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:08.709261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:08.736786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.738086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.739220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.740819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.741952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.743627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.050130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:09.075093 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db650c00-855e-4bb8-8c3a-74ae667de3f9 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1674 microversion: 2.1 time: 0.787949 Oct 04 21:13:09.076753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2300/4522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:08 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1674 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:09.087825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.088966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:09.104459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.104459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.105821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.107841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.109176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.112278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.171898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:10.204588 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87304a6d-41ee-489d-89d6-f9657d055714 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.125040 Oct 04 21:13:10.206103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2301/4523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:09 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:10.227513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:10.244457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.245542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:10.265983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7eec3c7-345f-4eaf-bc87-32adeb3f0df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 1.572463 Oct 04 21:13:10.270106 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2223/4524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:08 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:10.289698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.293002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.294321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.295505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.304456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.306040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.307173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.316210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:10.344681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.345617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.346457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.347916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:10.371314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:10.373212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.958135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:10.965626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:10.996360 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-acc49aeb-b2d8-43c8-bebd-d2c8bc007476 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1606 microversion: 2.1 time: 0.719585 Oct 04 21:13:11.004534 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2224/4525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:10 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1606 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:11.266596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:11.271448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:11.330882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.657147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:12.735545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8bf450e-3692-4b87-9406-b8353069bfd6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1506 microversion: 2.1 time: 2.527597 Oct 04 21:13:12.760590 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2302/4526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:10 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1506 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:12.776149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:12.781229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:12.807546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.812312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.830415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.830415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.830415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.830415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.911549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:13.859055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:13.909846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41793c1e-3435-44f0-b515-d6fdc45057df tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 2.654134 Oct 04 21:13:13.913474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2225/4527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:11 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:13.934376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320290b7-8047-476b-b477-7fdd6f02ad67", "name": "network-vif-deleted", "tag": "d4cefba1-254d-4f1b-b8ec-c91b9af1300e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:13.967111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.969582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.975805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.015155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] Creating event network-vif-deleted:d4cefba1-254d-4f1b-b8ec-c91b9af1300e for instance 320290b7-8047-476b-b477-7fdd6f02ad67 on n-h2-851029-13 Oct 04 21:13:14.036284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8e8a355d-6d98-4c56-a4b2-8ccf94f1dd87 req-696b05b8-aee2-4795-aeaa-2637c1faf8b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114444 Oct 04 21:13:14.042004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2226/4528] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:14.059826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.062113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:14.066383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:14.091981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.093875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.097068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.104099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.109735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.111413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.301163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.305726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.315154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.319540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lazy-loading 'fault' on Instance uuid 320290b7-8047-476b-b477-7fdd6f02ad67 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:15.321067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f337efc1e76467a887b7a60f89eafff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a38dd3831aa1439990b23b07b81023e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:15.349550 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e20e7b9-7a4c-4fe2-8844-f1ad2bfa0201 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 200 len: 1328 microversion: 2.1 time: 1.301168 Oct 04 21:13:15.353137 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2227/4529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:14 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 1328 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.373463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:15.378106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.412454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.413353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.414229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.416620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.417836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.418968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.832628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd2d45bd-58e6-46c4-8069-b718d812bbbb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "PUT /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1078 microversion: 2.1 time: 0.477240 Oct 04 21:13:15.843322 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2228/4530] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:13:15 2022] PUT /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1078 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.862889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:15.865761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.884875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.886493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.887737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.889390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.891737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.892982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.073034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.096958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84696141-568a-4e06-ae11-57e3fb0fa682 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 3.344361 Oct 04 21:13:16.112582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2303/4531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:12 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:16.145241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:16.146595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:16.159510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=88 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:16.163827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.165863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.167393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.169308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.171310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.172543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.423441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:17.457502 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f17ce818-b096-49aa-85a5-b5f28216627b tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.611253 Oct 04 21:13:17.474714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2229/4532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:15 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:17.597195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:17.653889 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e143290-fc30-41ab-a3ad-aa5add8faebb tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1504 microversion: 2.1 time: 1.539103 Oct 04 21:13:17.661055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2304/4533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:16 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1504 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:17.699992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "tag": "448f9e2e-3a37-4d83-bb3c-2ce30b40640b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:17.738091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.740107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.742103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.816823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] Creating event network-changed:448f9e2e-3a37-4d83-bb3c-2ce30b40640b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:13:17.861108 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-eccd31f3-baff-4eae-8022-79880007052e req-8dd07505-1acc-4b1b-a0b1-9c0e35661f89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180970 Oct 04 21:13:17.864708 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2305/4534] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:17.895722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:17.899657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] [instance: 320290b7-8047-476b-b477-7fdd6f02ad67] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:17.900074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e982f-b3c7-4da0-be39-33430bbf281a", "tag": "c6ea4b55-921f-4fbf-9c6f-dad152bd920e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:17.939162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.946291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.948356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.953679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.955699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.956574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.960292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.960793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.962156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.024882 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] Creating event network-changed:c6ea4b55-921f-4fbf-9c6f-dad152bd920e for instance a45e982f-b3c7-4da0-be39-33430bbf281a on n-h1-851029-13 Oct 04 21:13:18.032036 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] HTTP exception thrown: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Request method failure captured: Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 HTTP/1.1 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPJ54ZD2sPcPDuBZX9RfcdoXXee6JKMNV2Of9HwrkqzgBOSO-ucWomNcfqKPnDQOVI1vdyVr8Q3pIFkRwALQV6FM7MJduV_UOlqsV9JKdHEJflTrgZzXCaDHbEapi1I3wf0qZGgt3RyVTthP9v4jYx_BnCFSdwyX_KcDRbJn_dTNebyk Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a38dd3831aa1439990b23b07b81023e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a38dd3831aa1439990b23b07b81023e6 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1934153021 Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3f337efc1e76467a887b7a60f89eafff Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1934153021-project Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '320290b7-8047-476b-b477-7fdd6f02ad67'} Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:18.047708 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. Oct 04 21:13:18.062919 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:18.068627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f17e72e3-20d6-4bb6-95be-c5e9575eb929 req-e980330f-80c0-41ce-aec4-e25195e3c342 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586233 Oct 04 21:13:18.068896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Returning 404 to user: Instance 320290b7-8047-476b-b477-7fdd6f02ad67 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:18.068896 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da421d28-acd1-434a-ad9f-35264cbf8ebc tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67" status: 404 len: 111 microversion: 2.1 time: 0.189326 Oct 04 21:13:18.072436 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2230/4535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:18.075947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2306/4536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:17 2022] GET /compute/v2.1/servers/320290b7-8047-476b-b477-7fdd6f02ad67 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:18.092700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.106948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.107503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.112692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.144264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.145723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.147155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.149858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.151080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.156779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.157614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.159163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.160445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.161532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.166272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.167895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.492745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:19.520463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9675ed9f-738d-493c-99e3-10ca7e5778a2 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1504 microversion: 2.1 time: 1.442202 Oct 04 21:13:19.545821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2307/4537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1504 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:19.575438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-510dab6a-6d10-4f08-bb22-e884afb0bde0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] Calling method '.version_select at 0x7f54f5e1fdc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.743832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-510dab6a-6d10-4f08-bb22-e884afb0bde0 tempest-ServerActionsTestJSON-1934153021 tempest-ServerActionsTestJSON-1934153021-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061477077" status: 202 len: 0 microversion: 2.1 time: 0.195310 Oct 04 21:13:19.745645 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2308/4538] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 21:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061477077 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:19.763336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.763336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:19.774462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.775899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.776985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.793832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.793832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.793832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.100399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.132386 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5bed6ecd-3e5f-418c-80d8-d84521ef9855 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 2.053888 Oct 04 21:13:20.134972 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2231/4539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:20.148019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:20.154287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:20.172282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.173669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.174748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.184530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.187248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.188827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.589739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc1f1da4-b493-4712-a91e-742d420b40ce tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "PUT /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1080 microversion: 2.1 time: 0.444762 Oct 04 21:13:20.591532 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2232/4540] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:13:20 2022] PUT /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1080 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:20.605158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c", "tag": "89d6b0ee-743e-4dde-b42b-6813e5e0296e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:20.660793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.662028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.673024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.736800 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] Creating event network-changed:89d6b0ee-743e-4dde-b42b-6813e5e0296e for instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c on n-h1-851029-13 Oct 04 21:13:20.763268 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-431a7ff5-6655-4b99-9ec9-599ddc558c71 req-efb20c54-4cbf-4038-993f-8c3b5e259737 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169163 Oct 04 21:13:20.770370 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2233/4541] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:20.795717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:20.799710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:20.835436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.842394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.844763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.850314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.851865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.854790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.372554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.400161 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37fe61a7-fa7b-41d0-b1d2-fe24e032801c tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.652012 Oct 04 21:13:21.406289 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2309/4542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:19 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.426835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.428505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.455196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.456617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.459166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.465331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.466739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.475919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.800994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.871799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0036c7fd-41e4-4076-bf0c-2a23c188a1f6 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1506 microversion: 2.1 time: 1.094249 Oct 04 21:13:21.873730 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2234/4543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:20 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.926518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.927973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.957751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.960718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.967479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.973281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.977358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.979444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.981300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:22.014698 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6ce0cfd7-e672-4fc0-b6ef-f48a381bbb37 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 0.605849 Oct 04 21:13:22.028209 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2310/4544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:21 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:22.460032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.461241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.508810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.509681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.510917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.512749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.514013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.515954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.202532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.235303 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-006ffc2b-b505-44b4-9e3b-d8340fa36eee tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1506 microversion: 2.1 time: 1.313147 Oct 04 21:13:23.236281 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2235/4545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:21 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1506 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.256651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.264766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.299340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.302753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.302753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.303110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.304133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.304982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.765119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.782727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-044042bb-9e99-4f10-bca9-3c705677572e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.329673 Oct 04 21:13:23.784232 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2311/4546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:23.794292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.795775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.816547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.817921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.820338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.826814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.828584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.829812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.889363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:24.569823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07a2cc0c-1214-44b4-bd23-614b1d8b4c08 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 204 len: 0 microversion: 2.1 time: 0.782425 Oct 04 21:13:24.586947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2312/4547] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:23 2022] DELETE /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:24.612590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:24.614033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.627375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.628917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.630050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.631816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.633702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.635052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.717612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:24.996005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.compute.api [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Instance is already in deleting state, ignoring this request Oct 04 21:13:25.001035 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d39ed51b-0baf-4d34-a8ac-9d83fe8c53b1 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 204 len: 0 microversion: 2.1 time: 0.403444 Oct 04 21:13:25.012855 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2313/4548] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:24 2022] DELETE /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:25.038525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.045612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.067331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.069082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.069943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.071731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.072705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.073505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.516201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:25.553655 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2c2fa4e-b0a1-4860-ac5d-e2a4156c4b34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 2.308910 Oct 04 21:13:25.580560 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2236/4549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:25.618757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.620691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.647471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.650716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.650716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.652298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.655015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.656458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.261038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.298962 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c859bb62-acfc-4500-bede-793f16564dc1 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.275931 Oct 04 21:13:26.301725 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2314/4550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:26.466576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:26.483323 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd7e6261-0b6f-488e-9683-7181a821b00d tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1512 microversion: 2.1 time: 0.888488 Oct 04 21:13:26.485245 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2237/4551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1512 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:26.606928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:26.609942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:26.636194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.637221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.638578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.640592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.642290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.643482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.357298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.363033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:27.387059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.400026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.400849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.402327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.403301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.404266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.774248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:27.808886 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c7e1089-88f5-4d55-a9fb-7fc2887add91 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 1.212652 Oct 04 21:13:27.810815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2315/4552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:26 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:27.846755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:27.848419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:27.871230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.871230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.871230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:27.877233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:27.878745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:27.880133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:28.872463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:28.920533 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cfded66-c9aa-46c3-a7f1-a73d2f5eb475 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.584670 Oct 04 21:13:28.921703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2238/4553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:28.948436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:28.953501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:28.996107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.002474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.006097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.014892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:29.017647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:29.025094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:29.621428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:29.660765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7a21408-c3d2-4da5-b750-48436125d752 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1512 microversion: 2.1 time: 1.838158 Oct 04 21:13:29.664372 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2316/4554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:27 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1512 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:30.012747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.020092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:30.071546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.075843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.079175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.084795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.088181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.093388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.825359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:30.862211 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-115d3151-5533-46d3-8b82-b316f0fab49c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 1.937471 Oct 04 21:13:30.871217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2239/4555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:28 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:30.900892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:30.902047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:30.934774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.936228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.937582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:30.941413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:30.944834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:30.951217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:31.488188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:31.525436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75a74b05-afbf-4669-9bb4-d2e26ce596dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.545349 Oct 04 21:13:31.531966 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2317/4556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:29 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:31.920688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:31.924385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:31.963873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:31.965181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:31.969949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:31.971676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:31.983804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:31.985461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:32.865346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:32.923589 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7894cdb-743a-4898-a485-b02379d466f9 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1512 microversion: 2.1 time: 2.034635 Oct 04 21:13:32.923589 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2240/4557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:30 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1512 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:33.206896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e982f-b3c7-4da0-be39-33430bbf281a", "name": "network-vif-plugged", "status": "completed", "tag": "c6ea4b55-921f-4fbf-9c6f-dad152bd920e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:33.280334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.298331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.299556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.345787 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] Creating event network-vif-plugged:c6ea4b55-921f-4fbf-9c6f-dad152bd920e for instance a45e982f-b3c7-4da0-be39-33430bbf281a on n-h1-851029-13 Oct 04 21:13:33.370480 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8e1bd5b4-8b90-4b1a-aad2-e9994768fc16 req-0bcd3f10-035f-422e-9c14-58fdce3ef47e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451045 Oct 04 21:13:33.385629 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2241/4558] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:33.428350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:33.432522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:33.492799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.497630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.498588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.504524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:33.505452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:33.506322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:33.641933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:34.128076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:34.163042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-903feab7-df50-45cc-b885-f352eb0b1595 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 2.252674 Oct 04 21:13:34.174064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2318/4559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:31 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:34.193967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:34.196412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:34.222186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:34.224225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:34.225767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:34.227949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:34.229566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:34.231176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:34.294071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:34.573466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:34.599989 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7f9acc7-6008-4ecd-b1e9-87a5f7d22232 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1470 microversion: 2.1 time: 0.431078 Oct 04 21:13:34.608415 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2319/4560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:34 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1470 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:35.036179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:35.066126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-125b071f-c443-4c53-ad4a-fbbeb8ab2516 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.669912 Oct 04 21:13:35.072388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2242/4561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:33 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:35.218746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:35.219939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:35.266257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.270182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.272089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.275767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.277103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.278408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.921369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588e2193-ead0-4de7-90ec-074b16313c3e", "name": "network-vif-deleted", "tag": "2b1dc33e-52d6-482f-beb0-3dcfd705663c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:35.966440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:35.971640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.974127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.977047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.002340 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78f75d50-8947-4b2a-b5c2-7de4d5b71ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 0.792633 Oct 04 21:13:36.014645 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2320/4562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:35 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:36.017685 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] Creating event network-vif-deleted:2b1dc33e-52d6-482f-beb0-3dcfd705663c for instance 588e2193-ead0-4de7-90ec-074b16313c3e on n-h1-851029-13 Oct 04 21:13:36.033852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:36.039387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:36.044856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-cbfc0e34-39e3-4f1d-9f77-b6d982b80c85 req-5a1fc90a-308c-414d-90c8-5b0b370fe198 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402960 Oct 04 21:13:36.047838 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2243/4563] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:36.074763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.078399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.079627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.086326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.087303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.089621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.150299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:36.157279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:36.217474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.226846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.230611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.238815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.244958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.248152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.916411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:36.948337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30e9048a-f354-4ae6-887a-c0a5883cd012 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1470 microversion: 2.1 time: 0.931567 Oct 04 21:13:36.984869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2321/4564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:36 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1470 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:37.078424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:37.082550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:37.113433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.114972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.115841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.116884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.117414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.118201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.696723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.736063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4b3b9a1-f52f-48a7-ac10-7d8a1181487a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1470 microversion: 2.1 time: 1.620530 Oct 04 21:13:37.742625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2244/4565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:36 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1470 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:37.909064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.947813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cba6a38-6350-475c-894d-40195f12ec81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 0.878151 Oct 04 21:13:37.961774 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2322/4566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:37 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:38.024397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:38.032335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:38.073544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.077019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.083385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.091659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.097659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.107158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.323333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.326742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.331412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.336185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lazy-loading 'fault' on Instance uuid 588e2193-ead0-4de7-90ec-074b16313c3e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:38.447650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c", "name": "network-vif-plugged", "status": "completed", "tag": "89d6b0ee-743e-4dde-b42b-6813e5e0296e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:38.481360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70725c9735414d649b11fd73576174f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b818c66f54a438cc0e6cd0d6dd69d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:38.486684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.494924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.497150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.505517 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-438ac31d-ff46-4015-93d8-59647dc6b1de tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 200 len: 1307 microversion: 2.1 time: 0.495320 Oct 04 21:13:38.506592 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2245/4567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:38 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:38.533066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] Creating event network-vif-plugged:89d6b0ee-743e-4dde-b42b-6813e5e0296e for instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c on n-h1-851029-13 Oct 04 21:13:38.544230 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-407a8d60-e3ef-4da2-b952-132094a35ff6 req-129985a6-05aa-42ca-9241-2a786dd1678a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103524 Oct 04 21:13:38.553354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2323/4568] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:13:38.789959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:38.797691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:38.823421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.824975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.826021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.827290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.836424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.836424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.022000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.023675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.041724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.042765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.043543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.044914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.045750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.055158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.468033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.519160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39bdc7dc-516b-48fd-adfb-2a3ceea7a84d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1641 microversion: 2.1 time: 0.736292 Oct 04 21:13:39.526837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2246/4569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:38 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1641 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:39.573202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.574902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 588e2193-ead0-4de7-90ec-074b16313c3e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.588670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.589913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.591073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.592692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.594301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.595392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.633544 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] HTTP exception thrown: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Request method failure captured: Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e HTTP/1.1 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKDgYZORDsPktI6RUYbvPrfh4uqxLXRM30w-tqoSwf0O0XWfEiJ2DHUEhawKnhk_3Q_06OD08vl96GrughbnRxRRsUzo7gZ4xtOlh5FNwRYblhwTwgYk861vRmubNLzpc2-xELt-olocqG_ytc3Yad7a8EtubtmTTQbtwE8Y121ymgQ Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 70725c9735414d649b11fd73576174f0 Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '588e2193-ead0-4de7-90ec-074b16313c3e'} Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:39.636881 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Returning 404 to user: Instance 588e2193-ead0-4de7-90ec-074b16313c3e could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:39.661338 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9de6783e-9559-4fcd-ad0a-d57bda47ca3c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e" status: 404 len: 111 microversion: 2.1 time: 0.082428 Oct 04 21:13:39.669752 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2247/4570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/588e2193-ead0-4de7-90ec-074b16313c3e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:39.679057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.680298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.699835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.700951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.702233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.705107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.707533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.708562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.730210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.763619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c5f3472-23b3-4331-a249-95e166decc30 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 0.751404 Oct 04 21:13:39.784007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2324/4571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:39.821742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.823121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.839964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.841735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.843178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.845841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.847436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.849091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.896406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] HTTP exception thrown: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Request method failure captured: Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 HTTP/1.1 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKDgYZORDsPktI6RUYbvPrfh4uqxLXRM30w-tqoSwf0O0XWfEiJ2DHUEhawKnhk_3Q_06OD08vl96GrughbnRxRRsUzo7gZ4xtOlh5FNwRYblhwTwgYk861vRmubNLzpc2-xELt-olocqG_ytc3Yad7a8EtubtmTTQbtwE8Y121ymgQ Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 70725c9735414d649b11fd73576174f0 Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '63d9fd99-af7d-4647-b7ec-e53ba426cbc6'} Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:39.897553 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:39.909232 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:39.913413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Returning 404 to user: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:39.916374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00ba7941-90bb-4916-a23b-5b9959a50c67 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 404 len: 111 microversion: 2.1 time: 0.133755 Oct 04 21:13:39.918960 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2325/4572] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:39 2022] DELETE /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:39.938014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:39.940705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 63d9fd99-af7d-4647-b7ec-e53ba426cbc6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:39.958724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.962051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.962051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.964223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.965097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.967601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.002472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] HTTP exception thrown: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Request method failure captured: Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 HTTP/1.1 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKDgYZORDsPktI6RUYbvPrfh4uqxLXRM30w-tqoSwf0O0XWfEiJ2DHUEhawKnhk_3Q_06OD08vl96GrughbnRxRRsUzo7gZ4xtOlh5FNwRYblhwTwgYk861vRmubNLzpc2-xELt-olocqG_ytc3Yad7a8EtubtmTTQbtwE8Y121ymgQ Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 70725c9735414d649b11fd73576174f0 Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '63d9fd99-af7d-4647-b7ec-e53ba426cbc6'} Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.006400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Returning 404 to user: Instance 63d9fd99-af7d-4647-b7ec-e53ba426cbc6 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a8652bd-f89c-4997-a81d-d59e1179043c tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6" status: 404 len: 111 microversion: 2.1 time: 0.093151 Oct 04 21:13:40.028027 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2326/4573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/63d9fd99-af7d-4647-b7ec-e53ba426cbc6 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:13:40.041315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.043023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.057189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.070858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.070858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.070858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.070858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.070858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.094645 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] HTTP exception thrown: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Request method failure captured: Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda HTTP/1.1 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKDgYZORDsPktI6RUYbvPrfh4uqxLXRM30w-tqoSwf0O0XWfEiJ2DHUEhawKnhk_3Q_06OD08vl96GrughbnRxRRsUzo7gZ4xtOlh5FNwRYblhwTwgYk861vRmubNLzpc2-xELt-olocqG_ytc3Yad7a8EtubtmTTQbtwE8Y121ymgQ Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 70725c9735414d649b11fd73576174f0 Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2e1ca71c-c7fb-4655-87fc-5b6b1e34feda'} Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:40.098467 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Returning 404 to user: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21e448f8-d0a7-491c-a658-34873a6bd825 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 404 len: 111 microversion: 2.1 time: 0.068386 Oct 04 21:13:40.120087 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2327/4574] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:40 2022] DELETE /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:40.126414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.128810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] [instance: 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.147744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.149280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.151179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.153717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.155523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.156804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.205777 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] HTTP exception thrown: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Request method failure captured: Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda HTTP/1.1 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKDgYZORDsPktI6RUYbvPrfh4uqxLXRM30w-tqoSwf0O0XWfEiJ2DHUEhawKnhk_3Q_06OD08vl96GrughbnRxRRsUzo7gZ4xtOlh5FNwRYblhwTwgYk861vRmubNLzpc2-xELt-olocqG_ytc3Yad7a8EtubtmTTQbtwE8Y121ymgQ Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae0b818c66f54a438cc0e6cd0d6dd69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ae0b818c66f54a438cc0e6cd0d6dd69d Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1798924383 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 70725c9735414d649b11fd73576174f0 Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1798924383-project Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2e1ca71c-c7fb-4655-87fc-5b6b1e34feda'} Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.210352 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] Returning 404 to user: Instance 2e1ca71c-c7fb-4655-87fc-5b6b1e34feda could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e05996f-34b7-4830-bdc8-b419b83fe996 tempest-ServerDiskConfigTestJSON-1798924383 tempest-ServerDiskConfigTestJSON-1798924383-project] 10.222.0.36 "GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda" status: 404 len: 111 microversion: 2.1 time: 0.096073 Oct 04 21:13:40.226935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2328/4575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/2e1ca71c-c7fb-4655-87fc-5b6b1e34feda => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:40.463061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:40.503497 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3b479ae-da6f-489c-8f62-5ec50e3394c6 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1641 microversion: 2.1 time: 0.830103 Oct 04 21:13:40.507871 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2248/4576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:39 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1641 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:40.550213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.552096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.571269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.572729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.573770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.575339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.576398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.577384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.836657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.837713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.863338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.866651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.886723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.893289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.894828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.895885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:41.655346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:41.698413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0127fdf0-6d34-4f9b-b68a-f6cfb559b1d2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1329 microversion: 2.1 time: 0.880015 Oct 04 21:13:41.700971 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2249/4577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1329 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:42.361957 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef8e75e9-07c2-46e9-8121-5ad252fdffff tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1794 microversion: 2.1 time: 1.820544 Oct 04 21:13:42.364761 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2329/4578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1794 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:42.744950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:42.746180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:42.780330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.781095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.781935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:42.783381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:42.784282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:42.785136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:43.959223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:43.986197 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecc6917e-d994-477a-96be-cee5d6a0da59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1510 microversion: 2.1 time: 1.247867 Oct 04 21:13:43.988727 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2250/4579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:42 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1510 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:44.045476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:44.049771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:44.066958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.696663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:44.726106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74879675-3d02-4f29-9f43-8557fc0b5158 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1510 microversion: 2.1 time: 0.690100 Oct 04 21:13:44.750437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2330/4580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:44 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1510 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:44.775752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:44.777434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:44.800966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=52 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:44.807592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.808949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.811377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.814062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:44.815823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:44.816981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:44.895752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:45.600364 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ffba2f5-ef64-4efa-b5f0-aef13ec17f31 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 204 len: 0 microversion: 2.1 time: 0.832913 Oct 04 21:13:45.605338 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2251/4581] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:44 2022] DELETE /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:45.622576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:45.625343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:45.641859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.643094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.646356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:45.650640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:45.653292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:45.656816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:46.595356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:46.618567 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a6dd545-5d75-4fc1-a75e-80e22e7fd13f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1516 microversion: 2.1 time: 1.005251 Oct 04 21:13:46.620795 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2331/4582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:45 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1516 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:47.667640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:47.670568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:47.695370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.696643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.703497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:47.707002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:47.707002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:47.708620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:48.522331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:48.552014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf90afeb-8ddf-4e72-b70e-f8dfe36f8261 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1516 microversion: 2.1 time: 0.891955 Oct 04 21:13:48.555344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2252/4583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:47 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1516 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:49.603513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:49.611369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:49.637205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:49.644850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:49.649249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:49.655841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:49.658120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:49.662522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:49.664784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:50.464997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:50.489543 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-abec30f1-1716-42c2-80a5-b84e553d1a96 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1516 microversion: 2.1 time: 0.901327 Oct 04 21:13:50.490680 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2332/4584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:49 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1516 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:51.542803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:51.545152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:51.594502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:51.597681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:51.603077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:51.609464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:51.616443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:51.620904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:51.974551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:52.015013 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-020e0621-7135-4e08-a56f-0d249b03bc28 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1474 microversion: 2.1 time: 0.468388 Oct 04 21:13:52.017965 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2253/4585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:51 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:53.068727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:53.073198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:53.100565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.102705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.103721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.105334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.106332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.107334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.437385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:53.453371 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8c0b423-b49b-41e8-af12-4affd373c7f5 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1474 microversion: 2.1 time: 0.394178 Oct 04 21:13:53.454459 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2333/4586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:53 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:53.626270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c", "name": "network-vif-deleted", "tag": "89d6b0ee-743e-4dde-b42b-6813e5e0296e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:53.650550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:53.652132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:53.653341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:53.685552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] Creating event network-vif-deleted:89d6b0ee-743e-4dde-b42b-6813e5e0296e for instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c on n-h1-851029-13 Oct 04 21:13:53.697278 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-dda6cabb-c8ee-4282-ab52-f13f2192bff9 req-5e0dcf79-8a01-42b8-9255-5babc52547b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078182 Oct 04 21:13:53.699939 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2254/4587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:54.501373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:54.502793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:54.519721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.520758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.522591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.524932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.526371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.527961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.700531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:54.720732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:54.725765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:54.731723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:54.926442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:54.959764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89731efa-7b35-49fa-9365-b6e2521788d3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1319 microversion: 2.1 time: 0.468161 Oct 04 21:13:54.965666 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2334/4588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:54 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:55.952864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-236101644", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:56.019826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:56.026686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:56.056007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.063009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.064490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.067238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.069831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.073183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.122137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:13:56.123271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:13:56.124180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:13:56.127855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:13:56.137461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:13:56.181817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.181817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.182293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.182480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.182698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.182950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:56.183262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.183262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:56.187412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:56.188680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:56.247550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Getting quotas for project 8437741bfe9e4aa6ab1144f49a53e969. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:56.263642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Getting quotas for user 55ad330fc08d4d3abc26e86cff721033 and project 8437741bfe9e4aa6ab1144f49a53e969. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:56.279188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:56.314018 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-afd26bfd-e951-44f8-95dd-db68f341d7e7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 200 len: 1319 microversion: 2.1 time: 0.303077 Oct 04 21:13:56.319437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2335/4589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:56 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:56.330526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:13:56.336424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:13:56.633175 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5413162c-8bd2-4938-b1c1-c37a9a4671fb tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.242435 Oct 04 21:13:56.646783 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2255/4590] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:13:56.658109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:56.671095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:56.993358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:57.029551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:57.036412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:57.038773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97bd8d06-a6bd-4713-acf0-1f4eba000e13 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1280 microversion: 2.47 time: 0.389902 Oct 04 21:13:57.039829 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2336/4591] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:56 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:13:57.362807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:57.364113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:57.384184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:57.387901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:57.389301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:57.392496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:57.393809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:57.394903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:57.437349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c HTTP/1.1 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c'} Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:57.442850 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:13:57.453649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:13:57.457929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:57.460299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-611b8822-3f2e-45ee-a325-b81560081495 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 404 len: 111 microversion: 2.1 time: 0.105114 Oct 04 21:13:57.469711 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2256/4592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:57 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:57.477880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d690f27-225b-42de-a0f3-bb8d188be7bc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '.version_select at 0x7f54f639e5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:57.664130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d690f27-225b-42de-a0f3-bb8d188be7bc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-key-1616265096" status: 202 len: 0 microversion: 2.1 time: 0.193612 Oct 04 21:13:57.673018 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2337/4593] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 4 21:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1616265096 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:58.008496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1556755742", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:58.108493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:58.109886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:58.136844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:13:59.105417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.136202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.144603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:59.149832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4f87979-c678-4ab1-88c7-b4bd2c5c76f5 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1280 microversion: 2.47 time: 1.050403 Oct 04 21:13:59.184393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2338/4594] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:13:58 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1280 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:13:59.204346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e982f-b3c7-4da0-be39-33430bbf281a", "tag": "c6ea4b55-921f-4fbf-9c6f-dad152bd920e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:59.236428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:59.242684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:59.251264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:59.310162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] Creating event network-changed:c6ea4b55-921f-4fbf-9c6f-dad152bd920e for instance a45e982f-b3c7-4da0-be39-33430bbf281a on n-h1-851029-13 Oct 04 21:13:59.329198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c2b12ff3-1b5a-4f30-a4b2-88429f68ac29 req-8009b3f9-3fe1-47d2-8e65-e8f53bdf45dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139206 Oct 04 21:13:59.333820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2339/4595] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:00.216767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:00.229078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:00.287777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.287777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.287777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:00.287777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:00.289648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:00.290562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:01.089888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.121344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.141414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:01.145603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f9f45fd-1562-46ec-abda-d2084f478e08 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1276 microversion: 2.47 time: 0.938854 Oct 04 21:14:01.148363 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2340/4596] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:00 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1276 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:02.197767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:02.201954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:02.217763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.219171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.220288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:02.221906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:02.223186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:02.224281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:03.328931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.368189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.371664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:03.387302 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f9ab399-5050-492c-8aac-73d3f2d10447 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1340 microversion: 2.47 time: 1.198128 Oct 04 21:14:03.389581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2341/4597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:02 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1340 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:14:04.437273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:04.439117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:04.440851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:04.454427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:04.459268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:04.465269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:04.465892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:04.492032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.496395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.496395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.496980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.496980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.498006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.500095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.501448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.502698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.504445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:04.505351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:04.506142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:04.525172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:04.587605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:04.591210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:04.609627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:04.669872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:04.681402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:04.747184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:04.765161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:04.768250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:04.771142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-151fd871-da2f-4d8d-8da2-d08dac768566 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1338 microversion: 2.47 time: 0.327505 Oct 04 21:14:04.772173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2342/4598] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:04 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:04.937264 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-898269c2-f79c-41fb-8f9a-53a24609eadc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.939015 Oct 04 21:14:04.939235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2257/4599] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 6944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:04.965107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b547b6f-872a-406d-aefe-5f9e73a00fed tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:04.971551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b547b6f-872a-406d-aefe-5f9e73a00fed tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:05.229485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b547b6f-872a-406d-aefe-5f9e73a00fed tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:05.276080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b547b6f-872a-406d-aefe-5f9e73a00fed tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1209 microversion: 2.1 time: 0.318665 Oct 04 21:14:05.292946 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2343/4600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:04 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1209 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:05.838853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:05.838853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:05.877616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.880705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.884619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:05.886270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:05.889511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:05.891450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:06.137440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.216046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.219664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.224275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9385943-ddde-4e71-b2c8-6e9b148c37a2 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1359 microversion: 2.47 time: 0.401178 Oct 04 21:14:06.240807 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2258/4601] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:05 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:14:06.281266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-238999996"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:06.298771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:06.324848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-664c5f95-4c0c-4f6c-b4ae-518e12b11f6e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:06.325947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-664c5f95-4c0c-4f6c-b4ae-518e12b11f6e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:06.341452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:06.346144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:06.347884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:06.351942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:06.353172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:06.359152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:06.633543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-664c5f95-4c0c-4f6c-b4ae-518e12b11f6e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:06.657138 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-664c5f95-4c0c-4f6c-b4ae-518e12b11f6e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1209 microversion: 2.1 time: 0.337928 Oct 04 21:14:06.662124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2259/4602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:06 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1209 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:07.362590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-867aabba-d83e-4a64-8bd7-2969d173844b tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "POST /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3/action" status: 202 len: 52 microversion: 2.47 time: 1.092367 Oct 04 21:14:07.393717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:07.396076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:07.401891 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2344/4603] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:14:06 2022] POST /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3/action => generated 52 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:14:07.418546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.420101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.421314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.423074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.427009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.427009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.540471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:07.713850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:07.717646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:07.733429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.737439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.737439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.737439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:07.738372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:07.740013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:07.910237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:07.937700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c19a3ef-933a-49d3-a1c6-2dbf5bd2b4ae tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1213 microversion: 2.1 time: 0.237142 Oct 04 21:14:07.937700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2345/4604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:07 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:08.341857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0cc5999-ea46-4d62-8e25-d98fffc6ec84 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 204 len: 0 microversion: 2.47 time: 0.956636 Oct 04 21:14:08.346315 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2260/4605] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:14:07 2022] DELETE /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 0 bytes in 961 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:14:08.359516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:08.360705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:08.415194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.417237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.430210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.436471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:08.444753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:08.448823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:08.819966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:08.856194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:08.862766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:08.870179 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e33b8c8a-615a-40a2-bdcb-1661b92f3866 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1365 microversion: 2.47 time: 0.514701 Oct 04 21:14:08.874313 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2346/4606] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:08 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1365 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:08.985374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:08.985374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.011517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.012404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.013201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.014581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.029744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.041392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.379701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:09.414834 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-744766cf-057d-47d8-b526-341372bba7f3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1261 microversion: 2.1 time: 0.439175 Oct 04 21:14:09.418827 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2261/4607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:08 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1261 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:09.923853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:09.938279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.969080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.975386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.977110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.979520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.983824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.989976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.471391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:10.480161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:10.485105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:10.526189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.528609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:10.529406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.531667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.536267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:10.536632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:10.544406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:10.546344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d92dddc-fed5-4b3c-adcf-477d922d4bdd tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1365 microversion: 2.47 time: 0.631827 Oct 04 21:14:10.547526 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2347/4608] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:09 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1365 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:10.547922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:10.976235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:10.993750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f2f381d-ddf8-4bd3-909b-7e00d0779cb9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1269 microversion: 2.1 time: 0.526658 Oct 04 21:14:11.019150 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2262/4609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:10 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1269 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:11.597550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:11.600672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.630924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.632820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.633748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.635805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.638417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.640933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.889218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:11.915810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:11.919665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:11.926545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6b7b17f-efe0-4ae5-b5dd-5b1f246e645e tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1365 microversion: 2.47 time: 0.336472 Oct 04 21:14:11.938476 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2348/4610] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:11 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:12.049719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:12.052580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:12.071064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.075005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.075005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.075005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:12.076418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:12.077267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:12.435159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:12.457720 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b2c672d-4b84-41aa-a11e-bb760dc69654 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1267 microversion: 2.1 time: 0.415180 Oct 04 21:14:12.459657 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2263/4611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:12 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1267 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:12.981629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:12.985079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:13.001610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.002881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.004375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.006639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.008231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.010549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.090185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.091014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.091880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.093145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lazy-loading 'fault' on Instance uuid 95411249-d929-4eb8-8f68-2d182c253cb3 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:14:13.499411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:13.508984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:13.518832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:13.539903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.540718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:13.541593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.542296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.546543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:13.548741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:13.549898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:13.553713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55ad330fc08d4d3abc26e86cff721033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8437741bfe9e4aa6ab1144f49a53e969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:13.556744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb260853-1a03-4cef-92b6-5d5a21ee6698 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 200 len: 1370 microversion: 2.47 time: 0.583567 Oct 04 21:14:13.584472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2349/4612] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:12 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 1370 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:14:13.857900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:13.887236 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05db12e5-47d7-43ef-8baf-d021c8fdedca tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1267 microversion: 2.1 time: 0.390812 Oct 04 21:14:13.903242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2264/4613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:13 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1267 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:14.617419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:14.620191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] [instance: 95411249-d929-4eb8-8f68-2d182c253cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:14.671418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.672803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.676967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.679756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.687548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.688949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.739722 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] HTTP exception thrown: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Request method failure captured: Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 HTTP/1.1 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKISusnlXoQx-4bYqQlPxRem_oLcSte5Zu6Me9mfoJY_YmoMRbmqjTFHa5RYYF3XGIrRjgTSyeESBHOWEjs-yeOPjy43u_XBPUy_LOx92YcXxaSQPf4n9pRdbv6mhwbWg5Pi8frdD7f6DA2OcLgoeLDu6KWK9HmVD-0_-63ydrR_H4g Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8437741bfe9e4aa6ab1144f49a53e969 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAaction247Test-1234732193 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8437741bfe9e4aa6ab1144f49a53e969"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8437741bfe9e4aa6ab1144f49a53e969"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8437741bfe9e4aa6ab1144f49a53e969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8437741bfe9e4aa6ab1144f49a53e969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAaction247Test-1234732193 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8437741bfe9e4aa6ab1144f49a53e969 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAaction247Test-1234732193 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAaction247Test-1234732193-project Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 55ad330fc08d4d3abc26e86cff721033 Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAaction247Test-1234732193-project Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '95411249-d929-4eb8-8f68-2d182c253cb3'} Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:14:14.751088 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:14:14.764959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] Returning 404 to user: Instance 95411249-d929-4eb8-8f68-2d182c253cb3 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:14.784132 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18bec64d-86a6-4ff8-9c79-f34886939542 tempest-ServersAaction247Test-1234732193 tempest-ServersAaction247Test-1234732193-project] 10.222.0.36 "GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3" status: 404 len: 111 microversion: 2.47 time: 0.175014 Oct 04 21:14:14.791186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2350/4614] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:14:14 2022] GET /compute/v2.1/servers/95411249-d929-4eb8-8f68-2d182c253cb3 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:14:14.938273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:14.939465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:14.950216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:14.967164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.967983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.968810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:14.970174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:14.971111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:14.971924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:15.880503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:15.910255 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e21def4-1c00-4b7f-8064-b633fb902bf7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 0.979708 Oct 04 21:14:15.911334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2265/4615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:14 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:16.959922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:16.968822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:16.991022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:16.996892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:16.999258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.000441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.002032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:17.003402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:17.004228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:17.979491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:17.999639 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ddccba41-95f1-4314-ab7a-5b8c44748184 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.053017 Oct 04 21:14:18.000799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2351/4616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:16 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:19.045682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:19.048072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:19.082455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:19.088526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:19.099857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.100807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.102764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:19.110597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:19.112092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:19.113271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:20.188575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2125231013", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "eccecaac-f20f-476a-b1ca-130460018db3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:20.341153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] validate_networks() for [('eccecaac-f20f-476a-b1ca-130460018db3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:20.719920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:20.762008 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a45bb17f-9580-44d5-931b-2ec013376f39 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.734715 Oct 04 21:14:20.780001 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2266/4617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:19 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:21.822809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:21.825349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:21.840951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.842880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.844093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:21.845889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:21.847238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:21.848109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.860201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:23.889814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e39a4cb-0b67-47fc-9431-fd2892c2ca4f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 2.074073 Oct 04 21:14:23.891625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2267/4618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:21 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:23.902435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1663c717-5ddc-472c-83da-8c1e8589bb24", "tag": "3fc901da-9223-4fef-809f-3b71eb80ef37"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:23.938253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.941672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.942943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.093035 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] Creating event network-changed:3fc901da-9223-4fef-809f-3b71eb80ef37 for instance 1663c717-5ddc-472c-83da-8c1e8589bb24 on n-h1-851029-13 Oct 04 21:14:24.103245 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b7707b4f-4cbc-4fe3-b21e-f26f02c93c49 req-e8025eb3-9629-4de9-a2b7-0217f11d91bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209008 Oct 04 21:14:24.104860 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2268/4619] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:24.672054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:24.672961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:24.674155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:24.674752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:24.675550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:24.700357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:24.740942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.743826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.754412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.757589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.759478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.760283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.818967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:24.831912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for user b89accd9547e464b8b7557ca7474025c and project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:24.868088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:24.881736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:24.947698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:24.952980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:24.981099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.988630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.990254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.991787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:24.992838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:24.993612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:25.232744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d860476-1a0d-45e9-832f-2abad030e98b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.666575 Oct 04 21:14:25.234109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2352/4620] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 5670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:25.560856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1064889536", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "eccecaac-f20f-476a-b1ca-130460018db3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:25.784789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] validate_networks() for [('eccecaac-f20f-476a-b1ca-130460018db3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:26.322917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:26.353665 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72adc611-27bc-4d98-87a0-59291f15d4e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.421096 Oct 04 21:14:26.375217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2269/4621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:24 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:27.398530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:27.403788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:27.441030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:27.441963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:27.442778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:27.444080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:27.444957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:27.445732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.455638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:28.456597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:28.458363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:28.459610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:28.460780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:28.518285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.522161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.527438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.530948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:28.532457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:28.535778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:28.592707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:28.616276 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bad281c1-b4aa-4d2e-9648-8b03469f93db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.224645 Oct 04 21:14:28.630738 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2270/4622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:27 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:28.631116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:28.643163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for user b89accd9547e464b8b7557ca7474025c and project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:28.684986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:28.691594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:29.052371 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68d510b9-ffe2-43f8-b2cf-a9f4629d081f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.500444 Oct 04 21:14:29.058385 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2353/4623] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:29.386999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-631542219", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "451", "networks": [{"uuid": "eccecaac-f20f-476a-b1ca-130460018db3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:29.548565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] validate_networks() for [('eccecaac-f20f-476a-b1ca-130460018db3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:29.669340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:29.673462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:29.723714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:29.725162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:29.756409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:29.757637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:29.763022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:29.763994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.524205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:31.558795 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b05c4f56-7900-48da-b828-4671e8a78d86 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.902261 Oct 04 21:14:31.580105 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2354/4624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:29 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:32.621025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:32.624287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:32.653151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:32.670151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:32.674874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:32.677314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:32.681918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:32.683269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:33.964069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:33.965025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:33.966002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:33.967032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:33.967666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:33.999853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:34.027324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.030943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.037135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.041771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:34.042118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f89a99f5-f3f6-46b0-9217-d99d64f814cb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.430203 Oct 04 21:14:34.043489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:34.045408 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2355/4625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:32 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:34.064968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:34.158594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:34.207854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Getting quotas for user b89accd9547e464b8b7557ca7474025c and project c4d666b7e282413b9a1cf0e73c07de4a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:34.328899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:34.346306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:34.753928 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f62a918-55fd-4d4f-9709-2c8da9e8e1aa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.373147 Oct 04 21:14:34.760609 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2271/4626] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:34.783744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cd61b02-4b20-48ac-a881-aa3d6175628a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:34.785697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cd61b02-4b20-48ac-a881-aa3d6175628a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:35.094563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:35.095783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:35.136916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:35.139573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:35.140429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:35.143586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:35.147009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:35.148716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:35.337456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cd61b02-4b20-48ac-a881-aa3d6175628a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:35.369219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cd61b02-4b20-48ac-a881-aa3d6175628a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1220 microversion: 2.1 time: 0.594500 Oct 04 21:14:35.378451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2356/4627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:34 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1220 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:35.453787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1663c717-5ddc-472c-83da-8c1e8589bb24", "name": "network-vif-plugged", "status": "completed", "tag": "3fc901da-9223-4fef-809f-3b71eb80ef37"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:35.522645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:35.524711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:35.526917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:35.575104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:35.594493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] Creating event network-vif-plugged:3fc901da-9223-4fef-809f-3b71eb80ef37 for instance 1663c717-5ddc-472c-83da-8c1e8589bb24 on n-h1-851029-13 Oct 04 21:14:35.607924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b7ee9e96-aac9-4f8a-8f51-5613b5220b0d req-8a8d6cfe-dd7e-4009-9b0e-66e2fdb7d950 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204993 Oct 04 21:14:35.609811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2357/4628] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:36.423977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f09ebc56-b65f-4eb7-868f-04a1543ff5d4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:36.430788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f09ebc56-b65f-4eb7-868f-04a1543ff5d4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:36.650799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f09ebc56-b65f-4eb7-868f-04a1543ff5d4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:36.682377 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f09ebc56-b65f-4eb7-868f-04a1543ff5d4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1220 microversion: 2.1 time: 0.265995 Oct 04 21:14:36.684501 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2358/4629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:36 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1220 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:36.951205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:36.975953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:36.992435 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-967b459a-7456-4eaf-aca1-627b639a75cd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 1.905292 Oct 04 21:14:36.998633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2272/4630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:35 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:37.730352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:37.731582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:37.746634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:37.748221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:37.748996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:37.750323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:37.751242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:37.752211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:38.032397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:38.039356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:38.040567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:38.053668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12e4e4dd-1922-4622-a227-e409abcee830 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1224 microversion: 2.1 time: 0.332229 Oct 04 21:14:38.056228 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2359/4631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:37 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1224 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:38.099315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:38.104548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:38.106078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:38.113117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:38.114871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:38.117084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.121818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.123830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.155277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:39.186794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.189967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.194295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.197360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.199092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.200425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.054619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:40.075392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45ba95a1-e8e7-48cb-9e81-1dd557328a10 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1272 microversion: 2.1 time: 0.971935 Oct 04 21:14:40.079614 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2360/4632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:39 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1272 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:40.585512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c585110-d7ab-4468-971f-31674088f042", "tag": "6690df07-edb9-400e-8a13-7d87a2dbff51"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:40.650774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:40.651518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:40.652365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.733327 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] Creating event network-changed:6690df07-edb9-400e-8a13-7d87a2dbff51 for instance 7c585110-d7ab-4468-971f-31674088f042 on n-h2-851029-13 Oct 04 21:14:40.748404 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e56628a0-71b9-4b32-bf60-ff7239bef051 req-af06b329-093e-4090-97ce-653585eeaf81 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179099 Oct 04 21:14:40.750647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2361/4633] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:14:41.076982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:41.110526 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd31d336-36f9-4828-bd94-b7e5735bf832 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1309 microversion: 2.1 time: 3.080524 Oct 04 21:14:41.120802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2273/4634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:38 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1309 bytes in 3092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:41.153106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:41.163213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:41.263608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.273596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.280127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:41.283547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.285639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.292743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:41.902815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:41.939658 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f24a28e-c46a-487e-8200-79e9ce56b6c6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1290 microversion: 2.1 time: 0.803079 Oct 04 21:14:41.952881 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2362/4635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:41 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1290 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:42.168841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:42.170196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:42.205792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:42.207428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:42.208531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.210220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:42.211540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:42.212846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.008528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:43.009740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:43.023781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.024889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.025701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.027215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.028138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.028984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.561897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:43.584096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41ebb4f4-1aeb-491c-bf1c-7f9e4c7fcc1f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1278 microversion: 2.1 time: 0.586754 Oct 04 21:14:43.585633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2363/4636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:42 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1278 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:44.106234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:44.272561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:44.280335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:44.304011 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3093bdd7-1761-4275-86ca-1541c832a523 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1490 microversion: 2.1 time: 2.142857 Oct 04 21:14:44.308906 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2274/4637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:42 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1490 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:44.639889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:44.642317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:44.666103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1556755742", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:44.676447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:44.692238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:44.693290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:44.695028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:44.696415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:44.697405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:44.870465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:45.189270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:45.216000 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-454555d2-7a9a-4b00-b6ca-bc182e1000ae tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1278 microversion: 2.1 time: 0.578796 Oct 04 21:14:45.217540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2364/4638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:44 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1278 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:46.258760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:46.261504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:46.299473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.305384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.316905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.319839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.321212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.324906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.679957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:46.752816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:46.795416 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce0f2987-c519-4863-afa6-0100ab8e2af7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1278 microversion: 2.1 time: 0.539753 Oct 04 21:14:46.800727 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2365/4639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:46 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1278 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:46.811655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0515684c-49f4-4eec-8899-9067d1c22bae", "tag": "5f9e348d-28a9-4827-b82b-736446d58ac4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:46.859313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:46.860209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:46.861045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:46.891242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] Creating event network-changed:5f9e348d-28a9-4827-b82b-736446d58ac4 for instance 0515684c-49f4-4eec-8899-9067d1c22bae on n-h2-851029-13 Oct 04 21:14:46.901422 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c2612c95-19ad-40b9-9fbd-f37bee2cb71d req-1eb5fc19-48e2-4303-86d9-eb9e134aef73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098259 Oct 04 21:14:46.903485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2366/4640] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:47.900421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:47.903664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:47.946319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.949281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.949281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:47.951546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.953249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.954534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:48.991142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:49.013640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f25f8e29-9e4a-4a7d-bd20-4d9502e052be tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1278 microversion: 2.1 time: 1.164770 Oct 04 21:14:49.063454 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2367/4641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:47 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1278 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:49.522094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:49.523524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:49.524494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:49.525261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:49.526020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:49.545162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.546019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.546900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.548327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.549175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.550499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.592723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:49.610455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:49.654848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:49.660805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:49.903551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d76e32f5-f421-4ee9-b2d9-c960cc754017 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.245368 Oct 04 21:14:49.911115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2275/4642] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:49.938248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cca13530-ce10-48ab-b8ac-281538f3fe60 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:49.941300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cca13530-ce10-48ab-b8ac-281538f3fe60 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:50.086689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:50.102032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:50.166398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.167532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.170816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.175809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.181426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.181426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.428759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cca13530-ce10-48ab-b8ac-281538f3fe60 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:50.464910 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cca13530-ce10-48ab-b8ac-281538f3fe60 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1209 microversion: 2.1 time: 0.536986 Oct 04 21:14:50.468668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2368/4643] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:49 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1209 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:50.512236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c585110-d7ab-4468-971f-31674088f042", "name": "network-vif-plugged", "status": "completed", "tag": "6690df07-edb9-400e-8a13-7d87a2dbff51"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:50.540498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.542169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.542169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.628555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] Creating event network-vif-plugged:6690df07-edb9-400e-8a13-7d87a2dbff51 for instance 7c585110-d7ab-4468-971f-31674088f042 on n-h2-851029-13 Oct 04 21:14:50.628555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5a163659-2b4f-40f1-8217-0314c2c3d1bd req-6b20478e-1544-49ff-803c-d4591f9538df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119511 Oct 04 21:14:50.644425 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2369/4644] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:51.518979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08a6b2fc-3b26-468b-ac10-095a6d029da3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:51.519997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08a6b2fc-3b26-468b-ac10-095a6d029da3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:51.734183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:51.773025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-787a9800-54fc-4876-bdca-ac9f0da705ba tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.706235 Oct 04 21:14:51.777006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2276/4645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:50 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:51.854867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08a6b2fc-3b26-468b-ac10-095a6d029da3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:51.901167 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08a6b2fc-3b26-468b-ac10-095a6d029da3 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1209 microversion: 2.1 time: 0.391710 Oct 04 21:14:51.907814 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2370/4646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:51 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1209 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:52.821383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:52.827714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:52.863345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:52.864937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:52.866042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:52.867880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:52.875539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:52.875873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:52.967121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:52.968184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:53.024984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:53.032837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:53.034883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:53.038512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:53.044772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:53.049855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:53.769611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:53.796774 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9111918-3fc9-4d4d-8fb7-77f91a8910a2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1213 microversion: 2.1 time: 0.836553 Oct 04 21:14:53.825053 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2371/4647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:52 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1213 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:54.803720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:54.836230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:54.840937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:54.881242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.882262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.897392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.899451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:54.903980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:54.904346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a3703b9-5be9-4d1d-9092-298534c5f99f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 2.090256 Oct 04 21:14:54.905509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:54.911554 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2277/4648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:52 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:55.276108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:55.303521 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d5ad7dd-df70-4574-a829-8c5213b198fd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1261 microversion: 2.1 time: 0.476108 Oct 04 21:14:55.315197 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2372/4649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:54 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1261 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:55.965425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:55.966228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:55.972903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:55.983414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:55.984822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:55.986010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:55.987705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:55.988895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:55.989828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.419962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.558048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:56.607908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fa68003-60bf-43ee-bce3-6dbc424c4f4e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1269 microversion: 2.1 time: 0.264184 Oct 04 21:14:56.609501 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2373/4650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:56 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:56.969616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:57.044531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecd2042e-4d00-41a4-8d40-298a9edb7402 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.072574 Oct 04 21:14:57.046736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2278/4651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:55 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:57.664144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:57.667744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:57.716939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.718163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.721151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:57.725167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:57.732132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:57.734109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:58.095182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-645076904", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "bb108f51-8bfc-41cb-8794-5c35cc91a26d"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:58.149652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:58.290440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] validate_networks() for [('bb108f51-8bfc-41cb-8794-5c35cc91a26d', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:58.596061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:58.618234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ace6970d-f788-4454-a249-056d379e5333 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1267 microversion: 2.1 time: 0.967098 Oct 04 21:14:58.619620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2279/4652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:57 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1267 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:58.630481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:58.632386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:58.656545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:58.658272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:58.659378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:58.661228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:58.664712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:58.666475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.578558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:59.625992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:59.875465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:59.912145 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c398c37-b112-488d-9e16-1c9cf5e116c4 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.288226 Oct 04 21:14:59.915228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2280/4653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:58 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:59.926966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:59.929078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:59.947698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.949153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.950221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:59.956650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:59.956650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:59.959378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.408566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:00.435417 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72cc06fa-d7b2-4547-9d96-f2ee873656cc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1267 microversion: 2.1 time: 0.517269 Oct 04 21:15:00.442346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2281/4654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:59 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:00.475177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4", "tag": "ec8c0430-b15c-463c-95c8-02f2cbd0b2fd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:00.510241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:00.523644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:00.528801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.584470 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] Creating event network-changed:ec8c0430-b15c-463c-95c8-02f2cbd0b2fd for instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 on n-h1-851029-13 Oct 04 21:15:00.610249 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-341626e7-761a-4596-8271-feb1c02105b1 req-64a34cdc-94f8-402b-9454-de3c616b6e59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159929 Oct 04 21:15:00.612078 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2282/4655] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:00.621712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0515684c-49f4-4eec-8899-9067d1c22bae", "name": "network-vif-plugged", "status": "completed", "tag": "5f9e348d-28a9-4827-b82b-736446d58ac4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:00.666229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:00.667354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:00.667946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:00.721859 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] Creating event network-vif-plugged:5f9e348d-28a9-4827-b82b-736446d58ac4 for instance 0515684c-49f4-4eec-8899-9067d1c22bae on n-h2-851029-13 Oct 04 21:15:00.744900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6330a342-0fe7-43cb-b309-c8f0a1119eb1 req-0c77ca72-6dcc-4c8a-a832-3e524c682c2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130446 Oct 04 21:15:00.746459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2283/4656] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:00.980251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:00.981463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:01.000221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.001836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:01.003665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:01.005591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:01.006952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:01.010277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:01.893282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:02.863708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:02.889226 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6aa84727-5f7f-41c2-97bf-573787f0b49f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.928844 Oct 04 21:15:02.891274 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2284/4657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:00 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:02.902497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.904262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:02.931829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.935433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.936861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:02.938772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:02.942096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:02.944170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.221629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:03.221629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:03.222428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:03.222864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:03.223732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:03.258926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.260621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.261704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.263518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.264697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.273531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.315554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Getting quotas for project 2606c7733ad6445f80766a0c2f9dad91. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:03.328403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Getting quotas for user 7ff2241fd6f640eab135619f089e81f8 and project 2606c7733ad6445f80766a0c2f9dad91. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:03.392585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:03.399964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:03.594073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:03.629442 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b89a1f0f-9f66-4f21-8499-092d301c15e2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1267 microversion: 2.1 time: 0.735158 Oct 04 21:15:03.634417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2285/4658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:02 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1267 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:03.723440 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a24a99e-3daf-4810-be74-2dceb68db0ab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.212891 Oct 04 21:15:03.729483 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2374/4659] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 6222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:03.751140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-711deb33-a27f-4f42-84b5-dbed98ac7042 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.755832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-711deb33-a27f-4f42-84b5-dbed98ac7042 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:03.795368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.796821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:03.850429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.852680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.860292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:03.864328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:03.865644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:03.870745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:04.680886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-711deb33-a27f-4f42-84b5-dbed98ac7042 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:04.750323 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-711deb33-a27f-4f42-84b5-dbed98ac7042 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1215 microversion: 2.1 time: 1.006207 Oct 04 21:15:04.765191 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2286/4660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1215 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:04.768532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.771342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:04.834312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.837099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.838912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:04.841034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:04.843374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:04.847515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.846126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:05.924611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:05.928172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:05.939473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b6530f4-b6c4-4b6a-9819-17a148a77395 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2954 microversion: 2.42 time: 2.162673 Oct 04 21:15:05.944864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2375/4661] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2954 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:15:05.958340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:05.960736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:05.978095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.979641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.980875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:05.982501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:05.983942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:05.986440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:06.096355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:06.132945 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f40877f-fe36-4c14-9969-b65ab34b228e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.372483 Oct 04 21:15:06.138256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2287/4662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:06.160943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c401e23-2c9b-42fc-8269-600cb5e8f2fe tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:06.168414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c401e23-2c9b-42fc-8269-600cb5e8f2fe tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.544739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c401e23-2c9b-42fc-8269-600cb5e8f2fe tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:07.596061 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c401e23-2c9b-42fc-8269-600cb5e8f2fe tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1215 microversion: 2.1 time: 1.451343 Oct 04 21:15:07.618168 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2288/4663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:06 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1215 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:07.639579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:07.644847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:07.668295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.670361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.671887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:07.673847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:07.675117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:07.676445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.848958 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5baf88a0-859d-4faa-a86a-aea6a2d6864e tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7/os-interface" status: 200 len: 1829 microversion: 2.42 time: 1.228316 Oct 04 21:15:08.850805 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2289/4664] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:15:07 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7/os-interface => generated 1829 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:15:08.881154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:08.888276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:08.907061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.908847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.911402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:08.917544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:08.921990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:08.928973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.650007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:09.687136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac5e9c0b-4f83-48bc-9212-1e1b6f530e59 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 3.739201 Oct 04 21:15:09.691912 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2376/4665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:05 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 3746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:09.714828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:09.716824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:09.750610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.755606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.759970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:09.768471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:09.772788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:09.775130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.310003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:10.338921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d080f61-d3d0-4a13-8f81-fc4046b95d52 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1267 microversion: 2.1 time: 0.640534 Oct 04 21:15:10.341630 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2377/4666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:09 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1267 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:10.686148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:10.719512 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bc6fc0e-c27c-4432-a4a5-0ff84c1e0ffa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.866068 Oct 04 21:15:10.720499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2290/4667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:08 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:10.739599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:10.747276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:10.780353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.787031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.787031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.787031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:10.787031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:10.787031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:10.814829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=88 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:11.386156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:11.388052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:11.403387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.404925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.406109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.409024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.411688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.413488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.711868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:11.749750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3ebda3f-757a-4fcd-9d4a-c95e2c759d55 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1273 microversion: 2.1 time: 0.369105 Oct 04 21:15:11.754634 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2291/4668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:11 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:11.775484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:11.777359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:11.794989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.797966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.799751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:11.802235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:11.804190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:11.807081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.905274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:12.925339 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a75fac86-18d2-491a-90ef-e7d7b1117d68 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 2.193868 Oct 04 21:15:12.928663 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2378/4669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:10 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:12.940441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:12.941629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:12.963863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.964893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.966128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:12.968512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:12.970537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:12.971781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:13.297579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:13.351481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:13.495921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:13.518518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=94 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:13.546817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-87637adc-2e16-4fbd-bb83-1d14e60b0fd9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.788091 Oct 04 21:15:13.553044 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2292/4670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:11 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:13.628507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7933890-cdf7-4f94-9d42-9611d5fb86b0", "tag": "1ce36f29-02a3-4d23-8f29-00db34057639"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:13.676745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:13.677823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:13.681785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:13.743010 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] Creating event network-changed:1ce36f29-02a3-4d23-8f29-00db34057639 for instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 on n-h2-851029-13 Oct 04 21:15:13.756398 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6805ea89-feee-49dc-b9ea-415ee080b0fc req-ba016b1e-d230-43f1-8b24-df57ccf85225 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199797 Oct 04 21:15:13.758723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2293/4671] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:13.903265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:13.970819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3311a3e6-3a8f-4cc8-858d-f8580a13f33a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 1.037399 Oct 04 21:15:13.983194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2379/4672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:12 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:13.986863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:13.991323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:14.022581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.022581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.026569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.029395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.031598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.032716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.600697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:14.605838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:14.696086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.696915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.698161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:14.703657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:14.703657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:14.703657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.293429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:15.321441 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f273f048-5dbd-4ba6-83f3-6d3911c4875a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 1.357681 Oct 04 21:15:15.339422 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2294/4673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:13 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:15.339422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4", "name": "network-vif-plugged", "status": "completed", "tag": "ec8c0430-b15c-463c-95c8-02f2cbd0b2fd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:15.365797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.371121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.375139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.409537 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] Creating event network-vif-plugged:ec8c0430-b15c-463c-95c8-02f2cbd0b2fd for instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 on n-h1-851029-13 Oct 04 21:15:15.434317 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-908e48fd-3671-4154-9738-b099209d3a86 req-b9c8e8c5-0f0c-4000-acae-fe3e8e066241 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108496 Oct 04 21:15:15.436352 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2295/4674] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:15.460349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:15.463829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:15.490053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.495689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.497185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.499713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:15.501044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:15.514519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:15.815609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:15.859285 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bfe3c0e-37c4-46d5-852b-ede0f1ad4706 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 1.267737 Oct 04 21:15:15.905040 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2380/4675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:14 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:16.367949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:16.379181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:16.408804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.413857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.413857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:16.414774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:16.420748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:16.422346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.496383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:17.512522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d59b251e-4579-43e9-bf27-baf51239f5d5 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 2.072900 Oct 04 21:15:17.514749 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2296/4676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:15 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:17.523906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:17.525465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:17.537862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.539600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.546500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.549193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:17.551061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:17.552488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:17.600283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:18.856485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:18.878451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84307364-188d-433d-9a07-d56a02f1efaf tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 2.517569 Oct 04 21:15:18.898866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2381/4677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:16 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:18.922836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:18.923611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:18.936545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.938557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.939884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:18.941661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:18.943067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:18.944441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:19.600479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:19.623111 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f017b522-b1f3-4e38-a67c-65011448a768 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1320 microversion: 2.1 time: 2.105469 Oct 04 21:15:19.636040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2297/4678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:17 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1320 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:19.939963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: .version_select at 0x7f54f6270af0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1184298007", "policies": ["affinity"]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:20.042984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:20.072038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:20.203183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:20.235881 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-810cf748-04c4-48a5-bc90-74a8c36c169f tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 1.332418 Oct 04 21:15:20.269231 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2382/4679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:18 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:20.282014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:20.283779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:20.295737 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:15:20.322228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.323659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.324846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:20.326573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:20.327755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:20.335360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.296954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:21.315084 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 36484. Oct 04 21:15:21.332247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62774899-e8f8-42a0-8b9b-c88afb78aa36 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 1.059951 Oct 04 21:15:21.352722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2383/4680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:20 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:21.394862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:21.403852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:21.438759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.438759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.438759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.438759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.446136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.451891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.456374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:21.476202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:21.527775 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d02d0b1-9271-4fdf-a083-9bde4cfe751f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.889044 Oct 04 21:15:21.533340 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2298/4681] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 4 21:15:19 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:21.546252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:21.547922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:21.566522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.568414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.569725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:21.571845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:21.573092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:21.575699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.441978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.448505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:22.472175 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32c38ffe-9cd7-4530-82a3-1c05e38144c5 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1511 microversion: 2.1 time: 1.101048 Oct 04 21:15:22.479318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2384/4682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:21 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1511 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.495581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-657309be-505e-4903-a78a-68fa59ce4dcd tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.962898 Oct 04 21:15:22.496647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2299/4683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:21 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:22.498088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: .version_select at 0x7f54f5767160>, body: {"server_group": {"name": "tempest-server-group-1963264854", "policies": ["affinity"]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:22.535337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:22.538648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:22.604925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.605788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.617820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.628539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:22.629867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:22.631010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:22.656293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:22.688570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:23.015933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:23.050232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:23.111676 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f13fc48-756a-45c7-bc0e-2153686cc69a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.636418 Oct 04 21:15:23.115393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2385/4684] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 21:15:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:23.128947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:23.133019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:23.152442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.155224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.157672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:23.163440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:23.166221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:23.167680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:24.420920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:24.469319 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0304cf0-3eb4-437e-bae3-d868d5923da8 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 1.957153 Oct 04 21:15:24.471910 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2300/4685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:22 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:24.496828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: .version_select at 0x7f54fa55af70>, body: {"server_group": {"name": "tempest-server-group-1963264854", "policies": ["affinity"]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:24.587971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:24.626059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:24.933316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:24.952556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:24.995079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:25.005408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-080f6e53-f034-49ed-8c76-b8ab94db1c5d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.530306 Oct 04 21:15:25.015041 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2301/4686] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 21:15:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:25.024892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:25.026795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:25.075571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.079911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.082149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.090066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:25.093347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:25.097383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:25.905675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:25.940422 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09259e2b-8087-4090-903c-361116f5919b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1513 microversion: 2.1 time: 2.822248 Oct 04 21:15:25.948444 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2386/4687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:23 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1513 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:25.956840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4a30d89-dd1a-4963-a211-c7ab98f9fba7 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.118302 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4a30d89-dd1a-4963-a211-c7ab98f9fba7 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/63450619-c8d7-4489-ab8b-909d545bd012" status: 204 len: 0 microversion: 2.1 time: 0.167163 Oct 04 21:15:26.119323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2387/4688] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:15:25 2022] DELETE /compute/v2.1/os-server-groups/63450619-c8d7-4489-ab8b-909d545bd012 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:26.159364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d849d4c3-6fe1-4d01-851b-84e91391ff97", "tag": "00043283-ca89-494a-b41f-6f8a809d7870"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:26.221160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.237231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.238367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.282986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] Creating event network-changed:00043283-ca89-494a-b41f-6f8a809d7870 for instance d849d4c3-6fe1-4d01-851b-84e91391ff97 on n-h1-851029-13 Oct 04 21:15:26.299618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:26.307305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-43f7c375-9cfc-4772-ba70-247d613ba20e req-3752fbfe-eb89-469d-9a80-7b12f1e31187 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185084 Oct 04 21:15:26.312669 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2388/4689] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:26.334123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a59ab75-c5a9-4f28-ac64-8d088cdc4f4d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 1.321784 Oct 04 21:15:26.339776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.341446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.367593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2302/4690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:25 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:26.368897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.372319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.379826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.381422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.382843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.384080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.392788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:26.394023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:26.405763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.416539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.417780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:26.437832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:26.444621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:26.446097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.035452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:27.092406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8d95e1b-f6d9-4309-ac1c-b1158c1d8268 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1513 microversion: 2.1 time: 0.722602 Oct 04 21:15:27.098551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2303/4691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1513 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:27.113089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10bb8cb5-904c-4d7f-b6c6-e6dc6195018d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.152281 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10bb8cb5-904c-4d7f-b6c6-e6dc6195018d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.051301 Oct 04 21:15:27.154286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2304/4692] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:27.156484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:27.168801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.174104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eeeb2b70-67f7-4cac-9d03-956d7998a053 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 0.858694 Oct 04 21:15:27.175586 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2389/4693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:26 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:27.191356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:27.193302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8c94c83-906a-48f8-a916-6e412c27faeb tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.194328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:27.361330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8c94c83-906a-48f8-a916-6e412c27faeb tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/fa69e6a1-0b84-46de-b250-214bc316b995" status: 204 len: 0 microversion: 2.1 time: 0.182413 Oct 04 21:15:27.363717 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2390/4694] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:15:27 2022] DELETE /compute/v2.1/os-server-groups/fa69e6a1-0b84-46de-b250-214bc316b995 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:27.378471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed7ddf8f-32e3-4a5a-800a-662babe03bac tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.459996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed7ddf8f-32e3-4a5a-800a-662babe03bac tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.088966 Oct 04 21:15:27.475364 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2391/4695] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:27.487343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:27.489092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:27.503534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.504963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.506107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.507835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.509080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.510184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.853707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.858648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.863596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:27.867019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:27.867965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:27.868785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.088298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:28.276477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.291241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.292538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.293551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.581991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:28.637149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc10ecfe-5aae-4896-b276-4809f5f0473d tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 1.157222 Oct 04 21:15:28.642473 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2392/4696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:28.672418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: .version_select at 0x7f54f62c9af0>, body: {"server_group": {"name": "tempest-server-group-1352553090", "policies": ["affinity"]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:28.789062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:28.795097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:28.818191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:28.854874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13ed1191-dfcf-41d1-bfb7-bd3f8b15447d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.698540 Oct 04 21:15:28.870709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2305/4697] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 4 21:15:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:28.880551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:28.880551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:28.915748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.917296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.921788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:28.921788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:28.921788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:28.921788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.090020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:29.107162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:29.146774 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0b0cb13-ed15-4feb-ab07-8a50ee51536b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.499492 Oct 04 21:15:29.148429 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2393/4698] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 21:15:28 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:29.163885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7933890-cdf7-4f94-9d42-9611d5fb86b0", "name": "network-vif-plugged", "status": "completed", "tag": "1ce36f29-02a3-4d23-8f29-00db34057639"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:29.189883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.190977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.193057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.227222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] Creating event network-vif-plugged:1ce36f29-02a3-4d23-8f29-00db34057639 for instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 on n-h2-851029-13 Oct 04 21:15:29.243492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-10a8f347-f519-4c24-a126-bdb7d3403ff2 req-18555b6e-dd6b-4223-ba2f-d537a64cb86d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090899 Oct 04 21:15:29.245427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2394/4699] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:29.256403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.272950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.275199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2125231013', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:29.292992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.312524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.313498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.314283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.315854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.316748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.317551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.330271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b5c36c8-f16b-4ce1-afb2-1211f455fd8c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 0.471032 Oct 04 21:15:29.332625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2306/4700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:28 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:29.346140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-503fc3cd-e034-4ad7-ac51-b73ade16d829 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.506321 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-503fc3cd-e034-4ad7-ac51-b73ade16d829 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/cdd96251-c468-4015-a9af-3a909e4b7bdf" status: 204 len: 0 microversion: 2.1 time: 0.169258 Oct 04 21:15:29.507299 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2307/4701] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:15:29 2022] DELETE /compute/v2.1/os-server-groups/cdd96251-c468-4015-a9af-3a909e4b7bdf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:29.524475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-502be98b-0ef5-490d-bfee-bf3a7736afad tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:29.555291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-502be98b-0ef5-490d-bfee-bf3a7736afad tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033072 Oct 04 21:15:29.555291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2308/4702] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:29.580350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: .version_select at 0x7f54fa55a1f0>, body: {"server_group": {"name": "tempest-server-group-1231877055", "policies": ["anti-affinity"]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:29.626443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:29.629074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:29.650019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:29.835770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:29.855657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:29.856770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:29.857693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:29.955159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:29.972494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_groups'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:30.028485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9328e545-002a-4140-9fb2-b52568a1f25a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.455093 Oct 04 21:15:30.040573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2309/4703] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 21:15:29 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:15:30.044172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.045501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:30.074540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.075458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.076244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.077934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.078496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.079347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.376879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41274e48-225b-4b3b-b4cc-b71dfe8f5a9f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2125231013" status: 200 len: 1516 microversion: 2.1 time: 1.129488 Oct 04 21:15:30.391084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2395/4704] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 21:15:29 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2125231013 => generated 1516 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:30.391084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ecb1297-da5d-4234-830f-9e30f008e63d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.581641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ecb1297-da5d-4234-830f-9e30f008e63d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814" status: 204 len: 0 microversion: 2.1 time: 0.200563 Oct 04 21:15:30.586902 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2396/4705] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:15:30 2022] DELETE /compute/v2.1/os-server-groups/38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:30.603816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.606491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:30.646473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.648958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.650381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.652784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.654477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.658363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.688842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:30.719696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e00ab3a8-9ca4-4dcd-8121-e686d6752ed2 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.685737 Oct 04 21:15:30.720765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2310/4706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:30 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:30.734836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:30.750171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:30.751815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:30.767407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.768332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.770293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:30.770561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:30.771377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:30.772157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.104862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:31.138760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.160905 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8ed2041-6f88-4b18-94d1-15d7e4e38574 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1309 microversion: 2.1 time: 0.569905 Oct 04 21:15:31.162324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2397/4707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:30 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1309 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:31.209058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c9ea7d2-cd2f-4aa3-ad27-a24a9df07047 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:31.276222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c9ea7d2-cd2f-4aa3-ad27-a24a9df07047 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.099038 Oct 04 21:15:31.288211 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2398/4708] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:31.362555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:31.398249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:31.398804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:31.399268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:31.442836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2038975201", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "b2375912-7648-4c54-a994-32e07e9f1e36"}]}, "os:scheduler_hints": {"group": "718f21c4-8244-4a41-9d1f-a72a5e91f076"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:31.570487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] validate_networks() for [('b2375912-7648-4c54-a994-32e07e9f1e36', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:32.095194 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-478cf735-a1d0-4a2f-a22e-d1b96d84172f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 1.371779 Oct 04 21:15:32.096562 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2311/4709] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 4 21:15:30 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:32.110184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.111659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.158629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.163416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.165916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.169950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.174133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.176614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.005572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:33.041380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f692f444-4200-4614-86a8-21d2696b5ef7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.942627 Oct 04 21:15:33.055997 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2312/4710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:33.087664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:33.121371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:33.123980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.servers [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Removing options 'limit' from query {{(pid=123542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:15:33.129376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:33.159784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.162183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.165588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.178230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.179715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.180773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:33.334218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:33.364880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:33.366974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:33.368889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.025096 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-805407bb-c941-4e52-8330-2778500d36fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.958590 Oct 04 21:15:34.026836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2313/4711] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 4 21:15:33 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:34.049202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:34.052793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:34.089345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.091561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.093897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.095641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.106471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.108584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.209022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:34.212409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:34.213602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:34.214499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:34.219807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:34.258910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.259533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.260057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.260956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.261865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.281098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.357111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:34.376862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:34.435394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:34.441562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:34.636595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:34.661224 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-44220374-3cc2-4667-a218-15e1fa1a7be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1490 microversion: 2.1 time: 0.629307 Oct 04 21:15:34.668579 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2314/4712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:34 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1490 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:34.683299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:34.687329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:34.696813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:34.699228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:34.708976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:34.726237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.728320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.729568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.732081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.734051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.735328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:34.847962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:34.865839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:34.917868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:34.940838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Getting quotas for user d4c9d099e0a849baae08b8ffa9b94f20 and project 0f95a76923ed4d8e9fdd18dcdd0b943c. Resources: {'server_group_members'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:34.943776 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d00c2efb-36b3-47ec-b18f-d7141a8582c2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.272208 Oct 04 21:15:34.957696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2315/4713] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:15:34 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:34.957696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:34.959339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:34.992734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:34.993579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:34.998188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.005586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.006211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.006906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.071053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-047862cd-3250-4c30-8fb5-70b42de1bd5f tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.634238 Oct 04 21:15:35.083091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2399/4714] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:15:35.102938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.104099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:35.132164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.133657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.134029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.141834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.142791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.143631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.649245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.704932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8758f1f1-2a8b-4c50-92cb-2d61072af715 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.754131 Oct 04 21:15:35.709196 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2316/4715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:34 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.730909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.755793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.757559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.servers [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Removing options 'limit' from query {{(pid=123542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:15:35.762389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:35.802301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.803801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.810377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.815112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:35.825540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:35.826922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:35.861053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:35.898654 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0335e42b-17d4-4839-8a54-b59045ec1285 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1490 microversion: 2.1 time: 0.813958 Oct 04 21:15:35.902880 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2400/4716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1490 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:35.925174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93479deb-163f-4c69-b06c-aded30dbc953 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:35.928383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93479deb-163f-4c69-b06c-aded30dbc953 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:35.950729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:36.066601 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-828afd82-3375-4a84-870d-f91d5117ed31 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.355600 Oct 04 21:15:36.068330 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2317/4717] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.079927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.081734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:36.098285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.099344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.100244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.102963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.105126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.106169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.180568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-93479deb-163f-4c69-b06c-aded30dbc953 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.209253 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93479deb-163f-4c69-b06c-aded30dbc953 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1213 microversion: 2.1 time: 0.293202 Oct 04 21:15:36.215883 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2401/4718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:35 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1213 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.241997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.264975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.267623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:36.295191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.299760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.303371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.321916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.321916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.321916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.419745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:36.559316 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1f3ea58-5fd8-447e-a81a-8d6ba5a8d4b2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.339766 Oct 04 21:15:36.563043 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2402/4719] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers => generated 1011 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.590232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-400854928", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3b16b289-2102-49bb-af27-6c52a91752f5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-902061338", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a45e982f-b3c7-4da0-be39-33430bbf281a"]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:36.805171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.808509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] validate_networks() for [('3b16b289-2102-49bb-af27-6c52a91752f5', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:36.829228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02ef6f00-82da-400b-8380-1f1135045207 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1490 microversion: 2.1 time: 0.757912 Oct 04 21:15:36.832203 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2318/4720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1490 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:36.842934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:36.853952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:36.857607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:36.893266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.894580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.895705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:36.897707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:36.898998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:36.899877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.310479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:37.530579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e31584e9-3f82-444c-a640-877c52252026 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.695715 Oct 04 21:15:37.544463 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2319/4721] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 21:15:36 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:37.559973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:37.563845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:37.577751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.578701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.579542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.580895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:37.582410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:37.583407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:37.989701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.017427 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-827f86f1-52c4-4a28-bb6c-d30684054db8 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.466829 Oct 04 21:15:38.019217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2320/4722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:37 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:38.034807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:38.036041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:38.061543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.063074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.064366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.068666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.068666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.069656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.145952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:38.516247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:38.517251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:38.517914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:38.519073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:38.520198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:38.542740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.543732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.544551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.548292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.548292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.548779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.617015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:15:38.621896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Getting quotas for user e74b98e16c47438eb09af538c57f4e6b and project 2fdec3b9a14e49f7b5392a82d19af772. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:15:38.628323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:38.652126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:15:38.657707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:15:38.707743 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e69d00fa-ce3b-4a86-b170-abc1e125101f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 204 len: 0 microversion: 2.1 time: 0.684845 Oct 04 21:15:38.716902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2321/4723] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:38 2022] DELETE /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:38.728654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:38.730022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:38.742784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.744020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.744840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.746291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.747206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.748017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.878807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:38.899531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf892fa1-673d-4506-8602-de840ef85c89 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1209 microversion: 2.1 time: 0.178788 Oct 04 21:15:38.902886 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2322/4724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:38 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1209 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:38.913334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d849d4c3-6fe1-4d01-851b-84e91391ff97", "name": "network-vif-plugged", "status": "completed", "tag": "00043283-ca89-494a-b41f-6f8a809d7870"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:38.956669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:38.962752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:38.963733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:38.977531 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c65b26e9-3a74-4d96-9bf0-d3e46a1b35dd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.411838 Oct 04 21:15:38.980631 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2403/4725] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:36 2022] POST /compute/v2.1/servers => generated 361 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:15:38.996226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.011566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.012893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.servers [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Removing options 'limit' from query {{(pid=123541) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:15:39.015109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:39.026864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.028717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.031909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.035021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.036824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.038275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.081556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] Creating event network-vif-plugged:00043283-ca89-494a-b41f-6f8a809d7870 for instance d849d4c3-6fe1-4d01-851b-84e91391ff97 on n-h1-851029-13 Oct 04 21:15:39.091857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b091610d-08a4-4be3-a0c1-64b9b779589f req-1ebd9cab-8a52-4a3f-b803-58c306ac0b47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185815 Oct 04 21:15:39.101874 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2323/4726] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:39.107720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.110225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.112868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:39.125016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.125883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.127220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.128900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.131173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.132629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.137009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-55c6564a-a8e1-4339-b16b-00aa7d2b4b2e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.153740 Oct 04 21:15:39.138390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2404/4727] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 4 21:15:38 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:39.178768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a131517a-5083-4ab0-8d23-24f042bc2e17 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.180126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a131517a-5083-4ab0-8d23-24f042bc2e17 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.326415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a131517a-5083-4ab0-8d23-24f042bc2e17 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.355772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a131517a-5083-4ab0-8d23-24f042bc2e17 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1240 microversion: 2.1 time: 0.206528 Oct 04 21:15:39.356766 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2405/4728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1240 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.374282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.377534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.403112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.416047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.423114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.423114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.423114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.423114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.718480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.737568 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-075a5191-3c9a-4079-8edd-2c56efc69f74 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1496 microversion: 2.1 time: 0.640279 Oct 04 21:15:39.741291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2324/4729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1496 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.767550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.786718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.788678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2125231013', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:39.803213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.807034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.809014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.812505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:39.814101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:39.815311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:39.881319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:39.910757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdd202fe-79c1-479d-9d5a-ba9cefcc22e6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.551679 Oct 04 21:15:39.912821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2406/4730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:39.962873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:39.968856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:39.999440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.001834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.004177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.005748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.007105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.008499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.071310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:40.285497 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-03379889-4ef3-4db7-9f38-74a8f26981bd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2125231013" status: 200 len: 346 microversion: 2.1 time: 0.526195 Oct 04 21:15:40.286629 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2325/4731] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2125231013 => generated 346 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:40.318226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:40.330952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:40.345947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.346994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.347759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.358628 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b492a82-88ae-45d5-a213-e38ad4bd0ee5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1265 microversion: 2.1 time: 0.411061 Oct 04 21:15:40.360641 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2407/4732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:39 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:40.408539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51408a09-bfef-4c05-bab0-ff8376506471 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:40.413881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51408a09-bfef-4c05-bab0-ff8376506471 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:40.482021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Going to try to stop instance {{(pid=123542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:15:40.590030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51408a09-bfef-4c05-bab0-ff8376506471 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:40.621624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51408a09-bfef-4c05-bab0-ff8376506471 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1240 microversion: 2.1 time: 0.217588 Oct 04 21:15:40.632717 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2408/4733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:40 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1240 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:40.780651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:40.781579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:40.794248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.795889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.796688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.797822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.798527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.799202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.855559 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f25f8743-3295-4ad9-90d3-9370f3373bfd tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "POST /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042/action" status: 202 len: 0 microversion: 2.1 time: 0.550605 Oct 04 21:15:40.861297 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2326/4734] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:15:40 2022] POST /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:15:40.893296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:40.894779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:40.915126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:40.919998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.921999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.923194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:40.924988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:40.926519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:40.928126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.258036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.280765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7d9d067-823c-4f29-9f42-0b7302d4f672 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1496 microversion: 2.1 time: 0.506053 Oct 04 21:15:41.287753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2409/4735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:40 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1496 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.293228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.296325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.310766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.312992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.314285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.317111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.318550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.319897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.368928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.401040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0fb8f09-2203-4f93-8161-23cea7ff7c21 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 0.531647 Oct 04 21:15:41.402389 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2327/4736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:40 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.433660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.437687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.449580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.450168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.450738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.452082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.453305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.454213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.616855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.627293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:41.637180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28170cac-0a2c-40cc-80b1-3a612e3c35f5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1273 microversion: 2.1 time: 0.214814 Oct 04 21:15:41.639194 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2328/4737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.676327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:41.678846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:41.706000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.706984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.707785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.709115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:41.709968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:41.710792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:41.831541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.863822 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4c759ad-9852-420a-9266-253832fc6cf7 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1315 microversion: 2.1 time: 0.576381 Oct 04 21:15:41.866731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2410/4738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:41.927786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:41.954820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d6cf152-3f64-4ca7-9a50-15199e16cc06 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1244 microversion: 2.1 time: 0.292829 Oct 04 21:15:41.955955 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2329/4739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:41 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1244 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:42.338562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:42.341933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:42.399099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.400229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.407573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.414205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.417751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.419235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.454620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:42.461996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:42.494920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.494920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.495869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:42.498015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:42.499882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:42.501006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.047466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.085294 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c5c7d6c-2630-4fd8-a72e-c836f78b4ae9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1496 microversion: 2.1 time: 0.750859 Oct 04 21:15:43.087347 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2411/4740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:42 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1496 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.121754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.124094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.124382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.135917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.137304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.138391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.140428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.141734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.142823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.149177 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a320dc7d-6ffb-48d8-9536-721fa32e4c14 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 0.710690 Oct 04 21:15:43.153148 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2330/4741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:42 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.163949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.165920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.182219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.183551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.184566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.187576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.192642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.197647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.329437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=30 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:43.338762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.376887 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c7bc043-54ae-41d0-be3b-5f5919df4bb5 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1271 microversion: 2.1 time: 0.286779 Oct 04 21:15:43.379380 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2412/4742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:43 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.432268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.437219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.458081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.459160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.460015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.461364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.462426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.463363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.706084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.738874 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ffb6264e-ce6e-4c41-913a-0be919128ea5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1292 microversion: 2.1 time: 0.351479 Oct 04 21:15:43.741796 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2413/4743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:43 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.753789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:43.776432 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e587b69-283a-44f1-83f6-8c488a01803a tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1503 microversion: 2.1 time: 0.619473 Oct 04 21:15:43.778332 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2331/4744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:43 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1503 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:43.830176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:43.831831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:43.845532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.847388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.848626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:43.850445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:43.851640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:43.852642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.113933 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12133cb4-8b16-42db-8422-30565418f019 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.291538 Oct 04 21:15:44.116066 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2414/4745] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 4 21:15:43 2022] DELETE /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97/os-server-password => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:44.137949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.139691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.147861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.149302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.158569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.159666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.160644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.161850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.162726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.163751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.164101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.164961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.165720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.167848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.168487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.169284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.241845 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11581864-a251-4848-bfce-32e06530ba71 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.108248 Oct 04 21:15:44.244393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2415/4746] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97/os-server-password => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:15:44.268566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.268566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.276030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.276947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.277772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.279358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.280245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.281009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.379466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:44.392486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-600de065-2a6b-478c-adc4-eaf22bf77a4a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1454 microversion: 2.1 time: 0.264590 Oct 04 21:15:44.394496 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2332/4747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1454 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:44.404832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:44.406150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:44.421712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.423313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.424769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.426633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:44.428840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:44.429922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:44.557564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:45.278769 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fb25800-bacf-4e2f-adfd-1fbf8de28fed tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 204 len: 0 microversion: 2.1 time: 0.881388 Oct 04 21:15:45.282937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2333/4748] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:44 2022] DELETE /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:15:45.294279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:45.304900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:45.333517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.334550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.335429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.336812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.337708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.357050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.399479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:45.433065 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-392aca4d-8b63-46ea-a6fe-65c951d2066a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 1.186216 Oct 04 21:15:45.439121 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2416/4749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:44 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:45.461166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7933890-cdf7-4f94-9d42-9611d5fb86b0", "name": "network-vif-deleted", "tag": "1ce36f29-02a3-4d23-8f29-00db34057639"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:45.501182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.507112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.508280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.569317 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] Creating event network-vif-deleted:1ce36f29-02a3-4d23-8f29-00db34057639 for instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 on n-h2-851029-13 Oct 04 21:15:45.591520 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cf26f016-43dd-4670-8887-5181053a7ea8 req-e2960af3-f7c7-43f0-a56a-1a56fbbc03c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149077 Oct 04 21:15:45.593208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2417/4750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:45.604607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:45.606457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:45.632653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.633359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.634488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.636219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.637370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.639866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:45.895964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:45.915190 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a888a93f-ac80-4343-aa35-43f8b4e94235 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1271 microversion: 2.1 time: 0.629850 Oct 04 21:15:45.937403 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2334/4751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:45 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1271 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:45.964614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:45.965805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:45.986848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:45.995415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:45.996308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.004777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.007228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.011338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.237474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.256509 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-217d58fb-af88-4f36-8d1d-90436121d779 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.660691 Oct 04 21:15:46.258237 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2418/4752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:45 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:46.268262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.271975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.287257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.305260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.305260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.305260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.305260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.305260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.362431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.363441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.364257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.365136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid a7933890-cdf7-4f94-9d42-9611d5fb86b0 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:46.495355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.536282 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cdaacc90-ecd0-4110-bd5b-1a21569c8016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 200 len: 1299 microversion: 2.1 time: 0.267614 Oct 04 21:15:46.580433 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2419/4753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:46.622521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.627777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.656424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.659680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.661070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.662812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.664267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.665483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.735052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:46.763792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d44b1cf-2a41-466f-85b7-b1efc8085bab tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1509 microversion: 2.1 time: 0.823630 Oct 04 21:15:46.766353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2335/4754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:45 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:46.967262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:46.967262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:46.984927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.986143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.987248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:46.989424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:46.991253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:46.993256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:47.966814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:47.999972 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e736ec88-e77a-4a7c-81e7-6cff464301f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 1.409483 Oct 04 21:15:48.020780 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2420/4755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:48.046937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.055976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.076173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.079975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.086853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.086853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.087636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.088796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.281022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:48.300657 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f45b6d4-61e4-49e9-ba38-b265693947c0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 1.346753 Oct 04 21:15:48.314712 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2336/4756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:46 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:15:48.314712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.314712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.334245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:48.353144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.354597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.355881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.358355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.359576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.360792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.361219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e006e2c-a77a-4f0d-b3c8-ba7d800a6bfd tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.335940 Oct 04 21:15:48.367539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2421/4757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:48 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:48.382475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.384536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.397164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.398202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.399292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.400744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.401701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.402549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.430969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 HTTP/1.1 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a7933890-cdf7-4f94-9d42-9611d5fb86b0'} Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:48.435174 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97b11873-7445-4f76-a84e-8871416160b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 404 len: 111 microversion: 2.1 time: 0.133806 Oct 04 21:15:48.444725 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2337/4758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:48 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:48.464345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:48.468862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:48.503324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.511259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.512472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.518211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:48.519474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:48.522898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:48.601491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:15:49.051802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:49.291065 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22ffa524-26b0-42ef-bd0e-94caff102f65 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 204 len: 0 microversion: 2.1 time: 0.838897 Oct 04 21:15:49.293464 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2338/4759] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:15:48 2022] DELETE /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:15:49.307623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:49.309335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.324119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.325695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.327696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.329360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.332038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.333558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.365273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:49.372376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:49.401295 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8024df74-ca37-4973-a47e-2252b7bd82da tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1509 microversion: 2.1 time: 1.031739 Oct 04 21:15:49.415204 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2422/4760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:48 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1509 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:49.443486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:49.444678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:49.468540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.469769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.470895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.472575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:49.473772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:49.474875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:49.926012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:50.417967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:50.441262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:50.484199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5c14b08-b598-46b2-b811-6cde7cc0cdec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1496 microversion: 2.1 time: 1.059909 Oct 04 21:15:50.495979 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c0eb8aa-d5a7-409e-bab1-8fe8b235a0e6 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 1.199893 Oct 04 21:15:50.499524 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2423/4761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:49 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1496 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:50.506837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2339/4762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:49 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:50.539227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:50.540151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:50.550994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:50.566891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.567849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.568686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.570094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.571119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.571962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.600379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:50.626189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.627028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.627708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.628872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:50.629616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:50.630377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:50.681696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=44 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:51.082628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:51.134230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47a64871-2b10-4995-a714-f6965ac4ee39 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.620101 Oct 04 21:15:51.147320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2340/4763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:50 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:51.154707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:51.154707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:51.179522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.180629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.186618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.188404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.190151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.190894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.267623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.269114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.270125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.271226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lazy-loading 'fault' on Instance uuid d849d4c3-6fe1-4d01-851b-84e91391ff97 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:51.533199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff2241fd6f640eab135619f089e81f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2606c7733ad6445f80766a0c2f9dad91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:51.586809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57df297c-5a87-48d9-aeac-5d76308bd5b6 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 200 len: 1305 microversion: 2.1 time: 0.445414 Oct 04 21:15:51.586809 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2341/4764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:51 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 1305 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:51.597887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d849d4c3-6fe1-4d01-851b-84e91391ff97", "name": "network-vif-deleted", "tag": "00043283-ca89-494a-b41f-6f8a809d7870"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:51.624071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.624071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.624571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.663796 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] Creating event network-vif-deleted:00043283-ca89-494a-b41f-6f8a809d7870 for instance d849d4c3-6fe1-4d01-851b-84e91391ff97 on n-h1-851029-13 Oct 04 21:15:51.692743 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fbbf9064-1888-47d4-81d8-e180994dce78 req-72f59a32-0ebf-45ec-9381-d62218e77cbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099531 Oct 04 21:15:51.695175 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2342/4765] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:51.712299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:51.718425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:51.738312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.750782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.751954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.754909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:51.760805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:51.763709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:51.777903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:52.294020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:52.318461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d6f3ab4-23dd-464c-9ae7-fee2161e2a20 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 1.816011 Oct 04 21:15:52.332274 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2424/4766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:50 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:52.337583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:52.340402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:52.353211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:52.355111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:52.356109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:52.357625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:52.358629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:52.359820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:52.824469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:52.844584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa581c0f-3939-4d94-ad96-a2dbb1ac6d1f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1496 microversion: 2.1 time: 1.146680 Oct 04 21:15:52.846262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2343/4767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:51 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1496 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:52.856602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:52.860704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:52.885813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:52.887144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:52.889064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:52.890725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:52.893153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:52.897145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:52.976053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:52.996319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-706718ca-46dd-4238-8923-9ceb25f3e1f9 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 0.672675 Oct 04 21:15:52.998354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2425/4768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:52 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:53.011405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:53.013853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] [instance: d849d4c3-6fe1-4d01-851b-84e91391ff97] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:53.030780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.032325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.034137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.036142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.039399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.041682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.075330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] HTTP exception thrown: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Request method failure captured: Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 HTTP/1.1 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKJQhp3ZDvb4Q-_L4qn7VbTnuRon-4NQY6havlKcxMg4IDHWU_xMbCaxyZ5F82h2HsVKSuK_jUqpo5Eicel_sZrhOjhtR716sbQuvjalXGaoAzXz8sDX-mpFrmHxH-xHMLvyDOIGP5dxfoAYckqyEV_KGycRdVSy1nmHzZQrYrt_jKs Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2606c7733ad6445f80766a0c2f9dad91 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerPasswordTestJSON-2097779019 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2606c7733ad6445f80766a0c2f9dad91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2606c7733ad6445f80766a0c2f9dad91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2606c7733ad6445f80766a0c2f9dad91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2606c7733ad6445f80766a0c2f9dad91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerPasswordTestJSON-2097779019 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2606c7733ad6445f80766a0c2f9dad91 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2097779019 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerPasswordTestJSON-2097779019-project Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7ff2241fd6f640eab135619f089e81f8 Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerPasswordTestJSON-2097779019-project Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd849d4c3-6fe1-4d01-851b-84e91391ff97'} Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:53.077841 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] Returning 404 to user: Instance d849d4c3-6fe1-4d01-851b-84e91391ff97 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34a1f453-221d-438b-82fb-2e23fd0f4539 tempest-ServerPasswordTestJSON-2097779019 tempest-ServerPasswordTestJSON-2097779019-project] 10.222.0.36 "GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97" status: 404 len: 111 microversion: 2.1 time: 0.080128 Oct 04 21:15:53.095447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2426/4769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:52 2022] GET /compute/v2.1/servers/d849d4c3-6fe1-4d01-851b-84e91391ff97 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:53.251193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:53.272300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cec130db-bae2-4d29-ae8e-e4434028f555 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.423497 Oct 04 21:15:53.273958 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2344/4770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:52 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:53.368919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:53.371281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:53.385197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.386454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.387600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.389435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.390591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.391649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.892877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180cc3e5-60ff-4e37-b317-2eed854a53d3", "tag": "f44be311-b657-4f63-b7ff-a1c77855f3a8"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:53.959777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:53.968916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:53.970297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:53.975828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:53.990719 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61e0889b-64a5-45ff-a9c3-c2a31516e0b8 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 0.630392 Oct 04 21:15:54.003470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2427/4771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:53 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:54.027446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:54.030730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:54.058785 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] Creating event network-changed:f44be311-b657-4f63-b7ff-a1c77855f3a8 for instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 on n-h1-851029-13 Oct 04 21:15:54.078427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.081819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a3442456-a1ad-42c5-8848-5c3a291f8e02 req-47fa0724-799a-486d-a0d3-c5c654b74386 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220971 Oct 04 21:15:54.085954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.090220 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2345/4772] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:54.093206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.098645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.099621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.100623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1663c717-5ddc-472c-83da-8c1e8589bb24", "name": "network-vif-deleted", "tag": "3fc901da-9223-4fef-809f-3b71eb80ef37"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:54.107331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.118405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.120667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.121870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.173984 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] Creating event network-vif-deleted:3fc901da-9223-4fef-809f-3b71eb80ef37 for instance 1663c717-5ddc-472c-83da-8c1e8589bb24 on n-h1-851029-13 Oct 04 21:15:54.215492 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d2e04401-0e75-42da-8c61-239b5480e35e req-220408c7-202d-489a-8d6e-dcc16b1f5cb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116904 Oct 04 21:15:54.220637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2346/4773] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:54.284031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:54.290520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:54.350117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.363723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.365674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.370752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.374238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.375515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.827889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:54.843616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b330a15b-1319-4191-a81e-e157f5f7089e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1454 microversion: 2.1 time: 0.837681 Oct 04 21:15:54.844658 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2428/4774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:54 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1454 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:54.881161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:54.882520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:54.901028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:55.327582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:55.344402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3978cd45-7f25-4cc0-a25b-342e1279a5d9 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.483085 Oct 04 21:15:55.345746 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2429/4775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:54 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:55.356178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:55.357881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:55.370771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:55.372785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:55.373864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:55.376065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:55.377298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:55.378325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:55.462932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:55.480385 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-931ea619-4ac0-4373-bd17-21aa10976b7c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1523 microversion: 2.1 time: 1.250230 Oct 04 21:15:55.481697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2347/4776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:54 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1523 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:55.906890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:55.906890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:55.942495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:55.947470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:55.947470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:55.948393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:55.949352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:55.950153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.086782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.087497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.088715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.089942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid 1663c717-5ddc-472c-83da-8c1e8589bb24 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:15:56.379756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:56.395791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8500d0cf-53b2-4b8d-8af1-139bd8d84441 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 200 len: 1299 microversion: 2.1 time: 0.509480 Oct 04 21:15:56.396779 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2348/4777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:55 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 1299 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:56.406634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:56.408729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:56.424462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.426093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.427486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:56.429596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:56.430832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:56.432925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.171323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:57.192682 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a9f834b-2c59-4afe-adac-ce45ac6cb693 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 1.844342 Oct 04 21:15:57.195089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2430/4778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:55 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:57.214972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7d3ad-1984-4edd-b80b-b61f6d4aadcf", "tag": "83382096-2b27-4caf-ae9d-403b45f6305d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:57.239541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.240511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.241447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.289796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:57.302340 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] Creating event network-changed:83382096-2b27-4caf-ae9d-403b45f6305d for instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf on n-h2-851029-13 Oct 04 21:15:57.329617 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fa0ef9f9-3bb2-4ff1-9bc5-febd45e8f143 req-384d9535-f98f-48cd-8377-8b51d5e42f68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129470 Oct 04 21:15:57.333499 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2431/4779] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:57.344234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f32de21-d7c1-46a7-80d2-c165f2812b73 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.940325 Oct 04 21:15:57.344234 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2349/4780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:56 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:57.349865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:57.351348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:57.376713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.377667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.378423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.380119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.381013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.382540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.460385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:57.464509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:57.491808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.499813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.500906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.502498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:57.503586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:57.504534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:57.540534 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 HTTP/1.1 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1663c717-5ddc-472c-83da-8c1e8589bb24'} Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:57.546966 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:15:57.568907 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:15:57.583695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:57.594757 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99581e88-2eee-4dca-971d-d1f5820a9ef7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 404 len: 111 microversion: 2.1 time: 0.143631 Oct 04 21:15:57.597673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2350/4781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:57 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:57.709817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1526260644", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:57.826288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:15:58.167388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:58.192202 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74ca5760-fd83-4d56-8f51-92673b549b65 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1500 microversion: 2.1 time: 0.855060 Oct 04 21:15:58.227222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2432/4782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:57 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1500 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:58.265351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:58.266698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:58.302300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:58.306478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:58.308330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:58.312747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:58.314215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:58.316033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.051232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.065934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2442da02-fce7-4a4b-862b-38a757021e23 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 0.830142 Oct 04 21:15:59.079943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2433/4783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:58 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:15:59.106008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:59.117896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.120215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:15:59.132187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.135572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.136785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.138630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.139857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.141115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.407934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:15:59.613941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a81c938-19f9-44c8-8915-23520e6c08d2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.531523 Oct 04 21:15:59.616293 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2434/4784] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 4 21:15:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:59.626928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:59.629145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:59.654931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.655472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.656525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.657888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.658850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.659727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.904641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:15:59.906937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:15:59.908586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:15:59.909916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:15:59.916637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:15:59.933936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.936212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.937135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.939390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:59.940352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:59.941338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:59.965603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:15:59.986723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6845becb-99ad-4c1a-ab3f-3a2b8491da40 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.367251 Oct 04 21:16:00.005978 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2435/4785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:15:59 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:00.021943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:00.030984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:00.043036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:00.059178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:00.060197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:00.061048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:00.094800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:00.103803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:00.120777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:16:00.307088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfb42208-06e3-4558-8ad5-6fbf0a931312 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.605134 Oct 04 21:16:00.315836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2351/4786] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:16:00.330226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:00.332323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:00.374099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:00.375607 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fd7e04a-d612-430c-a59d-f9a3332b55bb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "POST /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042/action" status: 202 len: 0 microversion: 2.1 time: 0.360244 Oct 04 21:16:00.378758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:00.379131 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2436/4787] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:16:00 2022] POST /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:16:00.381490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:00.384566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:00.385967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:00.388098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:00.404858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a7270d5-4e2b-476b-9d97-17ca96da5d67 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:00.406563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a7270d5-4e2b-476b-9d97-17ca96da5d67 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:00.958150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a7270d5-4e2b-476b-9d97-17ca96da5d67 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:00.986341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a7270d5-4e2b-476b-9d97-17ca96da5d67 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1209 microversion: 2.1 time: 0.604663 Oct 04 21:16:00.987521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2437/4788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1209 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:01.008462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:01.015898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:01.045614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.045614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.045614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:01.045614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:01.045614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:01.047488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.124432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:02.151288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c36ef11-7bfc-44ed-b1e2-7bb976cc26b9 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 1.833068 Oct 04 21:16:02.179298 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2352/4789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:02.212089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:02.215710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:02.240280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.245659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.246499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.248403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.249321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.253778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.571367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:02.598106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-407fb418-1d44-42ce-af05-4bffcdda99b1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1509 microversion: 2.1 time: 1.598739 Oct 04 21:16:02.611663 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2438/4790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:00 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1509 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:02.643065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:02.644747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:02.659398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.660797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.662020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.663795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.665074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.666405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.843218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:02.861221 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c09ecc7-260c-4c03-b79a-eb6ef66f9a87 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.665204 Oct 04 21:16:02.863684 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2353/4791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:02 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:02.900120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7d3ad-1984-4edd-b80b-b61f6d4aadcf", "name": "network-vif-plugged", "status": "completed", "tag": "83382096-2b27-4caf-ae9d-403b45f6305d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:02.930477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:02.931929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:02.934953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:02.973811 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] Creating event network-vif-plugged:83382096-2b27-4caf-ae9d-403b45f6305d for instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf on n-h2-851029-13 Oct 04 21:16:02.995738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fa839ea0-f2c0-43b8-8cec-c7b187c83331 req-83b9a219-a973-4863-8e8f-06e41430d03a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110678 Oct 04 21:16:02.998361 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2354/4792] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:03.111771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:03.155196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-061d8931-6223-41dd-9ca8-6de15da1a864 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1213 microversion: 2.1 time: 0.537405 Oct 04 21:16:03.167403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2439/4793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:02 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1213 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:03.219308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:03.225530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:03.245945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.248176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.249358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.253477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.258254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.259838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.652585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:03.656471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:03.673087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.674714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.675813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.677658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:03.678843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:03.679879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:03.757731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:04.055868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:04.085258 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6506a45a-e345-4f19-9079-a285dfabfafd tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 0.878215 Oct 04 21:16:04.117501 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2355/4794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:03 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:04.142841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:04.144203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:04.179299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.182717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.182717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.184854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.186714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.188055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.701283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:04.729243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b7ae850-3246-4a13-a045-1eab2dfd3c33 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1298 microversion: 2.1 time: 0.601755 Oct 04 21:16:04.736037 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2356/4795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:04 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1298 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:04.749206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:04.755233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:04.794316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.795289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.797239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.798819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:04.799763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:04.800561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:04.804302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:04.831622 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa3d5083-51a5-49f9-9ceb-cd8f6eab3c04 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1509 microversion: 2.1 time: 1.186205 Oct 04 21:16:04.836445 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2440/4796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:03 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1509 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:05.071610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:05.104868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c291c4e2-ba41-4395-bd0e-37c58399bd22 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1261 microversion: 2.1 time: 0.366676 Oct 04 21:16:05.106059 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2357/4797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:04 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1261 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:05.144726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:05.146283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:05.163564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.165719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.165719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.166636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.167933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.170986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.761704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:05.780247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44156f7d-1d05-4670-a55f-cea9be8ff02b tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 0.650114 Oct 04 21:16:05.796337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:05.797306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:05.803356 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2441/4798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:05 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:05.820507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.821405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.822284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.827890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.827890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.827890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.888653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:05.889780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:05.909063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.909856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.910442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:05.911843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:05.912720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:05.913421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.231051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.254012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-deeb39ef-88cc-41ee-9417-7fb66f2e19eb tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1471 microversion: 2.1 time: 0.471843 Oct 04 21:16:06.254952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2358/4799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:05 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:06.275893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:06.277237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:06.300974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.306198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.307157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.308413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.314498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.315781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.492153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.508340 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56b54f53-240b-4860-9612-157ac0a99ff9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1267 microversion: 2.1 time: 0.251602 Oct 04 21:16:06.513173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2359/4800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:06 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:06.522971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:06.524728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:06.555012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.559606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.574161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.576091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.580012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.581797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.847059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.859831 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d9d2542-5b61-49fe-9525-4cafebc4e3e2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1509 microversion: 2.1 time: 0.978355 Oct 04 21:16:06.875855 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2442/4801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:05 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1509 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:06.880975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:06.884775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180cc3e5-60ff-4e37-b317-2eed854a53d3", "name": "network-vif-plugged", "status": "completed", "tag": "f44be311-b657-4f63-b7ff-a1c77855f3a8"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:06.903628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fd0cce5d-3b00-411d-a6e8-e8e29a7a9eb4 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1471 microversion: 2.1 time: 0.388407 Oct 04 21:16:06.904539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.906343 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2360/4802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:06 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:06.907338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.908487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.917785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:06.919461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:06.934580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.936293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.937743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.939674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:06.941419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:06.943499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:06.962934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] Creating event network-vif-plugged:f44be311-b657-4f63-b7ff-a1c77855f3a8 for instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 on n-h1-851029-13 Oct 04 21:16:06.985435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2d40756a-033c-4df4-9fdf-9c4555880aeb req-d09c2888-9ac1-4b4f-9dcc-cac2b882e858 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107344 Oct 04 21:16:06.986605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2443/4803] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:07.000024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.000969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.012523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.013290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.014246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.015731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.017005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.018424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.280934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3027daba-ec44-43a1-9e70-dc015accbd4c tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1624 microversion: 2.1 time: 0.291286 Oct 04 21:16:07.281910 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2444/4804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:06 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1624 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:07.325916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.327206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.342867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.344875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.346460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.349237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.350598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.351832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.411617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:07.424648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3527f65a-b136-4d75-9fe9-d2b0d528f53a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 0.515844 Oct 04 21:16:07.437861 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2361/4805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:06 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:07.569465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.570414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.581251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:07.589103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.589758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.591801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.594618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.598222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.598222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.641150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96d5aaa5-e7fe-4a08-9fdf-81e7b9380713 tempest-TestSecurityGroupsBasicOps-458309582 tempest-TestSecurityGroupsBasicOps-458309582-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1912 microversion: 2.1 time: 0.322773 Oct 04 21:16:07.642540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2445/4806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:07 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1912 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:07.752474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:07.780355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:07.785648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4e7c845-6901-4a7f-baa9-bbc5c7c35b10 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1267 microversion: 2.1 time: 0.225061 Oct 04 21:16:07.788449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.788986 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2362/4807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:07 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:07.789994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.801343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:07.808994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.810009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.810993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.818250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.818250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.818250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.854882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:07.899735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:07.905000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:07.913882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.914553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.915256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:07.916136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:07.916847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:07.917633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.183537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.200345 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d841cb22-1fef-4ecc-bce8-65b00663fb54 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1513 microversion: 2.1 time: 0.307965 Oct 04 21:16:08.201474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2363/4808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:07 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:08.265273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:08.277615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.279129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.servers [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Removing options 'limit' from query {{(pid=123542) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 21:16:08.280672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:08.282788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.283696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.284617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.286231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.286972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.287760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.290487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5ae4e6b8-6b70-45bc-a7a2-1d73ba798f5f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.037523 Oct 04 21:16:08.294726 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2364/4809] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 4 21:16:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 21:16:08.310366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:08.314267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:08.323507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.324302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.325290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.326730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.326923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.327548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.446473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39cd9b09-8650-4b6b-b8c3-d13ccbfa6bc5 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 204 len: 0 microversion: 2.1 time: 0.661271 Oct 04 21:16:08.449067 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2446/4810] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:07 2022] DELETE /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:08.503056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:08.521563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:08.560693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.560693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.560693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.560693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:08.560693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:08.561530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:08.957181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:08.990007 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac47a8c6-1045-4036-85ac-cb281f26b120 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1513 microversion: 2.1 time: 0.687741 Oct 04 21:16:09.037900 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2365/4811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:08 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1513 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:09.050793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:09.052905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:09.085852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.087305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.095211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.104198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:09.104198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:09.104198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:09.218952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:09.947214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:09.956846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:10.001168 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97dc8c31-565e-4270-8b47-ac171bea662d tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1313 microversion: 2.1 time: 1.536494 Oct 04 21:16:10.003640 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2447/4812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:08 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1313 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.013268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:10.018462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:10.052339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.062956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.065649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.069502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.073318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.075030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.079014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:10.084041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:10.098269 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21160d99-7b77-42b3-b146-21bd4f073a10 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1477 microversion: 2.1 time: 1.056983 Oct 04 21:16:10.099686 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2366/4813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:09 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1477 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.116313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:10.123096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:10.144183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.147429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.148956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.151905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.154044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.155544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.818205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:10.841642 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b09191f8-85f2-4d13-8a72-74b5be7ee7f9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.835860 Oct 04 21:16:10.843393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2448/4814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:10 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.855001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:10.881828 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f0e741c-3fe8-441f-b444-b32259ff04f2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1513 microversion: 2.1 time: 0.779447 Oct 04 21:16:10.895449 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2367/4815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:10 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:10.915192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:10.916213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:10.924322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.931544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.931544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.931544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:10.931544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:10.931544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:10.989041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:11.067925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:11.075078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:11.084066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.088568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.092839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.094915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.096245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.098724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.595867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.613731 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a383025-4374-4c90-a439-f9996ce65c6a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1511 microversion: 2.1 time: 0.702212 Oct 04 21:16:11.639050 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2449/4816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:10 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1511 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:11.652795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:11.652795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:11.673195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.675517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.679584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.681990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:11.682914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:11.686169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:11.725186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.755372 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-24e03b74-9e4b-47f6-aa4c-858ba9b14336 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1499 microversion: 2.1 time: 0.698722 Oct 04 21:16:11.797833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2368/4817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:11 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1499 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:11.816766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:11.844498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:11.845959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:12.239766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:12.303716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5406cc32-bb15-4c8e-9479-16de8f533229 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1477 microversion: 2.1 time: 0.667208 Oct 04 21:16:12.308495 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2450/4818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:11 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1477 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:12.315558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.328001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.332192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.341101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.347609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.354362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.368337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.449842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_groups [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Querying cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) for 1 instances {{(pid=123541) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:16:12.452482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.454010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.455205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.585146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87a0c524-4cc1-4de2-b425-73b242ec96a3 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076" status: 200 len: 222 microversion: 2.1 time: 0.258134 Oct 04 21:16:12.587066 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2451/4819] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076 => generated 222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:12.601954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.606448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:12.628616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.630554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.632008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.633841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.635381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.637349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.819982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:13.074419 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf5a4bfd-e1b0-45dc-85d7-d228f7917d6e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 1.270808 Oct 04 21:16:13.076225 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2369/4820] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 4 21:16:11 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.085913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.091568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:13.104304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.106424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.109924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.117076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.118175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.119148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.226626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:13.486434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:13.514591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65919563-f6b5-421e-909d-bcb8ffc98dfc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.919011 Oct 04 21:16:13.516853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2452/4821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:13.558700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.560388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:13.571190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.572565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.573702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.575965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.576911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.577682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.933148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4cbb981-3a00-4bdd-bca9-6dbc20268d43 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 204 len: 0 microversion: 2.1 time: 0.854544 Oct 04 21:16:13.940266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2370/4822] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:13 2022] DELETE /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:13.995194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:14.005228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:14.029580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.030492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.033584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.038275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.052072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.053121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.153315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:14.208749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c550f08f-ce7f-4570-aaab-d63bcc93a20e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1513 microversion: 2.1 time: 0.673104 Oct 04 21:16:14.212806 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2453/4823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1513 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:14.260773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7d3ad-1984-4edd-b80b-b61f6d4aadcf", "name": "network-vif-deleted", "tag": "83382096-2b27-4caf-ae9d-403b45f6305d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:14.327015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.327968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.328763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.356702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] Creating event network-vif-deleted:83382096-2b27-4caf-ae9d-403b45f6305d for instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf on n-h2-851029-13 Oct 04 21:16:14.369135 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6dcf3c16-40c0-4598-95ff-e3b0da9bc30f req-b7ed79c6-8a5a-4890-863e-a74fa98fa843 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147903 Oct 04 21:16:14.370906 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2454/4824] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:14.382036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:14.384406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:14.417005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.425832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.427325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.429339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.430885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.432255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.485027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:14.514962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89b37a54-a6c7-4cbf-9a92-d79633a94b49 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 200 len: 1325 microversion: 2.1 time: 0.572058 Oct 04 21:16:14.516842 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2371/4825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:14.549146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:14.550956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:14.575937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.578295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.595963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:14.597987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:14.599643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:14.601160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.238010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:15.263942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:15.270134 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60535cbf-9397-41e3-bcd5-02f5d6dda61b tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1513 microversion: 2.1 time: 0.747075 Oct 04 21:16:15.302885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2372/4826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:14 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1513 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:15.327760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:15.330131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f77c96c5-ab88-4054-931e-e236141b6387 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1505 microversion: 2.1 time: 0.956937 Oct 04 21:16:15.336403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2455/4827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:14 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1505 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:15.336659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:15.356110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:15.362441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:15.367108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.371740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.372140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.375364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.378988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.382714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.395326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.396909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.400888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:15.405855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:15.409279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:15.410495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.232688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.253383 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f03b45a8-b5ac-4cbb-95ac-d7879fa3354b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.948100 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2373/4828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:15 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] HTTP exception thrown: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Request method failure captured: Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf HTTP/1.1 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKGiS7l6yCcJwL8Fcfbix31aCkr4enektDtS7Lm0bskGgS8bW_Lxpkg-cINA8DZL351fGhs5x9okB_NNWLKj3vlB3WbwpALrJesMBC87CtxX2JnrHYkdTofn12nt9OA16x0pMBOJW22lWhoi6wSSAIgd1KPbJRTW_uDx-GWOILJbcag Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2fdec3b9a14e49f7b5392a82d19af772 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:16.373459 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2fdec3b9a14e49f7b5392a82d19af772 Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestSecurityGroupsBasicOps-1136592078-project Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: e74b98e16c47438eb09af538c57f4e6b Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1136592078-project Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '17d7d3ad-1984-4edd-b80b-b61f6d4aadcf'} Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. Oct 04 21:16:16.378947 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:16.395346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Returning 404 to user: Instance 17d7d3ad-1984-4edd-b80b-b61f6d4aadcf could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:16.395346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afabf997-69b2-46b2-8b1b-c85f4dd87b64 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf" status: 404 len: 111 microversion: 2.1 time: 0.071121 Oct 04 21:16:16.395346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2374/4829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/17d7d3ad-1984-4edd-b80b-b61f6d4aadcf => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:16.395968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.396749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.396749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:16.397128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19869cfa-8207-4ecd-90d5-bdff7ad133ef tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1511 microversion: 2.1 time: 1.059856 Oct 04 21:16:16.398589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2456/4830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:15 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1511 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:16.409088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.410021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.410929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.412475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.413481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.414223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.442918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:16.461313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.476871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:16.496288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.496288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.497286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.509722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.511995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.517802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:16.621481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:16.674506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:16.822959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:16.850609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:16.852373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:16.860405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.480009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aecc831a-fe44-4dff-b7b0-39bf10d83372 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 1.042043 Oct 04 21:16:17.481185 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2457/4831] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:17.502045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7251a32f-3119-4f18-b2f9-5cea58058cee", "tag": "6eacd1cd-acb4-4ca4-8f4c-90d022e74733"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:17.519297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:17.556850 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-de783586-9d3a-4677-96fd-0946557e35a0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1505 microversion: 2.1 time: 1.177841 Oct 04 21:16:17.560105 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2375/4832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:16 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1505 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:17.561801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.563128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.570581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.582084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:17.588417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:17.622898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.628494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.629280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.630504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.634052 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] Creating event network-changed:6eacd1cd-acb4-4ca4-8f4c-90d022e74733 for instance 7251a32f-3119-4f18-b2f9-5cea58058cee on n-h2-851029-13 Oct 04 21:16:17.635525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.640189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.659470 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5614bf1b-6a4c-4fff-af60-8100e97966b6 req-c3c79fa1-acf0-4953-adfd-162aa3440df9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175906 Oct 04 21:16:17.667330 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2458/4833] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:17.699849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180cc3e5-60ff-4e37-b317-2eed854a53d3", "name": "network-vif-deleted", "tag": "f44be311-b657-4f63-b7ff-a1c77855f3a8"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:17.723506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:17.727352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:17.728254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:17.789289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] Creating event network-vif-deleted:f44be311-b657-4f63-b7ff-a1c77855f3a8 for instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 on n-h1-851029-13 Oct 04 21:16:17.814616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-856963cb-26b3-483d-b9ea-2bb2d592dcce req-ee9442a7-ed93-42be-a8d5-1eae7ce828c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144882 Oct 04 21:16:17.816760 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2459/4834] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:17.828449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:17.837778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:17.840361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:18.128593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.131163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.135530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.135530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.138783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.144367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.207521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.242160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3a26229-07c8-4878-986f-66864df936dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.677789 Oct 04 21:16:18.255074 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2376/4835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:17 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.459674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:18.605924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.608443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:18.626782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.627741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.628550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.629869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.630592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.631283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.746312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.747693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.750175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.752561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lazy-loading 'fault' on Instance uuid 180cc3e5-60ff-4e37-b317-2eed854a53d3 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:18.777329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-410da7dd-3702-445c-849d-e490e15f413d tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.950160 Oct 04 21:16:18.778358 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2460/4836] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 4 21:16:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:18.800107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:18.828743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.835715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:18.871590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.875280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.876567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.880987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:18.884944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:18.886646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:18.911079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c9d099e0a849baae08b8ffa9b94f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f95a76923ed4d8e9fdd18dcdd0b943c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:18.936020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3715d40c-3435-49b5-a137-c47e2e49ed6a tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 200 len: 1303 microversion: 2.1 time: 0.336724 Oct 04 21:16:18.959884 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2377/4837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 1303 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:19.360409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1488313726", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:19.471626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:19.472784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:19.474003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:19.475118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:19.476172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:19.496648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.498010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.499172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.502414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.504095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.505206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.548629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Getting quotas for project f4ed8236ef344940a3cd9d52eb8aa735. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:19.561631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Getting quotas for user dedd2ba2e9954f44b1c74d2ba5743668 and project f4ed8236ef344940a3cd9d52eb8aa735. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:19.602217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:19.608080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:19.759013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:19.891993 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8dd76a8-2c9b-4477-a59a-e65df9582788 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 1.100731 Oct 04 21:16:19.893505 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2461/4838] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 4 21:16:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:19.905765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.905765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:19.916917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.918384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.919225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.920581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:19.921464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:19.922308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:19.956452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8642ffd-13e3-4ff4-b2e4-094603b5cbeb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.918272 Oct 04 21:16:19.969057 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2378/4839] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 21:16:19.976508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:19.994893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.004197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:20.014716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.016831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.018001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.019548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.021840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.022484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.266939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:20.273689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:20.289735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.308487 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe6216ac-16e9-41fb-93fb-13d3bb2e0608 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.412898 Oct 04 21:16:20.324381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2462/4840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:20.324381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.324381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.488930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.503242 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fe604dd-f57f-4844-8ad3-6452178688db tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.542471 Oct 04 21:16:20.504274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.505433 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2379/4841] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Oct 4 21:16:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:20.508201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.511587 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36753d95-3e66-4777-bdd4-df525ae096dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 200 len: 1278 microversion: 2.47 time: 0.199177 Oct 04 21:16:20.543125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.543125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:20.544007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2463/4842] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:20.544211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.544211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.544211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.544707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.556051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.556051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.595055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.611823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:20.617533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 HTTP/1.1 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '180cc3e5-60ff-4e37-b317-2eed854a53d3'} Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:20.622100 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:20.638319 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a3d9842b-36d9-4204-a0a0-8298754f9db2 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 404 len: 111 microversion: 2.1 time: 0.117797 Oct 04 21:16:20.643836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2380/4843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:20.644110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': '2125231013', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:20.652463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:20.670316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.673861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.678172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.680142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.684904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.686537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.688136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.server_groups [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Querying cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) for 1 instances {{(pid=123542) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:16:20.689369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.690214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.691005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.716822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e738d88-5f18-4af9-a2a9-c34d20a0e616 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.075968 Oct 04 21:16:20.724685 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2381/4844] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:20.735761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1661089505", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:20.877301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:20.879030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:20.880311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:20.881739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:20.884088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:20.916540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:20.938832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.946705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.946705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:20.946705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:20.946705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:20.951471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.007537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Getting quotas for project f4ed8236ef344940a3cd9d52eb8aa735. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:21.031629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Getting quotas for user dedd2ba2e9954f44b1c74d2ba5743668 and project f4ed8236ef344940a3cd9d52eb8aa735. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:21.071859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:21.082352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:21.119824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f99a7ea5-5db3-4786-b146-e32e0e03ce1c tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=2125231013" status: 200 len: 346 microversion: 2.1 time: 0.589215 Oct 04 21:16:21.121044 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2464/4845] 10.222.0.36 () {58 vars in 1156 bytes} [Tue Oct 4 21:16:20 2022] GET /compute/v2.1/servers?name=2125231013 => generated 346 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:21.130335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.159277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_groups [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Querying cell 53a07c22-f558-466a-be6a-02b63f0f6ed3(cell1) for 1 instances {{(pid=123541) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 21:16:21.161139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.162369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.163526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.191614 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f4fde45-627e-4000-afc0-d8e0a3a7fd2c tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076" status: 200 len: 184 microversion: 2.1 time: 0.067244 Oct 04 21:16:21.193454 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2465/4846] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076 => generated 184 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:21.205631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.217014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:21.218906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:21.230164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.231674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.232772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.234596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.250095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.250095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.388925 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f482f9d-affb-442c-94f0-ff314516858c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.661567 Oct 04 21:16:21.391230 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2382/4847] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:16:21.402996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.404009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.432691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.436312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.437208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.444342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.449750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.460403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.476034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 HTTP/1.1 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '180cc3e5-60ff-4e37-b317-2eed854a53d3'} Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:21.531530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.544177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:21.549143 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb74ed36-7365-4105-9418-ffb74fd6b280 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 404 len: 111 microversion: 2.1 time: 0.150369 Oct 04 21:16:21.555964 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2383/4848] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:21 2022] DELETE /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:21.585097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.586481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.625956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.630822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.636958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.636958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.638321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.642078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.673860 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-119cf7b3-d472-475f-b3d8-b0cf0ba8e267 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.477098 Oct 04 21:16:21.675688 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2466/4849] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:21.685159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cff75436-f2be-44d6-bdc9-48766ad62699 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:21.692312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cff75436-f2be-44d6-bdc9-48766ad62699 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.788159 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cff75436-f2be-44d6-bdc9-48766ad62699 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "PUT /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 992 microversion: 2.47 time: 0.109568 Oct 04 21:16:21.789789 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2467/4850] 10.222.0.36 () {62 vars in 1297 bytes} [Tue Oct 4 21:16:21 2022] PUT /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 992 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:16:21.800534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.802883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] [instance: 180cc3e5-60ff-4e37-b317-2eed854a53d3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:21.818408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.819581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.820672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.828432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.828432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.828432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.862762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 HTTP/1.1 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '180cc3e5-60ff-4e37-b317-2eed854a53d3'} Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:21.867954 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance 180cc3e5-60ff-4e37-b317-2eed854a53d3 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:21.883111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44c3715c-7c85-498e-a2eb-42451817abd0 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3" status: 404 len: 111 microversion: 2.1 time: 0.080152 Oct 04 21:16:21.887814 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2468/4851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/180cc3e5-60ff-4e37-b317-2eed854a53d3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:21.898598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:21.913592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:21.916046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-212523101', 'deleted': False, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:16:21.930620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.933718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.937038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:21.940834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:21.942903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:21.944667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.305584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:16:22.476063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.496750 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3fa3ccf3-3e48-4827-867f-b87afff80264 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-212523101" status: 200 len: 346 microversion: 2.1 time: 0.604918 Oct 04 21:16:22.514772 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2469/4852] 10.222.0.36 () {58 vars in 1228 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-212523101 => generated 346 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:22.523531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f0b36e0-4b65-46f0-a500-aa5cbbd7c697 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.965411 Oct 04 21:16:22.545577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2384/4853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:21 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:22.562468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.566439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:22.579705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d69946c5-a2cb-49d3-a8d0-32ae9c645926 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.599213 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d69946c5-a2cb-49d3-a8d0-32ae9c645926 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d69946c5-a2cb-49d3-a8d0-32ae9c645926 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-server-groups/38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 HTTP/1.1 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814'} Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.604299 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.615070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d69946c5-a2cb-49d3-a8d0-32ae9c645926 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance group 38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:22.620158 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d69946c5-a2cb-49d3-a8d0-32ae9c645926 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814" status: 404 len: 117 microversion: 2.1 time: 0.057447 Oct 04 21:16:22.620158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2385/4854] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/os-server-groups/38fdbfeb-e6bc-4c2d-b0e7-f783d1f3f814 => generated 117 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:22.630435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.631604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:22.650229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.651352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.659006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.659006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:22.659006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:22.659006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:22.718418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:22.749242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.767285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.771991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:22.774555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee56da92-b5a8-4f50-8368-488097f45000 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1278 microversion: 2.47 time: 0.256570 Oct 04 21:16:22.775917 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2470/4855] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:22 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:22.812753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b88852a7-af4c-4fbe-a5a5-9679751d9325 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.824991 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b88852a7-af4c-4fbe-a5a5-9679751d9325 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b88852a7-af4c-4fbe-a5a5-9679751d9325 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-server-groups/cdd96251-c468-4015-a9af-3a909e4b7bdf HTTP/1.1 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'cdd96251-c468-4015-a9af-3a909e4b7bdf'} Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.829913 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b88852a7-af4c-4fbe-a5a5-9679751d9325 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance group cdd96251-c468-4015-a9af-3a909e4b7bdf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:22.847492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b88852a7-af4c-4fbe-a5a5-9679751d9325 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/cdd96251-c468-4015-a9af-3a909e4b7bdf" status: 404 len: 117 microversion: 2.1 time: 0.048070 Oct 04 21:16:22.849997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2471/4856] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/os-server-groups/cdd96251-c468-4015-a9af-3a909e4b7bdf => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:22.862582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f670209c-ed0c-43af-9f30-59352ae38498 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.875375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f670209c-ed0c-43af-9f30-59352ae38498 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f670209c-ed0c-43af-9f30-59352ae38498 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-server-groups/fa69e6a1-0b84-46de-b250-214bc316b995 HTTP/1.1 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fa69e6a1-0b84-46de-b250-214bc316b995'} Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.879552 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f670209c-ed0c-43af-9f30-59352ae38498 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance group fa69e6a1-0b84-46de-b250-214bc316b995 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f670209c-ed0c-43af-9f30-59352ae38498 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/fa69e6a1-0b84-46de-b250-214bc316b995" status: 404 len: 117 microversion: 2.1 time: 0.035659 Oct 04 21:16:22.900248 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2472/4857] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/os-server-groups/fa69e6a1-0b84-46de-b250-214bc316b995 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:22.913086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-460d0c6a-179a-46da-b823-b1d41bbb6b04 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:22.934136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-460d0c6a-179a-46da-b823-b1d41bbb6b04 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] HTTP exception thrown: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-460d0c6a-179a-46da-b823-b1d41bbb6b04 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Request method failure captured: Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-server-groups/63450619-c8d7-4489-ab8b-909d545bd012 HTTP/1.1 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKJnwzFu5fZfDUR-S0aQZoxwotcr1q89RjDQmn7KSI6BIYY_zx4LwDhNuimmGbu9IKHuqPP61tVgdpicpu8WzyzappBoGAGiYqLcHQDWS19KCEpcN8ndaN0vqrI_0vVPvpcvMbw_m4oLQHd6p58vQZpz608BR3cCPtqyB1Ju-GuOYdg Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f95a76923ed4d8e9fdd18dcdd0b943c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0f95a76923ed4d8e9fdd18dcdd0b943c Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerGroupTestJSON-1385368873 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d4c9d099e0a849baae08b8ffa9b94f20 Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerGroupTestJSON-1385368873-project Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '63450619-c8d7-4489-ab8b-909d545bd012'} Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.937609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. Oct 04 21:16:22.946342 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:22.951357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-460d0c6a-179a-46da-b823-b1d41bbb6b04 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Returning 404 to user: Instance group 63450619-c8d7-4489-ab8b-909d545bd012 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:22.951357 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-460d0c6a-179a-46da-b823-b1d41bbb6b04 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/63450619-c8d7-4489-ab8b-909d545bd012" status: 404 len: 117 microversion: 2.1 time: 0.045674 Oct 04 21:16:22.953064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2473/4858] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/os-server-groups/63450619-c8d7-4489-ab8b-909d545bd012 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:22.966387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22b535d8-94e6-4dd2-8a0f-412fa7e25d86 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.160188 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22b535d8-94e6-4dd2-8a0f-412fa7e25d86 tempest-ServerGroupTestJSON-1385368873 tempest-ServerGroupTestJSON-1385368873-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076" status: 204 len: 0 microversion: 2.1 time: 0.199754 Oct 04 21:16:23.161298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2474/4859] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/os-server-groups/718f21c4-8244-4a41-9d1f-a72a5e91f076 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:23.404500 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86727ae4-52dd-4088-b5c9-18c02636e6da tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 204 len: 0 microversion: 2.1 time: 0.780622 Oct 04 21:16:23.405453 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2386/4860] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:22 2022] DELETE /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:23.421034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.421967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.438239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.439264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.440301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.442150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.443106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.444643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.598986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.601021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.668163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.677346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.679578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.686701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.690642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.692030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.843844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:23.905580 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1998b955-f480-44c4-9cae-0092d23b5de0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1517 microversion: 2.1 time: 0.454947 Oct 04 21:16:23.905580 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2475/4861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1517 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:23.908209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:23.917771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:23.935849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.938269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.939589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:23.941522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:23.942978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:23.944313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.196363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:24.237500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:24.248037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:24.251181 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e663ffd-90b3-4279-a514-5db39100630c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1282 microversion: 2.47 time: 0.366167 Oct 04 21:16:24.272051 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2476/4862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1282 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:24.281240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:24.309273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fa1f5cb-3e4a-4985-8ca7-fe9b1e19ec2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.728474 Oct 04 21:16:24.313205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2387/4863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:23 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:24.328222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7251a32f-3119-4f18-b2f9-5cea58058cee", "name": "network-vif-plugged", "status": "completed", "tag": "6eacd1cd-acb4-4ca4-8f4c-90d022e74733"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:24.376699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.378889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.381189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.421356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] Creating event network-vif-plugged:6eacd1cd-acb4-4ca4-8f4c-90d022e74733 for instance 7251a32f-3119-4f18-b2f9-5cea58058cee on n-h2-851029-13 Oct 04 21:16:24.438345 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-49ba3262-a626-465a-8dbf-cbea909613a7 req-aa02e0c4-01d8-4688-915e-11fef5f5344c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115463 Oct 04 21:16:24.438345 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2477/4864] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:24.922590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:24.925159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:24.938749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.940272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.941720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:24.943798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:24.945177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:24.946523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.325688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:25.327643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:25.344880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.345866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.347639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.350368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.351742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.352942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.551260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:25.625520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:25.636335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:25.638192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-187e391d-7685-4b60-b69d-ff949d3f6a70 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1274 microversion: 2.47 time: 0.332624 Oct 04 21:16:25.639365 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2478/4865] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:25 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:25.656317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:25.658068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:25.659600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:25.691025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a514a1c-e5a2-4818-9a16-d1519933d90f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1517 microversion: 2.1 time: 0.781389 Oct 04 21:16:25.694697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.696421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.702937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2388/4866] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:24 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1517 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:25.711070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:25.728141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:25.728141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:25.728141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.201391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:26.229297 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-951ecc02-109e-4d67-b069-0b8a111ca29e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1309 microversion: 2.1 time: 0.587093 Oct 04 21:16:26.241046 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2479/4867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:25 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1309 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:26.601452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4", "name": "network-vif-deleted", "tag": "ec8c0430-b15c-463c-95c8-02f2cbd0b2fd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:26.652185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.653598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.659996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.717078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:26.724219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:26.744347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.746616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.748359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.750444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.753868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] Creating event network-vif-deleted:ec8c0430-b15c-463c-95c8-02f2cbd0b2fd for instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 on n-h1-851029-13 Oct 04 21:16:26.754931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.777387 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a1e8577e-7481-4304-a5a5-5c36a6b071e7 req-638a19e9-d4a8-4b66-afc1-f06b82e44fc8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204163 Oct 04 21:16:26.777997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.787228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2389/4868] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:26.810698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:26.814021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:26.844539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.865822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.867220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:26.868886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:26.870178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:26.871828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.132030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.136536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.153216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e82e3bbf-de3b-4357-89bf-dc19159ed96e tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1475 microversion: 2.1 time: 0.363216 Oct 04 21:16:27.159945 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2390/4869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:26 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1475 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:27.204101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.208136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.212771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49c84fe0-a8f6-43b0-ba77-d804f77c6b92 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1330 microversion: 2.47 time: 0.514423 Oct 04 21:16:27.218362 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2480/4870] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:26 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1330 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:27.299331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:27.301317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.328064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.329468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.331307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.333007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.336451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.337779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.691413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:27.712768 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb7243ac-6694-4d2e-93e0-2f0f3cfdb508 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1490 microversion: 2.1 time: 0.418442 Oct 04 21:16:27.730712 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2391/4871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:27 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1490 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:27.762911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:27.767923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:27.780978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.787835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.787835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.787835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:27.787835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:27.787835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:27.861965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:28.058238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f89b5166-fa09-43ef-b027-a0ea1dbf7e23 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "PUT /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1085 microversion: 2.1 time: 0.303631 Oct 04 21:16:28.060311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2481/4872] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:16:27 2022] PUT /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1085 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:28.097482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.099433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:28.116365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:28.119647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.121950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.123479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.125672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.127169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.128356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.211743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.214723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:28.231317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.232222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.233001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.234310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.235169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.235976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.316752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:28.326462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.327396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.328180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.329039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:28.517896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:28.540165 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd60ea8e-e002-4ce6-9890-376ff302ba42 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1310 microversion: 2.1 time: 0.337783 Oct 04 21:16:28.546318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2482/4873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1310 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:28.565992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:28.567795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:28.612774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.614206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.615455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:28.617147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:28.619460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:28.622140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.407829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:29.455416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:29.469786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:29.469786 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c16c57b-5e9c-4dec-8f50-ac40aabd01e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1338 microversion: 2.47 time: 0.918423 Oct 04 21:16:29.469786 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2483/4874] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1338 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:29.604117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:29.606195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.631955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.635911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.636609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:29.650171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.652410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.653778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.654525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.679884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b782b76c-8413-412f-af3e-f73bccd528b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1511 microversion: 2.1 time: 1.591126 Oct 04 21:16:29.682927 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2392/4875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:28 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1511 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:29.739307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.739307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.739307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.739307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:29.747262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:29.748845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:29.790120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.792932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.795765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.800538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:29.808618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:29.812809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:29.958269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.006954 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26dfca27-bd5e-47a3-8c2d-aec60ea4b7f0 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1310 microversion: 2.1 time: 0.418467 Oct 04 21:16:30.025130 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2484/4876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:29 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1310 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:30.297372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.316499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99d44fa0-1733-4d4a-b2cb-2d925cb0fd42 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1511 microversion: 2.1 time: 0.583605 Oct 04 21:16:30.320628 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2393/4877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:29 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:30.392435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:30.392435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:30.404953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.406534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.407770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.410465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.412995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.416124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.479622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:30.526794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:30.528541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:30.546449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.548262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.550436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.553079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:30.554566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:30.555904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:30.701947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.723813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.730596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:30.733271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6278885-d256-452b-91f7-948d746adbcb tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1336 microversion: 2.47 time: 0.215198 Oct 04 21:16:30.745206 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2394/4878] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:30 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:31.057077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:31.059278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:31.063431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:31.066200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:31.076281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.077322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.078505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.080543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.081796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.083262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.191744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.192962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.194036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.195167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:31.330437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:31.402811 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-de917db0-5a8f-44c4-9879-1345e114f2a3 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1310 microversion: 2.1 time: 0.352565 Oct 04 21:16:31.404998 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2395/4879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:31 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:31.563686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e71f4e00-3383-4dfa-9b76-fcf779925df9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 204 len: 0 microversion: 2.1 time: 1.175957 Oct 04 21:16:31.575622 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2485/4880] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:30 2022] DELETE /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 0 bytes in 1190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:31.593807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:31.596753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:31.647247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.649186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.653245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.661229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.662320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.664141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.823584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:31.825129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:31.866904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.867704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.873458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:31.877040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:31.879996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:31.895355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.089139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:32.543729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.574423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.584775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.588146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-285f8062-7051-4d09-8fd4-b167ea97789c tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1336 microversion: 2.47 time: 0.796921 Oct 04 21:16:32.616183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2486/4881] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:31 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1336 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:32.638615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:32.639790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:32.655642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.656868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.657786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.660657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.660657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.662039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.693550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.724548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be070635-ea4a-458d-91ec-fbd44fe50b19 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1517 microversion: 2.1 time: 1.140370 Oct 04 21:16:32.725946 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2396/4882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:31 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1517 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:32.756548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:32.782104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:32.782836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:32.783517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:32.784427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:32.879411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:32.911098 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c5e7b26-6fa5-46a7-ad09-416a0a30ee4f tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 200 len: 1310 microversion: 2.1 time: 0.292914 Oct 04 21:16:32.912421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2487/4883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:32 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 1310 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:33.654602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:33.657131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:33.701938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.704285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.707503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.709796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.711430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.712922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.791881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:33.796894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:33.835987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.836663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.837512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.843539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:33.856966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:33.856966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:33.999915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:34.031650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:34.036423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:34.045953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7d67915-005d-46b9-bc1e-414bfc5152b2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1336 microversion: 2.47 time: 0.405190 Oct 04 21:16:34.050388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2397/4884] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:33 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1336 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:34.077905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:34.080398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:34.114354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.120185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.121435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.124741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.133220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.134406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.146431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:34.174864 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] HTTP exception thrown: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Request method failure captured: Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 HTTP/1.1 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKIqzq14aSuJZKD5xGxoDOpkDqyRbMIuvxCQxnPQoyyU9C1dSc2j2ovF7yyoqiaIWB4bGNlYwi10gLpKGsJxykxgrw7pz0CG1ffl1gjXPXRYF2R1VUyBo65s-vWNs4tIMWWnI9nCrGTw_28CIyLwE5A8c5iUW_IxJTk7f-aeJK_-O_o Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b89accd9547e464b8b7557ca7474025c Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4'} Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:34.179051 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. Oct 04 21:16:34.187978 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:34.191862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Returning 404 to user: Instance 1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:34.194265 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fed8de6-5940-4451-b687-2d473fc7ca08 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4" status: 404 len: 111 microversion: 2.1 time: 0.140351 Oct 04 21:16:34.196295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2398/4885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:34 2022] GET /compute/v2.1/servers/1a9aa11b-ca70-4e4a-9396-ef769c1e5ce4 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:34.207248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:34.208948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:34.219612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.221284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.223606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.225752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.227820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.231661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.300617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:34.615604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:34.632628 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-572ee3c9-d3e2-4579-b530-cf2b8144d668 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1517 microversion: 2.1 time: 0.865129 Oct 04 21:16:34.633755 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2488/4886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:33 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1517 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:34.893046 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b815979b-b5d3-4bc7-a026-9cfddd0725a2 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 204 len: 0 microversion: 2.1 time: 0.690094 Oct 04 21:16:34.894912 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2399/4887] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:34 2022] DELETE /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:34.908677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:34.909961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:34.937785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.943153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.943153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:34.943153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:34.943153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:34.945089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.130522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:35.136413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:35.148829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.149685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.150503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.151928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.153229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.155537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.412914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.464883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.468234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.470651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1cf761ff-2bb0-47e2-9d0d-72762c8c9d60 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1357 microversion: 2.47 time: 0.362102 Oct 04 21:16:35.472803 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2400/4888] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:35 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1357 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:35.537973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:35.568961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:35.593786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.595080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.600274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.600274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.600274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.600274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.629573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:35.679161 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bae82f9-91a5-4386-b56c-7051bf8318c7 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1519 microversion: 2.1 time: 0.771461 Oct 04 21:16:35.686307 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2489/4889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:34 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1519 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:35.744320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:35.749226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:35.788748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.789666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.790495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:35.815099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:35.819178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:35.839266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.128904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:36.139479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:36.142571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:36.146981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:36.156418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:36.780336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:36.801830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.802768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.803595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.816219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:36.817393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:36.818244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:36.937509 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dfdf8e81-e88f-49e0-9bd7-49e2bff8f3c6 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "POST /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6/action" status: 202 len: 1079 microversion: 2.47 time: 1.404799 Oct 04 21:16:36.941489 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2401/4890] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:16:35 2022] POST /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6/action => generated 1079 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:16:36.979662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:36.981028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:37.009744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.015748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.016610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.017928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.018807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.019567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.085662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:37.155295 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a76dfe2-909d-458b-b248-d4905b7e4c34 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1517 microversion: 2.1 time: 1.449024 Oct 04 21:16:37.156305 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2490/4891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:35 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1517 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:37.241345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:37.255132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:37.290015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.290796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.301244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.303754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:37.305209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:37.437555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:37.924095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:37.972049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:37.991779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:38.001962 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8a9528c-9987-43b3-bfaa-5a30cf9e13c4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.834188 Oct 04 21:16:38.005906 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2491/4892] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:37 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:38.055592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7251a32f-3119-4f18-b2f9-5cea58058cee", "name": "network-vif-deleted", "tag": "6eacd1cd-acb4-4ca4-8f4c-90d022e74733"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:38.088241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:38.101696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.104707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.107321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.137753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec2a9514-9198-4390-b6ae-6931152fae94 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1519 microversion: 2.1 time: 1.192863 Oct 04 21:16:38.141027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] Creating event network-vif-deleted:6eacd1cd-acb4-4ca4-8f4c-90d022e74733 for instance 7251a32f-3119-4f18-b2f9-5cea58058cee on n-h2-851029-13 Oct 04 21:16:38.145973 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2402/4893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:36 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1519 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:38.155670 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-644dceec-c83c-4e7d-a081-7213b5ef6244 req-23ca03af-0e5a-47f2-9a2a-19e980e65683 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128349 Oct 04 21:16:38.155670 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2492/4894] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:38.224083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:38.228080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:38.252736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.254071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.256642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.261402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.262752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.263718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.422947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:38.424065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:38.424944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:38.426311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid 7251a32f-3119-4f18-b2f9-5cea58058cee {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:38.555843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:38.596262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16d46c6c-6328-412e-ae82-92f6fc4f43dd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1320 microversion: 2.1 time: 0.383085 Oct 04 21:16:38.597846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2403/4895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:38 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:39.084944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.087097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.129173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.130649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.133698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.137497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.138975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.142497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.195862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.198039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.216763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.217791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.218649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.220134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.223073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.224517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.541486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:39.548424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:39.588597 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34c16ff7-4aac-418e-83ee-df159cc925fa tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1477 microversion: 2.1 time: 0.400246 Oct 04 21:16:39.590588 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2404/4896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:39 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:39.601289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:39.607512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:39.617551 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6bfdb188-6daa-4b45-9f2a-57a0f29c6f5e tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.562545 Oct 04 21:16:39.617551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2493/4897] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:39 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:39.651874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:39.654330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:39.684923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.685854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.687364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.695041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.702977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.704302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.817464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:39.818219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:39.818977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:39.825697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lazy-loading 'fault' on Instance uuid 7251a32f-3119-4f18-b2f9-5cea58058cee {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:40.062758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:40.092049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e4b5bb38-2ba1-43ee-aaa4-4642e62ef6ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 200 len: 1320 microversion: 2.1 time: 0.455585 Oct 04 21:16:40.100346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2405/4898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:39 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:40.303826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0515684c-49f4-4eec-8899-9067d1c22bae", "name": "network-vif-deleted", "tag": "5f9e348d-28a9-4827-b82b-736446d58ac4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:40.335835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.337208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.339014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.374307 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] Creating event network-vif-deleted:5f9e348d-28a9-4827-b82b-736446d58ac4 for instance 0515684c-49f4-4eec-8899-9067d1c22bae on n-h2-851029-13 Oct 04 21:16:40.389449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d014aec3-e90c-46b9-8410-a8458c45b4b0 req-2c589529-fcf2-4d34-82e3-f3b71390ffab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092751 Oct 04 21:16:40.391219 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2494/4899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:40.676524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:40.680078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:40.684930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:40.687584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:40.704481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.705845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.707208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.711089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.712683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.714132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.716812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.718271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.722271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.731686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.734856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.740124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.854429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:40.855399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:40.856240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:40.857219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 0515684c-49f4-4eec-8899-9067d1c22bae {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:40.980745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:40.988635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:40.996711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:41.008960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab5c33ee-7da0-4f34-89d0-d983b641af65 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.343076 Oct 04 21:16:41.027934 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2495/4900] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:40 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:41.083720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:41.117664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1a0f22c-e8ce-47f9-9246-180077c94890 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 200 len: 1311 microversion: 2.1 time: 0.484692 Oct 04 21:16:41.118952 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2406/4901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:40 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 1311 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:41.158366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:41.160172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:41.221794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.232807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.232807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.243192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:41.250052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:41.258948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:41.328381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee HTTP/1.1 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7251a32f-3119-4f18-b2f9-5cea58058cee'} Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:41.332261 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:41.346484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:41.349187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d88b2be3-6d8e-4992-b6fa-63a785925bd7 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 404 len: 111 microversion: 2.1 time: 0.197156 Oct 04 21:16:41.350111 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2496/4902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:41 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:41.577711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1536095686", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "aae843aa-6c37-4b3b-82f3-46eb822753d3"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:41.808885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] validate_networks() for [('aae843aa-6c37-4b3b-82f3-46eb822753d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:16:42.060598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:42.065649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:42.081249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.082729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.083938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.085628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.086938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.088692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.170219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:42.321225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:42.338185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:42.349021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:42.349021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20d147e6-cf6c-4f78-a06a-11a54f368573 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.291943 Oct 04 21:16:42.359305 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2497/4903] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:42 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:42.392497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:42.393670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 0515684c-49f4-4eec-8899-9067d1c22bae] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:42.407920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.409719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.410980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.412479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.413552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.415763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.462026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] HTTP exception thrown: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Request method failure captured: Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae HTTP/1.1 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKIqzq14aSuJZKD5xGxoDOpkDqyRbMIuvxCQxnPQoyyU9C1dSc2j2ovF7yyoqiaIWB4bGNlYwi10gLpKGsJxykxgrw7pz0CG1ffl1gjXPXRYF2R1VUyBo65s-vWNs4tIMWWnI9nCrGTw_28CIyLwE5A8c5iUW_IxJTk7f-aeJK_-O_o Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b89accd9547e464b8b7557ca7474025c Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '0515684c-49f4-4eec-8899-9067d1c22bae'} Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:42.466618 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:42.495079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Returning 404 to user: Instance 0515684c-49f4-4eec-8899-9067d1c22bae could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:42.502291 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3baf66a-2c5a-4d79-805e-ed8368643e03 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae" status: 404 len: 111 microversion: 2.1 time: 0.137840 Oct 04 21:16:42.504738 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2498/4904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:42 2022] GET /compute/v2.1/servers/0515684c-49f4-4eec-8899-9067d1c22bae => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:42.523586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:42.524529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:42.537856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.538811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.539925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.541592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:42.543485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:42.544685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:42.639925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:43.636516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a174fc8-28c8-48db-a08d-87211a73bbce tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 204 len: 0 microversion: 2.1 time: 1.122916 Oct 04 21:16:43.642286 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2499/4905] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:42 2022] DELETE /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:43.654703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e982f-b3c7-4da0-be39-33430bbf281a", "tag": "c6ea4b55-921f-4fbf-9c6f-dad152bd920e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:43.702624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.703549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.704357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.749287 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] Creating event network-changed:c6ea4b55-921f-4fbf-9c6f-dad152bd920e for instance a45e982f-b3c7-4da0-be39-33430bbf281a on n-h1-851029-13 Oct 04 21:16:43.765866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1d8fcc39-97a7-41e9-8620-8150ae19abd4 req-41c15bec-e5df-4cee-bcec-60ec071ec3b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120828 Oct 04 21:16:43.767703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2500/4906] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:43.790849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:43.791877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:43.836086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.839359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.841295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.843086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:43.844034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:43.846214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:43.951380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:16:44.296041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:16:44.298134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:16:44.299121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:16:44.300048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:16:44.301075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:16:44.321073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.322164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.323629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.325611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.326942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.327759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.384676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:16:44.405195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Getting quotas for user 6e7e7c55520c48f59cec34c685a91083 and project 42dc68bf379143d0918f3395c2bd67d0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:16:44.442003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:16:44.448264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:16:44.769239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7da20797-0ee9-48e1-87bf-ef803865e65c tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.210278 Oct 04 21:16:44.771565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2407/4907] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:16:44.797411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:44.799402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:44.817166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.818588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.819712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.826615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.827421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.829205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.864032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7e3d652-66f7-4eeb-be5b-63bc4d00989e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 204 len: 0 microversion: 2.1 time: 1.085226 Oct 04 21:16:44.871751 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2501/4908] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:16:43 2022] DELETE /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:16:44.903889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:44.910932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:44.936394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.937398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.938382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:44.940565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:44.942007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:44.943024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.028888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.076902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.080417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.083434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dee95090-0bd9-44b4-b040-dd3272878367 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.309045 Oct 04 21:16:45.109409 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2408/4909] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:44 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:45.141001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5a937fb-491e-44e1-a1e4-d3e178f7ce02 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:45.143470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5a937fb-491e-44e1-a1e4-d3e178f7ce02 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:45.324357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5a937fb-491e-44e1-a1e4-d3e178f7ce02 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.355611 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5a937fb-491e-44e1-a1e4-d3e178f7ce02 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1209 microversion: 2.1 time: 0.242439 Oct 04 21:16:45.368214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2409/4910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:45 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:45.391384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:45.393067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:45.430813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.431651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.433436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.436576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:45.437620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:45.439158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:45.537168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:45.576686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f456a9b-bf74-4014-9a59-6fee878b8717 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1519 microversion: 2.1 time: 0.702122 Oct 04 21:16:45.590717 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2502/4911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:44 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1519 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:46.151114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:46.158093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:46.185711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.191448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.192962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.194731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.195941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.198598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.544893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.603195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.612447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.617429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:46.621407 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40f67264-4441-424b-b636-772c0880a1f9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.479710 Oct 04 21:16:46.649184 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2503/4912] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:46 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:46.667465 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a271650c-1655-4d80-bb42-bd1bf0207da8 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1765 microversion: 2.1 time: 1.286819 Oct 04 21:16:46.672375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2410/4913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:45 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1765 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:46.711568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fe5be58-8490-4020-ace2-0a0b9d04c9dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:46.715063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2fe5be58-8490-4020-ace2-0a0b9d04c9dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:46.725601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:46.729832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:46.766154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.771195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.772459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:46.777228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:46.779874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:46.785838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.123097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2fe5be58-8490-4020-ace2-0a0b9d04c9dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:47.156837 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fe5be58-8490-4020-ace2-0a0b9d04c9dc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1209 microversion: 2.1 time: 0.505292 Oct 04 21:16:47.158140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2504/4914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:46 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1209 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:47.291206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:47.313281 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53461dcf-e43e-4f5d-85c3-610588fd5c3a tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1519 microversion: 2.1 time: 0.631850 Oct 04 21:16:47.330376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2411/4915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:46 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1519 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:47.702287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:47.704327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:47.729986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:47.730765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.732450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.732871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:47.736876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.741159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.746698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.766176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.787647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.792294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.803916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.817986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:47.819618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:47.822698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:47.918497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:48.099001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.121887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.130287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.139706 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7173bda-c81e-4eab-9e33-6634772adf4b tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.442185 Oct 04 21:16:48.148336 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2505/4916] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:47 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:48.201564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.204657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:48.223939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.224951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.225832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.227471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.229236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.232493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.507163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.536170 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-410ad01c-c3b9-40d3-9a81-66bf24f88c2b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1213 microversion: 2.1 time: 0.340935 Oct 04 21:16:48.541328 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2506/4917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:48 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:48.553124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:48.554890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:48.574802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.576067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.577446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.581023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:48.582452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:48.583779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:48.675316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:48.711696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e1599b-8434-47ec-880f-0e06415b716a tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1647 microversion: 2.1 time: 0.986559 Oct 04 21:16:48.716323 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2412/4918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:47 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1647 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:49.002903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.026542 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f79cead4-da75-4a72-978a-3d59dcc94540 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1519 microversion: 2.1 time: 0.481010 Oct 04 21:16:49.027735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2507/4919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:48 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1519 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:49.199285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:49.200240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:49.245199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.246039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.246850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.250501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.261111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.262267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.408927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e982f-b3c7-4da0-be39-33430bbf281a", "name": "network-vif-deleted", "tag": "c6ea4b55-921f-4fbf-9c6f-dad152bd920e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:49.436376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.465162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.465162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:49.468217 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7a3bd54-3707-4739-85b1-c71549ac8d4f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.279031 Oct 04 21:16:49.471043 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2413/4920] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:49 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:49.476795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.478215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.479385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.514083 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] Creating event network-vif-deleted:c6ea4b55-921f-4fbf-9c6f-dad152bd920e for instance a45e982f-b3c7-4da0-be39-33430bbf281a on n-h1-851029-13 Oct 04 21:16:49.517919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d4dc1d64-ec5b-4c10-8aab-11b0ae182f63 req-b324647f-e996-4245-84f0-2d05adf100a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124231 Oct 04 21:16:49.519920 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2508/4921] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:49.600457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:49.600457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:49.644021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.646217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.652413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.660093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.661325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.662427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.767977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:49.772588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:49.809813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.819217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.820296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:49.821686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:49.822569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:49.823395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.108962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.173177 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc833914-3e84-4701-9890-f294753c952a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1261 microversion: 2.1 time: 0.589310 Oct 04 21:16:50.179159 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2414/4922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:49 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1261 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:50.200489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:50.207359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:50.250504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.256791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.258554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.265490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.267618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.268923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.278695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.321999 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4cbf5e9e-4f71-45d9-9d0d-0294ca0b2bfa tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1379 microversion: 2.1 time: 0.566039 Oct 04 21:16:50.329117 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2509/4923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:49 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1379 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:50.528826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:50.533852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:50.565652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.566517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.567888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.569278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.570952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:50.572235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:50.573078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:50.600190 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c8c4fed-ecc3-4bd1-a19c-3b8f1f80fdeb tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1306 microversion: 2.1 time: 0.417111 Oct 04 21:16:50.605008 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2415/4924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:50 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1306 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:50.884366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.909074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.914012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:50.917823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcde471d-cc8c-489b-8683-1bf3a9cf0ca5 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.396672 Oct 04 21:16:50.919824 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2510/4925] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:50 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:51.239277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:51.256757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:51.278903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.282536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.283969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.298121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.299585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.304285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.372040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:51.372990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:51.416560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.420758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.428064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.433340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.433340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.433340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.575625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.577716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.578880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.580233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lazy-loading 'fault' on Instance uuid a45e982f-b3c7-4da0-be39-33430bbf281a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:51.806174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:51.852058 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c305b98-9612-4b5d-98d1-fbc34d1280fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1279 microversion: 2.1 time: 0.626163 Oct 04 21:16:51.875336 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2416/4926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:51 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1279 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:51.876494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74b98e16c47438eb09af538c57f4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fdec3b9a14e49f7b5392a82d19af772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:51.901390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c585110-d7ab-4468-971f-31674088f042", "name": "network-vif-deleted", "tag": "6690df07-edb9-400e-8a13-7d87a2dbff51"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:51.904855 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea392de8-7d0e-473a-826c-30e92cbe0c32 tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 200 len: 1384 microversion: 2.1 time: 0.541287 Oct 04 21:16:51.920599 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2511/4927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:51 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 1384 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:51.942708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:51.943992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.948880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.948880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.950635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:51.968613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.976926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.977832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:51.983978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:51.985047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:51.987359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.000289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] Creating event network-vif-deleted:6690df07-edb9-400e-8a13-7d87a2dbff51 for instance 7c585110-d7ab-4468-971f-31674088f042 on n-h2-851029-13 Oct 04 21:16:52.020982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b25884e4-b4b1-411b-89cd-24afca7912fa req-49739649-8bb5-409a-8d02-6f2773a816c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140109 Oct 04 21:16:52.023705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2417/4928] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:52.035219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:52.037244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:52.055191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.056611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.057712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.059859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.062481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.063864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.192588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.193674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.194741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.195908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lazy-loading 'fault' on Instance uuid 7c585110-d7ab-4468-971f-31674088f042 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:16:52.398922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.433650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.437438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.440014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84a677f0-9c95-451c-8dd5-598b1a224280 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.413059 Oct 04 21:16:52.441655 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2418/4929] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:52 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:52.470791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89accd9547e464b8b7557ca7474025c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d666b7e282413b9a1cf0e73c07de4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:52.479888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:52.490250 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-608d8134-d05b-4225-9a94-14e7ea2469d1 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 200 len: 1311 microversion: 2.1 time: 0.567537 Oct 04 21:16:52.499169 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2512/4930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:51 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:52.895865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:52.897674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:52.910315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.911265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.912142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.913587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.914292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.915667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.962971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:52.965198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] [instance: a45e982f-b3c7-4da0-be39-33430bbf281a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:52.979098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.980725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.982243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:52.984049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:52.985424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:52.986842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.018447 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] HTTP exception thrown: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Request method failure captured: Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a HTTP/1.1 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKGiS7l6yCcJwL8Fcfbix31aCkr4enektDtS7Lm0bskGgS8bW_Lxpkg-cINA8DZL351fGhs5x9okB_NNWLKj3vlB3WbwpALrJesMBC87CtxX2JnrHYkdTofn12nt9OA16x0pMBOJW22lWhoi6wSSAIgd1KPbJRTW_uDx-GWOILJbcag Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2fdec3b9a14e49f7b5392a82d19af772 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2fdec3b9a14e49f7b5392a82d19af772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2fdec3b9a14e49f7b5392a82d19af772 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1136592078 Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestSecurityGroupsBasicOps-1136592078-project Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: e74b98e16c47438eb09af538c57f4e6b Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1136592078-project Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a45e982f-b3c7-4da0-be39-33430bbf281a'} Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.022509 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.038269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Returning 404 to user: Instance a45e982f-b3c7-4da0-be39-33430bbf281a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:53.054995 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50fa118f-c072-49e9-a6df-85dc4b6bfe6d tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a" status: 404 len: 111 microversion: 2.1 time: 0.100296 Oct 04 21:16:53.058084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2513/4931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:52 2022] GET /compute/v2.1/servers/a45e982f-b3c7-4da0-be39-33430bbf281a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:53.203584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:53.235050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ea56c36-c79b-451a-92e7-d745bb5b5be9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1267 microversion: 2.1 time: 0.347180 Oct 04 21:16:53.241013 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2419/4932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:52 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:53.486165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:53.487444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:53.513371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.520549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.522609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.531932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.534391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.538598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:53.539472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.539662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] [instance: 7c585110-d7ab-4468-971f-31674088f042] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:53.559064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.566091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.567719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.574464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:53.575931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:53.577255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:53.629830 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] HTTP exception thrown: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Request method failure captured: Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 HTTP/1.1 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKIqzq14aSuJZKD5xGxoDOpkDqyRbMIuvxCQxnPQoyyU9C1dSc2j2ovF7yyoqiaIWB4bGNlYwi10gLpKGsJxykxgrw7pz0CG1ffl1gjXPXRYF2R1VUyBo65s-vWNs4tIMWWnI9nCrGTw_28CIyLwE5A8c5iUW_IxJTk7f-aeJK_-O_o Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4d666b7e282413b9a1cf0e73c07de4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c4d666b7e282413b9a1cf0e73c07de4a Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1117140558 Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b89accd9547e464b8b7557ca7474025c Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ListServerFiltersTestJSON-1117140558-project Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7c585110-d7ab-4468-971f-31674088f042'} Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:16:53.641037 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] Returning 404 to user: Instance 7c585110-d7ab-4468-971f-31674088f042 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:16:53.659818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-000c545a-9a5d-469f-87b0-42e94ee38151 tempest-ListServerFiltersTestJSON-1117140558 tempest-ListServerFiltersTestJSON-1117140558-project] 10.222.0.36 "GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042" status: 404 len: 111 microversion: 2.1 time: 0.116285 Oct 04 21:16:53.666510 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2420/4933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:53 2022] GET /compute/v2.1/servers/7c585110-d7ab-4468-971f-31674088f042 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:16:53.793675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:53.829976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:53.838992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:53.843963 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-df13185d-fcf6-494d-b720-b2c862347622 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.364915 Oct 04 21:16:53.844829 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2514/4934] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:53 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:54.292075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:54.294227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:54.326416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.326416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.326953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:54.335802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.338347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.339527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:54.364376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:54.621142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:54.648523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-689a9565-f8b3-40b3-bd25-922ceaddf844 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1267 microversion: 2.1 time: 0.364704 Oct 04 21:16:54.650392 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2421/4935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:54 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:16:54.919794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:54.928174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:54.960939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.966720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.970923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:54.972251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:54.973072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:54.978198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.318081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:55.344120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:55.357629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:55.367824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51f9a4fc-3819-4475-bc14-f1ca88417859 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.460105 Oct 04 21:16:55.371710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2515/4936] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:54 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:55.698844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:55.699917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:55.718508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:55.745099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:55.745867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:55.746908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:55.748423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:55.749819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:55.751593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.311317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:56.333652 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dffc7bad-3515-4813-aeab-d6a677450ec1 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.648537 Oct 04 21:16:56.337721 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2422/4937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:55 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:56.423212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:56.425809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:56.440368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.441680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.442860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.445250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:56.446931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:56.448203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:56.674129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:56.703596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:56.711906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:56.714341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-879038f1-584e-4df6-8f6a-a8f2f8123c7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.299045 Oct 04 21:16:56.721188 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2516/4938] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:56 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:16:57.381780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:57.382868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:57.414169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.415476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.416438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.420225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.421164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.422013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.765700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:57.784246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:57.785915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:57.811717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.824531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.824531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:57.826499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:57.827831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:57.829232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:58.284066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:58.329683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:58.335454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:58.339189 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa5a4a1c-063d-40cb-aacc-9e6297dc87b7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.575098 Oct 04 21:16:58.341521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2517/4939] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:57 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:16:58.949978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:58.981810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e06a8e6-0c0f-4af6-847b-38d3492c2852 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 1.606910 Oct 04 21:16:58.985956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2423/4940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:16:57 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:16:59.393230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:59.395291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:16:59.404630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:59.421115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:59.422523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:59.423667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:59.425649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:59.426890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:59.427975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:59.704417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:59.745513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:59.752279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:16:59.754699 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41f31d3f-bc58-48fd-af88-7b53318dd3b1 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.368845 Oct 04 21:16:59.759584 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2518/4941] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:16:59 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:00.035233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:00.038709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:00.066335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:00.073860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:00.075185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:00.076367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:00.081230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:00.083823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:00.091710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:00.753981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:00.789786 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f06936f-01ca-48bc-99c8-f110302bacbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.757928 Oct 04 21:17:00.812924 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2424/4942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:00 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:00.826543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:00.839633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:00.846049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:00.847478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:00.848602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:00.857077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:00.862601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:00.863731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:01.102319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:01.142447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:01.147253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:01.152574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7867467-7e19-402f-901e-664a408186d9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.336135 Oct 04 21:17:01.156367 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2519/4943] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:00 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:01.858485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:01.860804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:01.896077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:01.902427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:01.914930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:01.919332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:01.921366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:01.925343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:02.277567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:02.278562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:02.302994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:02.306312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:02.307580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:02.309465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:02.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:02.311637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:02.522035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:02.572833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:02.588362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:02.596875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:02.606313 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01fe4426-2811-43b7-aa15-fb7201f257a2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.388380 Oct 04 21:17:02.608448 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2520/4944] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:02 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:02.621735 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da728508-f849-4a7f-83c9-0ca49c06847e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.790193 Oct 04 21:17:02.634712 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2425/4945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:01 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:03.679110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:03.680286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:03.681126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:03.683282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:03.703602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:03.705078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:03.708881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:03.708881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:03.709976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:03.710647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:03.712267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:03.712500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:03.713119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:03.714469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:03.715253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:03.715897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:04.039077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:04.073279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:04.088123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:04.091506 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a875344d-2761-4d58-9358-b5591e50b927 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1366 microversion: 2.47 time: 0.437541 Oct 04 21:17:04.093682 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2521/4946] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:03 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:04.270685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:04.287076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6843e106-7581-4824-a484-16a7feb541d0 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.616136 Oct 04 21:17:04.312653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2426/4947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:03 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:05.149726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:05.159215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:05.197386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3561a7-3c90-4c66-90c8-74624604620e", "tag": "9d0b3d09-c580-47f5-8342-8fa713516efd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:05.205230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.209363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.214111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.223868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.225090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.259467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.260561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.260561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.260561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.294336 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] Creating event network-changed:9d0b3d09-c580-47f5-8342-8fa713516efd for instance 5b3561a7-3c90-4c66-90c8-74624604620e on n-h2-851029-13 Oct 04 21:17:05.317150 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a6e2ad99-034c-41ee-ab8c-170617ef931f req-d13ce953-7fae-485d-9892-4d1092177602 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127048 Oct 04 21:17:05.325113 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2427/4948] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:05.345931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:05.359398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:05.378871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.382068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.387803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.389691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:05.392204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:05.403466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:05.740342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:05.758126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:05.762273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:05.765289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f2e2661-04e5-410b-8a63-5be032e9090f tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1384 microversion: 2.47 time: 0.624109 Oct 04 21:17:05.767294 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2522/4949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:05 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1384 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:17:06.838508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.845837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:06.878032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:06.879113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:06.879855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:06.881283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:06.892275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:06.894589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:07.255709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:07.287770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:07.292069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:07.303429 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7946b2c5-92d0-42c7-b41e-fa2729e3ac7d tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1372 microversion: 2.47 time: 0.477572 Oct 04 21:17:07.310808 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2523/4950] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:06 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1372 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:07.321382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:07.361061 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34ab9338-f9f6-4fa5-bfc0-240b57c9d6ec tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 2.032669 Oct 04 21:17:07.369579 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2428/4951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:05 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:08.364855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:08.369929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:08.407483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.408801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.417547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:08.418510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.421743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.422732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.423490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.426822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:08.448319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.449212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.450159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.454221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.454221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.454221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.939839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:08.972895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:08.979004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:08.986194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96d01711-41a0-4b9a-bcde-a82bef1d6c39 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1372 microversion: 2.47 time: 0.624627 Oct 04 21:17:08.986194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2524/4952] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:08 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1372 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:09.116291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:09.189493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c749316-2f2e-4862-a458-7e0d37838d7d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.778996 Oct 04 21:17:09.190602 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2429/4953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:08 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:10.035554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:10.040474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:10.082349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.085072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.087828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.089680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.092697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.094965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.243366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:10.253694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:10.283487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.284945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.288324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.294402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.295535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.300396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.463886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:10.492754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:10.497680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:10.510021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf224633-f532-40d5-a79a-729e222c9efc tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1357 microversion: 2.47 time: 0.483705 Oct 04 21:17:10.513064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2525/4954] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:10 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1357 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:10.571149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:10.583234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:10.585522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Searching by: {'deleted': False, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:17:10.597152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.602594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.602594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.602594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:10.604527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:10.605997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.954580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:17:11.185722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:11.187952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:11.212173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:11.212480 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d18ff08-da0d-4b78-b986-ca68b6260984 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.977768 Oct 04 21:17:11.214168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:11.216683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:11.222853 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2430/4955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:10 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:11.252400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:11.256670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:11.384157 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e3ee9d9-5504-49c3-994e-b06a3030e7e4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.823233 Oct 04 21:17:11.386246 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2526/4956] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 4 21:17:10 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:17:11.452845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:11.457771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:11.472710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:11.473985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:11.475155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:11.477349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:11.478513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:11.479587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:11.487998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:11.551590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:12.280442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:12.283512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:12.314590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.316605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.322475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.326448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.327215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.331004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.589186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f3f4441e-3172-4bf4-b063-e28214fb7c7a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 204 len: 0 microversion: 2.47 time: 1.139206 Oct 04 21:17:12.597054 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2431/4957] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:17:11 2022] DELETE /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:17:12.613335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:12.628163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:12.650527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.652639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.654039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.656071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.657381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.659331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.860890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:12.912124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:12.918950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:12.922818 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a13a091-b39b-4d06-a7a5-ce83c6ac4352 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1363 microversion: 2.47 time: 0.321610 Oct 04 21:17:12.926067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2432/4958] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:12 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:12.952049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:12.976749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-148a7da1-a9ca-480c-84eb-aee9d99829ef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.710446 Oct 04 21:17:12.999182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2527/4959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:12 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:13.758349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-390b916f-0372-413b-bd14-a5361bbb848e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] Calling method '.version_select at 0x7f54f5e88670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:13.978357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:13.980898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:13.986426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-390b916f-0372-413b-bd14-a5361bbb848e tempest-TestSecurityGroupsBasicOps-1136592078 tempest-TestSecurityGroupsBasicOps-1136592078-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-902061338" status: 202 len: 0 microversion: 2.1 time: 0.237628 Oct 04 21:17:13.987998 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2433/4960] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-902061338 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:17:14.021305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.022185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.023061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.024558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.037545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.045609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.045859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:14.045859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:14.077308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.087521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.090983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.090983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.091591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.092150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.380091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:14.398332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:14.403106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:14.418890 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-445f25fe-f205-400c-8e0b-93f546e0c1a7 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1363 microversion: 2.47 time: 0.434767 Oct 04 21:17:14.419704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2528/4961] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:13 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:17:14.749815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:14.784852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d174dab5-52e0-48df-b7db-463bda8d083e tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.750754 Oct 04 21:17:14.800028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2434/4962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:14 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:15.456747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:15.458107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:15.469608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.470410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.471492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:15.477116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.477116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.477116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:15.529723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:15.679456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:15.703831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:15.707079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:15.709462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e82dbdf-7fd1-4ba0-a087-9e591ad1344a tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 200 len: 1363 microversion: 2.47 time: 0.259737 Oct 04 21:17:15.711886 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2529/4963] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:15 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:15.834844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:15.836620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:15.853621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.855118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.856126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:15.857797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.858925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.859953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.124636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:17.125769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.149746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.150826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.150826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.152036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.153070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:17.154077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.155389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.168700 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d6d5479-58e1-4415-a065-71998d397f81 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 1.343171 Oct 04 21:17:17.182705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2435/4964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:15 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:17.195612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:17.195612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: c4df7c0d-9005-4f28-9d9a-6c5218c447b6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.215034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.216028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.216725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.218280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.219001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.219762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.271873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:17.308890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] HTTP exception thrown: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Request method failure captured: Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 HTTP/1.1 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKKi3NdsG7lP1xQrjeeCoJo0fchW0aLknc7V1zSP8g1boTHEj5Z7JdD1C9uSbxv1vep7SFpBc7d_Mw9B29cjTYuonj_y9FOU7bSN4dSV-EIujEkEjJVD9s-zTc5oAOU922yKCg7oQlh8KjDCEANss3TmrPwvluERiGNxRH872SajZNY Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: f4ed8236ef344940a3cd9d52eb8aa735 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: f4ed8236ef344940a3cd9d52eb8aa735 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerShowV247Test-1884107259-project Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dedd2ba2e9954f44b1c74d2ba5743668 Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerShowV247Test-1884107259-project Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c4df7c0d-9005-4f28-9d9a-6c5218c447b6'} Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:17.321769 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Returning 404 to user: Instance c4df7c0d-9005-4f28-9d9a-6c5218c447b6 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7bc2e79-3c04-45bd-b2a2-c437d38f9914 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6" status: 404 len: 111 microversion: 2.47 time: 0.153778 Oct 04 21:17:17.340181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2436/4965] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:17 2022] GET /compute/v2.1/servers/c4df7c0d-9005-4f28-9d9a-6c5218c447b6 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:17:17.355512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:17.356555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.375065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.376094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.376960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.379263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.380227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.381152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.449966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:17.858192 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38485869-f5f0-4197-981a-422dccc9841c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 204 len: 0 microversion: 2.42 time: 1.562332 Oct 04 21:17:17.866698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2530/4966] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:17:16 2022] DELETE /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 0 bytes in 1566 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:17:17.876013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:17.878227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.896111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.897885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.898716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.902777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.902777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.902777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.030222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f5cb16f-83ab-40c2-9f7c-0b6a3dc37392 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 204 len: 0 microversion: 2.47 time: 0.686183 Oct 04 21:17:18.033135 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2437/4967] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:17:17 2022] DELETE /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:17:18.055380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.058109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.074713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.076486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.078021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.080063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.081464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.083610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.482276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.499113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.502203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.504746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dee924e6-d05b-402d-bfa3-719b8cfae8e9 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 200 len: 1363 microversion: 2.47 time: 0.463681 Oct 04 21:17:18.522207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2438/4968] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:18 2022] GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:18.550646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.551785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.563652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.564548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.565338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.566651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.569926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.569926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.759738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.799403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.809395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.821797 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c6be0ad5-75b9-43cd-a788-8ea5d17d4a8d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2960 microversion: 2.42 time: 0.946927 Oct 04 21:17:18.821797 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2531/4969] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:17 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2960 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:19.093765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3561a7-3c90-4c66-90c8-74624604620e", "name": "network-vif-plugged", "status": "completed", "tag": "9d0b3d09-c580-47f5-8342-8fa713516efd"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:19.154780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:19.154780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:19.154780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.189634 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] Creating event network-vif-plugged:9d0b3d09-c580-47f5-8342-8fa713516efd for instance 5b3561a7-3c90-4c66-90c8-74624604620e on n-h2-851029-13 Oct 04 21:17:19.198398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-527b4fd6-0405-4bd9-99dd-f0a08b24870e req-f990f5e7-f3f3-4230-a570-1a4ca753f031 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116293 Oct 04 21:17:19.204041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.221240 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2532/4970] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:19.232202 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa136756-0820-4be9-b9bd-488b38d6317a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 0.707927 Oct 04 21:17:19.244293 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2439/4971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:18 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:19.571691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:19.574156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:19.594705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:19.595478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:19.596295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.603437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:19.606573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:19.616168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.878575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:19.879562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:19.911420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:19.912334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:19.913184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.914501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:19.915136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.915957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:19.916153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.951086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.954611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.961129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1010d4f4-c072-4da7-b7ef-14d7a323d0e2 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 200 len: 1363 microversion: 2.47 time: 0.408901 Oct 04 21:17:19.966132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2533/4972] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:19 2022] GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:20.291672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:20.296906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:20.350000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.354594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.357090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.359745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.364092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.372864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.705066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:21.175664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:21.655852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.708400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.724089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.727727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.748332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc216534-5f03-4c60-8abc-e565963fa797 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2960 microversion: 2.42 time: 1.869880 Oct 04 21:17:21.751196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c71314b-3c73-4d73-9f81-a254a17f7e82 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1309 microversion: 2.1 time: 1.471903 Oct 04 21:17:21.759922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2534/4973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:20 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1309 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:21.776688 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2440/4974] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:19 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2960 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:21.786092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:21.795781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:21.828578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.838528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.841999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.847356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.857047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.857047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.003885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.009442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.010850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.013431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lazy-loading 'fault' on Instance uuid 9b5f82f1-0174-403a-950c-4f675bd1299a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:22.348965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:22.380276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:22.396674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedd2ba2e9954f44b1c74d2ba5743668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ed8236ef344940a3cd9d52eb8aa735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:22.399604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c342989-d418-47cd-ab75-efe833649eb4 tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 200 len: 1368 microversion: 2.47 time: 0.637007 Oct 04 21:17:22.405603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2535/4975] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:21 2022] GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 1368 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:22.813259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:22.819558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:22.820259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.821737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.853486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.860087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.861060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.863052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.871641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.872118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.876356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.879451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.880382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.887096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.890017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.893699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.481547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:24.516972 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d7f52a7-013b-4fd1-9325-b3880cda6eef tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1490 microversion: 2.1 time: 1.714674 Oct 04 21:17:24.540349 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2441/4976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:22 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1490 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:24.561526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "f0255488-6f0e-47ee-99d3-249d39b64c02"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:24.601081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.601994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.607349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.671641 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] Creating event network-vif-unplugged:f0255488-6f0e-47ee-99d3-249d39b64c02 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:24.701906 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-18fb5ea1-6e03-4ac3-b4d7-e9b5ca4e4122 req-fd29839e-0c98-48f3-a27d-3a451c0c3f38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154860 Oct 04 21:17:24.701906 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2442/4977] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:24.725698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:24.731751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] [instance: 9b5f82f1-0174-403a-950c-4f675bd1299a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:24.763808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.765098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.770924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.772336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.773295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.776669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.844670 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] HTTP exception thrown: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Request method failure captured: Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a HTTP/1.1 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKKi3NdsG7lP1xQrjeeCoJo0fchW0aLknc7V1zSP8g1boTHEj5Z7JdD1C9uSbxv1vep7SFpBc7d_Mw9B29cjTYuonj_y9FOU7bSN4dSV-EIujEkEjJVD9s-zTc5oAOU922yKCg7oQlh8KjDCEANss3TmrPwvluERiGNxRH872SajZNY Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: f4ed8236ef344940a3cd9d52eb8aa735 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f4ed8236ef344940a3cd9d52eb8aa735"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: f4ed8236ef344940a3cd9d52eb8aa735 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerShowV247Test-1884107259 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerShowV247Test-1884107259-project Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dedd2ba2e9954f44b1c74d2ba5743668 Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerShowV247Test-1884107259-project Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9b5f82f1-0174-403a-950c-4f675bd1299a'} Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:24.852984 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] Returning 404 to user: Instance 9b5f82f1-0174-403a-950c-4f675bd1299a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27799fcf-6d23-410a-98b4-3bc3c7fd76dd tempest-ServerShowV247Test-1884107259 tempest-ServerShowV247Test-1884107259-project] 10.222.0.36 "GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a" status: 404 len: 111 microversion: 2.47 time: 0.153437 Oct 04 21:17:24.869593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2443/4978] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:24 2022] GET /compute/v2.1/servers/9b5f82f1-0174-403a-950c-4f675bd1299a => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:17:24.888826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-972304282"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:24.893994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:24.912150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.914079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.916869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.919865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.921999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.923316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.292053 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-784461d7-499a-4642-9ebc-02b349f3928b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "PUT /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1074 microversion: 2.1 time: 0.409958 Oct 04 21:17:25.292547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2444/4979] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:17:24 2022] PUT /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1074 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:25.327067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.329140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.360040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.365607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.367051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.371158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.378094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.378094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:26.081662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:26.132053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:26.141376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:26.161937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9850dfc3-6435-4964-b230-adbb86823f3a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2960 microversion: 2.42 time: 3.353719 Oct 04 21:17:26.190750 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2536/4980] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:22 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2960 bytes in 3379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:26.968086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d8d425-b525-4f9b-a3e6-7eeea44a6954"}, {"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "0e5e760a-f01f-4572-83ba-c4b920e8ea69"}, {"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:27.029259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.030584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.031586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.081712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Creating event network-vif-unplugged:e9d8d425-b525-4f9b-a3e6-7eeea44a6954 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:27.084537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Creating event network-vif-unplugged:0e5e760a-f01f-4572-83ba-c4b920e8ea69 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:27.086516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] Creating event network-vif-unplugged:fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:27.101904 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-188bb94c-b4fd-4d1d-abd6-c807594e36aa req-60f6959c-3940-444d-a738-64234c015f6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.141250 Oct 04 21:17:27.103657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2537/4981] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:27.234592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.238056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.268309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.271912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.273092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.274378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.275371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.276515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.502349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:27.525601 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b91f5f6c-89f8-4c7d-aa97-1c1cf8606d9f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1500 microversion: 2.1 time: 2.205961 Oct 04 21:17:27.532410 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2445/4982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:25 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1500 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:27.563932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.570307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.587264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.589206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.590062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.591329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.592103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.619379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:28.595133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:28.645277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:28.653178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:28.657593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f9b4d3f-353c-4ebd-884e-89075d8fa3bd tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2939 microversion: 2.42 time: 1.434923 Oct 04 21:17:28.661818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2538/4983] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:27 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2939 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:29.148009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "448f9e2e-3a37-4d83-bb3c-2ce30b40640b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:29.195734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:29.228447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:29.238339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.240214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.245696 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f871060d-6989-4aa4-9d51-05f50902871b tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1500 microversion: 2.1 time: 1.686112 Oct 04 21:17:29.247810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.251102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2446/4984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:27 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1500 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:29.300979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:29.306919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] Creating event network-vif-unplugged:448f9e2e-3a37-4d83-bb3c-2ce30b40640b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:29.323941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.327856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.328087 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-54ef6b9c-c6c5-47a9-9bf3-edee22df5286 req-d36fc0f7-5c79-4bbb-ad12-75e41d26a6d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189812 Oct 04 21:17:29.329634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.334423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2539/4985] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:29.415446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Going to try to stop instance {{(pid=123542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:17:29.726759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:29.736535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:29.752980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.771296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f71c1e6-4864-41bc-b0ba-2e4f34b656e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "POST /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e/action" status: 202 len: 0 microversion: 2.1 time: 0.485722 Oct 04 21:17:29.777232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2447/4986] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:29 2022] POST /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:17:29.777476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.777476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.784009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.785197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.786009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.800458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:29.801802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:29.832741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.833627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.835137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.836458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.837293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.838063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:31.115217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.139275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.143742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.148411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4629e55d-2a73-484f-a757-d151b4d59807 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2939 microversion: 2.42 time: 1.430843 Oct 04 21:17:31.150736 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2540/4987] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:29 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2939 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:31.163651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:31.182573 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d74c0c04-9e80-4936-9a5a-c3629860605a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.389318 Oct 04 21:17:31.184469 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2448/4988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:29 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:31.429930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "70282be4-4cea-436c-b0e0-de05f59122d4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:31.464266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:31.467676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:31.476176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:31.529077 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] Creating event network-vif-unplugged:70282be4-4cea-436c-b0e0-de05f59122d4 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:31.540679 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-209f786c-e69f-4b4d-8f74-788634dacea7 req-b8373e78-46a6-486a-a510-b7f0e6fb4282 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124044 Oct 04 21:17:31.541786 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2541/4989] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:32.226232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:32.227398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:32.249586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:32.283674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.285322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.287992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:32.295203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.299854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.314461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:32.353726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:32.355183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:32.381732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:32.385803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.387172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.388222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:32.389853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:32.391036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:32.392065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:33.600145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.631973 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-477fc6c3-eaad-41d1-bfd6-bf3842cd1a05 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.414378 Oct 04 21:17:33.633310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2449/4990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:32 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:33.848556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.886900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.893376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:33.898976 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0d1f16e-94f1-4fbb-be01-547ca2fca611 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2918 microversion: 2.42 time: 1.564542 Oct 04 21:17:33.912647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2542/4991] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:32 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2918 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:34.678652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:34.679858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:34.725855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.726915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.728912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:34.729148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:34.729869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:34.730644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:35.265736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-775209d4-4c68-4204-8bdd-1839bf763904 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: .version_select at 0x7f54f5e9f040>, body: {"keypair": {"name": "tempest-keypair-1664901809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/YS/HaR0oo1sXGrh3iCWOm9d5EZ/YExTrsDTw6omV2339REncwHJXJSvuCFCubX72IEj967kLZIICkuhhzIsdVVMwI6TZFXVAMAzgYsj0oVaHwVcK36IW6UPwxj4gtqg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:35.379262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-775209d4-4c68-4204-8bdd-1839bf763904 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for project 7cc41a7a78a1428eaef197899143a842. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:35.408960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-775209d4-4c68-4204-8bdd-1839bf763904 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for user 8faa07a8f88c460fb7972ac174f087e0 and project 7cc41a7a78a1428eaef197899143a842. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:35.586442 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-775209d4-4c68-4204-8bdd-1839bf763904 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.277307 Oct 04 21:17:35.588471 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2450/4992] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:17:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:35.613776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:35.615640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:35.637118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:35.638043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:35.639069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:35.640742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:35.641777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:35.642404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:36.523633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:36.523633 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aadbd7b2-9214-40cc-a54a-f982b1d9d316 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.612258 Oct 04 21:17:36.523633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2543/4993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:34 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:37.100758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-584256439", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:37.156787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:37.200580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:37.212668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:37.225285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fba5dbe-8116-42be-8e1b-420af75dae51 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2871 microversion: 2.42 time: 1.633823 Oct 04 21:17:37.228371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2451/4994] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:35 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2871 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:37.243144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:37.243144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:37.243144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:37.243623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:37.244108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:37.263482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.264892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.266534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.268286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.269405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.270390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.282168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-deleted", "tag": "fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:37.303313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.320747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.323524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.339912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Getting quotas for project 0b0f9829125442fc865a57c51fb55fa2. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:37.362000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Getting quotas for user 9a684380da5f4c4c97800a2ba4c6d13d and project 0b0f9829125442fc865a57c51fb55fa2. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:37.376585 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] Creating event network-vif-deleted:fdfe2fa6-9f5c-4011-90a0-1e4ca21f0687 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:37.390202 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-307bdad3-8290-42a0-91bd-241be4c4b86f req-393f760b-d976-469a-be9d-02a2fe9949c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142649 Oct 04 21:17:37.396698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2452/4995] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:37.414621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:37.420854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:37.432099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:37.433494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.435160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.436377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.436969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:37.438410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:37.439741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:37.440902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:37.719075 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41dd95d0-5081-4a3b-92cc-90308ba78b38 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.019593 Oct 04 21:17:37.733746 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2544/4996] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:17:37.750289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:37.752098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:38.114639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:38.143883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:38.148426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:38.154007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15af9ec4-5361-48e0-a096-70531ff9bbc6 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1277 microversion: 2.57 time: 0.412539 Oct 04 21:17:38.166703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2545/4997] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:37 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1277 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:38.301846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:38.305829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:38.335940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.337226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.341377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.347775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:38.350012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:38.351657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:38.388232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:38.416119 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c3efccf3-2d88-4596-8dc0-1dcb8cc5ffd2 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.016600 Oct 04 21:17:38.417346 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2453/4998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:37 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:39.218135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:39.221566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:39.395496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:39.458398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:39.467191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:39.476431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41fac034-aefb-45ed-ac84-f6546d41d5f9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2758 microversion: 2.42 time: 1.181670 Oct 04 21:17:39.479697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2546/4999] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:38 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2758 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:39.492308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:39.493833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:39.517422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.526120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.533549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:39.541183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:39.547968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:39.549507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:40.235908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:40.262709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:40.265734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:40.267890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48134a67-7a2b-476f-812a-a0ba6e324c90 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1277 microversion: 2.57 time: 1.058657 Oct 04 21:17:40.268903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2454/5000] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:39 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1277 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:17:40.545701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:40.548974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:40.566912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:40.567949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:40.569112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:40.570819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:40.572020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:40.573057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.216496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:41.250906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f470900-b265-4ef8-8ed2-d7d5e64a3947 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.768854 Oct 04 21:17:41.275470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2547/5001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:39 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:41.331728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:41.336609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:41.376512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.376512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.388419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.403072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.404381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.408177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.615754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:41.888104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:41.929454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:41.934795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:41.946624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bd34c0e-1b87-4dfb-a448-a1fcf2c7bf55 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1273 microversion: 2.57 time: 0.623204 Oct 04 21:17:41.956765 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2548/5002] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:41 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1273 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:17:41.970543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-deleted", "tag": "70282be4-4cea-436c-b0e0-de05f59122d4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:41.993998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.997321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.999412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.028566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] Creating event network-vif-deleted:70282be4-4cea-436c-b0e0-de05f59122d4 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:42.045080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-dc695c3b-2b9d-48ab-a15a-23a4dbd0bddd req-e7dd5bbf-df17-42da-8d0f-5beb071d98d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082408 Oct 04 21:17:42.047043 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2549/5003] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:42.116563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:42.150836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:42.154580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:42.169162 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fefc881-1fe1-4f8e-bec7-d7775a8e8b58 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2711 microversion: 2.42 time: 1.623053 Oct 04 21:17:42.170563 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2455/5004] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:40 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2711 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:42.318885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:42.320820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:42.348115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:42.351572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:42.354832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.358736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:42.363804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:42.365895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.534902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-689652159", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:42.733919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] validate_networks() for [('b356aab2-159e-4241-9ad9-490d50407eda', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:43.651977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:43.688263 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8d6d8ff-424e-432a-8c9d-41671caff3a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1510 microversion: 2.1 time: 1.376744 Oct 04 21:17:43.698822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2456/5005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:42 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1510 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:43.714156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:43.718520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:43.743851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.745198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.754227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.756787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.758120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.759235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.488224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:44.518641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:44.524401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:44.527487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10c5893b-3a9d-4636-b1a1-1b2af4255e92 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1335 microversion: 2.57 time: 0.825862 Oct 04 21:17:44.542710 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2457/5006] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:43 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1335 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:44.544753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:44.546615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:44.580805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.581707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.582768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.584319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.585488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.586306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.328181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:46.352157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:46.356026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:46.359206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a480833-063e-4538-998f-b30de2359254 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2597 microversion: 2.42 time: 1.825931 Oct 04 21:17:46.360869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2458/5007] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:44 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2597 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:46.370163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:46.371432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:46.394906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.411768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.418788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.421649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.422793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.423708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.679244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:46.686106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:46.686106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:46.686106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:46.686106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:46.713331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.714691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.715647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.716742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:46.717590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:46.720369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:46.990330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Getting quotas for project ba1f9e53677d41118bddc2027b32952b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:47.027064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Getting quotas for user 3527dc5750294371ae96dcccf4a38a7c and project ba1f9e53677d41118bddc2027b32952b. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:47.087859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:47.103297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:47.480677 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03a7a31e-41cc-480b-8d42-6606589d6ad6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.430314 Oct 04 21:17:47.492276 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2550/5008] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 5443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:47.509855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-30611034", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d92991c-1b63-4645-9069-bd87a8eb54d3"}], "security_groups": [{"name": "tempest-securitygroup--1708525470"}], "key_name": "tempest-keypair-1664901809", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:48.337221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:48.367529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5abe3abe-5556-4c54-8ec0-b9029c212016 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1487 microversion: 2.1 time: 1.995861 Oct 04 21:17:48.392254 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2459/5009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:46 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1487 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:48.409607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:48.414123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:48.430399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.431318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.432270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.433749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.434499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.435264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.084355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] validate_networks() for [('2d92991c-1b63-4645-9069-bd87a8eb54d3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:49.234258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:49.300531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:49.308211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:49.313209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f39031cf-a662-4ae5-89bb-1df84806237f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1356 microversion: 2.57 time: 0.918112 Oct 04 21:17:49.314286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2460/5010] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:48 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1356 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:49.374000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:49.375746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:49.411949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.416805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.418228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.420856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.425668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.428252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.261459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:50.837423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:50.857557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:50.868056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:50.875560 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-457f0c32-0eb2-4850-a7f8-50f0612dd151 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2550 microversion: 2.42 time: 1.555132 Oct 04 21:17:50.876616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2461/5011] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:49 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2550 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:50.894620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:50.897391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:50.909753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.911093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.912257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.913863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.915143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.916293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.501417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:51.542970 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-912ee7c7-1ee6-4811-bbd3-63bca4dbd832 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1218 microversion: 2.1 time: 0.664138 Oct 04 21:17:51.552795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2462/5012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:50 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1218 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:51.564015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1544698859"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:51.575353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:51.604822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.606071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.607017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.608378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.609252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.610124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.042314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69fa991d-83f9-4c68-a124-83ac320571db tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "PUT /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1061 microversion: 2.1 time: 0.489304 Oct 04 21:17:52.044393 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2463/5013] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 21:17:51 2022] PUT /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1061 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:52.075878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:52.085274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:52.120072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.121612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.123469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.125325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.126740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.128237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.197790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:52.389657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:52.391077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:52.393097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:52.397971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:52.412446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:52.833724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:52.860820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.863126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.864338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.865884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.868143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.869221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.944882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:52.949385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:52.949385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:52.953515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:52.956090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:52.995516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:52.996718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:52.999739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47312de5-cdbf-4005-b574-851342523410 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "POST /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01/action" status: 202 len: 1137 microversion: 2.57 time: 0.953351 Oct 04 21:17:52.999988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.001193 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2464/5014] 10.222.0.36 () {62 vars in 1320 bytes} [Tue Oct 4 21:17:52 2022] POST /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01/action => generated 1137 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:17:53.009303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-deleted", "tag": "448f9e2e-3a37-4d83-bb3c-2ce30b40640b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:53.017561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.045234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.046420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.049251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.050071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.050917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.114147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] Creating event network-vif-deleted:448f9e2e-3a37-4d83-bb3c-2ce30b40640b for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:53.133894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e8fd0f33-4117-4e6f-8d86-48a1284145f3 req-339a90db-aefe-4794-afbd-1b64177b1b6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130752 Oct 04 21:17:53.139180 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2465/5015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:53.154938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for project 7cc41a7a78a1428eaef197899143a842. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:53.158377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.171591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.185212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for user 8faa07a8f88c460fb7972ac174f087e0 and project 7cc41a7a78a1428eaef197899143a842. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:53.185624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.186520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.195733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.197177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.198170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.199718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.229061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:53.236791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:53.517388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2fb2c3c-964f-498f-b9fb-b831a43f97cb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.019807 Oct 04 21:17:53.526997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2551/5016] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 6026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:53.560192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.561862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.602601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.602601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.603102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.604461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.605347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.606153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.877871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.920455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.929408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:53.933637 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-efa9924a-52b6-4d06-9a66-14e782399e4b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2550 microversion: 2.42 time: 0.792050 Oct 04 21:17:53.935238 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2466/5017] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2550 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:53.958137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.963219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:54.019635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.021238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.022045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.025624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.026594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.028163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.480789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:54.500931 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bf19f6a-41f7-4448-9500-a39b9c68a207 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1280 microversion: 2.1 time: 0.563263 Oct 04 21:17:54.509985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2467/5018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1280 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:54.539146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.541427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:54.571519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.575908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.578323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.580230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.581421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.583096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.918935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:54.950714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:54.955585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:54.958296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a642ef10-2e88-490d-bfde-816299e5a91a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.444278 Oct 04 21:17:54.960259 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2468/5019] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:54.980958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-166f080d-96bc-431f-ab09-d7a7b4819fdb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.983896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-166f080d-96bc-431f-ab09-d7a7b4819fdb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:55.213289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:55.246679 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2cac9d0-778c-4889-858c-62c3ed8a96ad tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1488 microversion: 2.1 time: 1.714986 Oct 04 21:17:55.255522 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2552/5020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1488 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:55.256002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-166f080d-96bc-431f-ab09-d7a7b4819fdb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:55.271286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:55.274911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:55.321697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.323218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.324421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.331916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.333380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.334529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.336953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-166f080d-96bc-431f-ab09-d7a7b4819fdb tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1236 microversion: 2.1 time: 0.371763 Oct 04 21:17:55.345306 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2469/5021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1236 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:55.383422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:55.384756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:55.402242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.403181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.404004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.405372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.406223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.411057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.643855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:56.666467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78d767f6-0432-42f5-a9cc-fdbb2728e2aa tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1488 microversion: 2.1 time: 1.320511 Oct 04 21:17:56.667873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2470/5022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:55 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1488 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:56.677917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:56.680213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.682165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:56.696755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.698201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.699843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.703720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.705279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.706740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.712005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:56.727299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:56.729895 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-534d745c-1e00-4fc9-8f8d-4a0ffb6305eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2213 microversion: 2.42 time: 1.476827 Oct 04 21:17:56.731049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2553/5023] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:55 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2213 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:56.741305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.750798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:56.774179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.775844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.776674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.779938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.782296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.787515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.503057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:57.529854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:57.533616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:57.536695 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6af4ae7-1685-439c-bc38-e70c760cb7d5 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.803530 Oct 04 21:17:57.538163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2554/5024] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:57.547892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-deleted", "tag": "e9d8d425-b525-4f9b-a3e6-7eeea44a6954"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:57.573527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.579215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.579215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.604945 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] Creating event network-vif-deleted:e9d8d425-b525-4f9b-a3e6-7eeea44a6954 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:17:57.615690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-82d3d01e-3d0f-4e83-8848-e14cab9cb8da req-22eeb360-d805-4b69-8e89-47100e3dcd9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074453 Oct 04 21:17:57.617366 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2555/5025] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:57.628160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:57.630100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:57.643001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.643957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.645370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.647007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.648118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.649166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.045430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.108982 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c81994ca-eee0-46e9-a3d9-fc1a07dafbfe tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1288 microversion: 2.1 time: 0.482712 Oct 04 21:17:58.130178 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2556/5026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:57 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1288 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:58.149977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.167483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.168527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.177544 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ef9ee89-51e0-43de-bc44-6befc30def1d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 1.507479 Oct 04 21:17:58.188848 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2471/5027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:58.203382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.204404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.205207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.206524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.208703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.211142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.221856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.223204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.225905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.227404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.228779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.230469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.231996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.233161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.318537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:58.743106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.781435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.790751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:58.797942 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9024dd86-fb38-47f3-80fb-cb12bcdb37ca tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 2055 microversion: 2.42 time: 0.606035 Oct 04 21:17:58.803031 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2472/5028] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:58 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 2055 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:58.825613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.831271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.851966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.859433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.860634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.872119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.872952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.874408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.044291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:59.073269 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8bd0db0f-3b40-47fe-957d-a894e238d390 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 204 len: 0 microversion: 2.1 time: 0.923295 Oct 04 21:17:59.074311 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2557/5029] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:17:58 2022] DELETE /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 0 bytes in 943 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:17:59.078307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:59.090288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:59.093354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:59.096051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:59.100113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b8956851-cd80-42bb-a5c1-0d47bac682b8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.294760 Oct 04 21:17:59.101215 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2473/5030] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:17:58 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:17:59.142443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.149805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.150640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.152073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.152949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.153770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.181576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:59.183984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:59.212098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.216153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.219691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.230202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.231206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.232037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.576189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:59.608193 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ea85d6a-f274-46f4-b67b-dd9974d79980 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1306 microversion: 2.1 time: 0.436405 Oct 04 21:17:59.611202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2474/5031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:59 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1306 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:59.625156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:59.638405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:59.655441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.662111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.662936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.664386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:59.665160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:59.665948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.342958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:00.367490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ae3c24b-1bcd-4ca0-bec2-d42008f8b073 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1494 microversion: 2.1 time: 1.285488 Oct 04 21:18:00.369015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2558/5032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:59 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1494 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:00.408751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7", "name": "network-vif-deleted", "tag": "0e5e760a-f01f-4572-83ba-c4b920e8ea69"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:00.437382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.439156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.440050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.483970 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] Creating event network-vif-deleted:0e5e760a-f01f-4572-83ba-c4b920e8ea69 for instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 on n-h2-851029-13 Oct 04 21:18:00.486455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ad045cd6-2718-443e-8f5b-9587e5067596 req-eb913ac0-4351-473f-b6e9-ca1e0254f8a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098409 Oct 04 21:18:00.488488 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2559/5033] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:00.498770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:00.500107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:00.501768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:00.513188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.513908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.514741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.518178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.520195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.528098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.603429 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-782c683e-b7a7-450f-ae35-d719e5f5a7ea tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 0.989900 Oct 04 21:18:00.609591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2475/5034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:59 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:00.628121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:00.629617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:00.659223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.662246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.663172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.693423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.693423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.693423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.186029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.193324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.227496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.234580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.244663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.249306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.252142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dedba1d4-0ced-4411-b6f5-e0ba4592a45c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.761451 Oct 04 21:18:01.254273 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2560/5035] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:00 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:01.255280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d50a4979-223a-4dac-9c96-4e8925f3bf7e tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.633103 Oct 04 21:18:01.257544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2476/5036] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:00 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:01.278854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:01.302745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:01.304246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:01.326359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.327331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.328140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.329373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.329568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.330273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.330461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.341258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.347531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.386681 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] Creating event network-changed:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:18:01.396176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f002a4ed-24aa-48a9-a7bd-f40a289083d3 req-40352e86-5c3b-41df-9614-2dbca5486043 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136155 Oct 04 21:18:01.404549 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2477/5037] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:01.421516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:01.427356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:01.456337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.464114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.465307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.473335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.473335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.473335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.736475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:01.775084 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-721dc860-ae05-4f95-873e-69de59257011 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1294 microversion: 2.1 time: 0.508391 Oct 04 21:18:01.776157 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2561/5038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:01 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1294 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:01.805333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:01.806885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:01.837945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.839183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.840048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.841617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.842586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.843355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.551606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:02.589018 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-732ebda7-d21c-4fb5-a697-12005fb10129 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 0.809510 Oct 04 21:18:02.593394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2562/5039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:01 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:02.620156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:02.621792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:02.652345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.653246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.654497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.660379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.664236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.665466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.843547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:02.884292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69bfafee-886c-4ea3-acad-69ddf6942cfd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1494 microversion: 2.1 time: 1.466339 Oct 04 21:18:02.900775 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2478/5040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:01 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1494 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:02.916724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:02.921453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:02.936757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.937581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.938736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.940485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.942392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.943578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.989422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.035856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.041809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.045268 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbf17e5d-22c0-4ae8-aec7-0d3b58bb379f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.446577 Oct 04 21:18:03.056297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2563/5041] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:02 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:03.080999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:03.082455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:03.105824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:03.108182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:03.115949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.116970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.117811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.119239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.120110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.131912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.243057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=20 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:03.609734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.658650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.675951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.681925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:03.687794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-efea7549-dcc8-4636-90da-abd95644553a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.783747 Oct 04 21:18:03.695369 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2479/5042] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:02 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:03.719185 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-618e380f-223e-4b5a-9503-d3ca05f8a143 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1294 microversion: 2.1 time: 0.660719 Oct 04 21:18:03.720672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:03.721357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2564/5043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1294 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:03.731986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:03.751859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:03.760415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.761846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.763540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.770351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.771903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.773068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.940750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:03.946990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:03.969615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.970714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.971725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.973819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.976667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.978002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.205859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:05.240698 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8fbd7100-d46c-454f-96da-957b9195a9e9 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1494 microversion: 2.1 time: 1.309246 Oct 04 21:18:05.247116 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2565/5044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1494 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:05.276116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:05.277320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:05.308786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.309766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.310599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.311563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:05.314880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.317635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.321829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.083798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.099178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:06.128230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.135166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.148867 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aafdee12-eca6-4708-8d3e-e05ebbdd6666 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.894703 Oct 04 21:18:06.163406 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2566/5045] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:05 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:06.205692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.207561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.222173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.223609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.224767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.226392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.227619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.228744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.278888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.313054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae881992-b15e-4201-bb83-bf4fedc724d1 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 2.611295 Oct 04 21:18:06.318806 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2480/5046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.348690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.349822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.365309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.366312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.367363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.368836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.369685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.370875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.449269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.491999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.501624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:06.506917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:06.509104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28603a9b-728c-4d8b-bd74-210c6f87ac8b tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.343116 Oct 04 21:18:06.530714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2567/5047] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:06.536769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.538329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.574930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.576084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.581334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.588802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.596006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.599666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.358003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:07.392671 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c24df45-e7f8-4f0d-b327-70f45354a6b6 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 200 len: 1292 microversion: 2.1 time: 0.875961 Oct 04 21:18:07.394433 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2568/5048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 1292 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:07.406770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3561a7-3c90-4c66-90c8-74624604620e", "name": "network-vif-deleted", "tag": "9d0b3d09-c580-47f5-8342-8fa713516efd"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:07.431771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.433530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.434389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.461158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] Creating event network-vif-deleted:9d0b3d09-c580-47f5-8342-8fa713516efd for instance 5b3561a7-3c90-4c66-90c8-74624604620e on n-h2-851029-13 Oct 04 21:18:07.472696 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-11109e80-bcca-4278-a1d6-15a6a8249fd6 req-69edbe5b-36f6-4dc2-ae02-c9dd5399f5d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074825 Oct 04 21:18:07.475104 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2569/5049] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:07.486785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:07.489409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:07.503707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.505462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.506403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.508084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.509151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.511030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.922572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:07.966633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0cc2d683-a078-49d1-a335-b299a39d473d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 1.645459 Oct 04 21:18:07.967810 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2481/5050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:07.996082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.004817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.009303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.041157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.047705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.051168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.054450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-05ff0e5a-142f-4390-931b-beb875cd623b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.577041 Oct 04 21:18:08.055080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.058214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.060327 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2570/5051] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:07 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:08.064759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.069718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.073548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.083319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.088577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.115704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.118607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.123383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.126273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.132850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.140401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.632066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.674044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.687053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:08.689772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba3617d6-707e-4d21-b7d4-3c98d454bfd3 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.627531 Oct 04 21:18:08.692670 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2571/5052] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:08.732890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.732890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.758287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.760617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.766848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.772653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.777099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.779498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.871430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e HTTP/1.1 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5b3561a7-3c90-4c66-90c8-74624604620e'} Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:08.880753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:08.889512 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4f328974-0c74-49ac-99c5-b6490e2d67ff tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 404 len: 111 microversion: 2.1 time: 0.193805 Oct 04 21:18:08.894901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2572/5053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:08.937078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.938369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.966708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.967508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.970123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.974105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.975460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.979755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.053693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e HTTP/1.1 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5b3561a7-3c90-4c66-90c8-74624604620e'} Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:09.064828 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.072203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:09.079478 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1dbdb0ef-dd72-420d-8bef-cddfe79f8d2a tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 404 len: 111 microversion: 2.1 time: 0.146214 Oct 04 21:18:09.079478 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2573/5054] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:08 2022] DELETE /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:09.091162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.092969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.109135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.110449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.111706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.113413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.115311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.116584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.123860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.158835 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-feab4e6a-b7fe-4b1c-8518-97e801a1c1c4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 1.183574 Oct 04 21:18:09.165973 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2482/5055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:07 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:09.181842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.184901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 5b3561a7-3c90-4c66-90c8-74624604620e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.216642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.218685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.221453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.229617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.231381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.232021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.281038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e HTTP/1.1 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '5b3561a7-3c90-4c66-90c8-74624604620e'} Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.289156 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 5b3561a7-3c90-4c66-90c8-74624604620e could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:09.296001 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf9d8a4f-9e4f-40cd-ae92-6716b80a64eb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e" status: 404 len: 111 microversion: 2.1 time: 0.123850 Oct 04 21:18:09.296977 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2483/5056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/5b3561a7-3c90-4c66-90c8-74624604620e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:09.318125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.326281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.352164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.360156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.360156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.360156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.361150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.362135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.756696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.781324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.794279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:09.804243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fad4fac-ef86-4686-8c20-632499d1dd8b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.501596 Oct 04 21:18:09.805341 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2484/5057] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:09.831225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.840916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.874539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.880352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.881578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.887764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.889698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.891016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.940038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee HTTP/1.1 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7251a32f-3119-4f18-b2f9-5cea58058cee'} Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:09.945449 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:09.956846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:09.962456 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-276b753a-b58e-437a-9a21-e6d43b7d32ce tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 404 len: 111 microversion: 2.1 time: 0.154954 Oct 04 21:18:09.964974 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2485/5058] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:09 2022] DELETE /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:09.978246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.981354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.077984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.081391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.082626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.088624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.096955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.100148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.336561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:10.359869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fa5d3615-b216-4bfb-83dc-4b2cf5edea9e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 1.277918 Oct 04 21:18:10.361930 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2574/5059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:10.371021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.372647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7251a32f-3119-4f18-b2f9-5cea58058cee] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.387100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.392988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.392988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.392988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.392988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.392988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.423955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:10.445564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:10.449931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:10.453002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50b5ce5d-704a-4aa3-8b2e-b5292b2d0adb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.485539 Oct 04 21:18:10.456919 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2486/5060] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:10.468286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.469478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.469690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee HTTP/1.1 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7251a32f-3119-4f18-b2f9-5cea58058cee'} Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.472991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7251a32f-3119-4f18-b2f9-5cea58058cee could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:10.479228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21000722-7fdc-4c53-b69b-fd33721e957f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee" status: 404 len: 111 microversion: 2.1 time: 0.112398 Oct 04 21:18:10.484052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.484765 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2575/5061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/7251a32f-3119-4f18-b2f9-5cea58058cee => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:10.485111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.487862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.489388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.490357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.491269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.493920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.509676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.538847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.545386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.546383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.552390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.553392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.562810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.606464 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 HTTP/1.1 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a7933890-cdf7-4f94-9d42-9611d5fb86b0'} Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:10.611670 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.627210 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.631415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:10.634076 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f685fd0-f903-4716-b87e-3a08f91924f4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 404 len: 111 microversion: 2.1 time: 0.147143 Oct 04 21:18:10.638173 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2576/5062] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:10 2022] DELETE /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:10.672382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.675794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: a7933890-cdf7-4f94-9d42-9611d5fb86b0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.693201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.694517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.696701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.697948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.699234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.700074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.760197 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 HTTP/1.1 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a7933890-cdf7-4f94-9d42-9611d5fb86b0'} Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.769500 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance a7933890-cdf7-4f94-9d42-9611d5fb86b0 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:10.775839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb1ef99c-24ca-4be2-a397-58366fad6c12 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0" status: 404 len: 111 microversion: 2.1 time: 0.126000 Oct 04 21:18:10.780457 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2577/5063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/a7933890-cdf7-4f94-9d42-9611d5fb86b0 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:10.790227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245ad0f0-f9b9-4a07-876f-1e2db9a4f26a", "tag": "d055c4f3-01c1-4f27-8dad-86ffbbbe8b24"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:10.881019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.886333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.893624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.933298 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] Creating event network-changed:d055c4f3-01c1-4f27-8dad-86ffbbbe8b24 for instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a on n-h1-851029-13 Oct 04 21:18:10.967629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0bc2146a-74fc-430c-9abe-5ed79ecec3df req-cd23e103-b005-498a-8b8c-6736e0c0f645 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180524 Oct 04 21:18:10.969626 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2578/5064] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:10.984524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.986358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.009667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.011206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.012471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.014257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.015601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.018612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.078164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 HTTP/1.1 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1663c717-5ddc-472c-83da-8c1e8589bb24'} Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:11.083221 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.089615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.093204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:11.095251 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-753359fe-d6ea-4370-8a75-d58a6604f673 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 404 len: 111 microversion: 2.1 time: 0.122135 Oct 04 21:18:11.101479 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2579/5065] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:10 2022] DELETE /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:11.108724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.110020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.122632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.123473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.124585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.126344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.127666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.129391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.251569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.283265 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe5e2aa3-3c19-4a0b-b09a-cad695e0b014 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 0.823900 Oct 04 21:18:11.303186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2487/5066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:11.313309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.314889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 1663c717-5ddc-472c-83da-8c1e8589bb24] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.339387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.351958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.353150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.354800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.355935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.356945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.401304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.432578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 HTTP/1.1 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1663c717-5ddc-472c-83da-8c1e8589bb24'} Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.444759 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. Oct 04 21:18:11.452993 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.455572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 1663c717-5ddc-472c-83da-8c1e8589bb24 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:11.457580 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78c69be8-a4ec-4941-8255-9ede1941a179 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24" status: 404 len: 111 microversion: 2.1 time: 0.152261 Oct 04 21:18:11.463489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.464416 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2488/5067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/1663c717-5ddc-472c-83da-8c1e8589bb24 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:11.472265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:11.477431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.479263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b4199e8-646d-411a-af30-40dba7574920 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.374290 Oct 04 21:18:11.479459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.483796 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2580/5068] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:11.500604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.501946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.504836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.506753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.510200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.512806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.518198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "name": "network-vif-plugged", "status": "completed", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:11.603225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.619304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.622081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.673763 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] Creating event network-vif-plugged:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:18:11.692081 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3580bc9a-b12b-4954-8867-00e26d58084d req-d399885d-75d9-4015-901d-bc5e92e4c850 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202616 Oct 04 21:18:11.698490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2581/5069] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:11.735500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.737975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.771272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.777046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.781283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.783452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.788354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.790886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.855893 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c HTTP/1.1 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c'} Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:11.861116 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:11.869344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:11.872251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:11.875269 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47977481-1a4d-4de1-98dd-30f9f379b6b4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 404 len: 111 microversion: 2.1 time: 0.178566 Oct 04 21:18:11.877371 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2582/5070] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:11 2022] DELETE /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:11.890480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.892532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.906152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.907604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.908744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.911097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.913108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.914390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.166418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.190492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.194739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.197818 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c542e763-7f57-4ec5-b08a-a498fef13468 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.317971 Oct 04 21:18:12.200318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2583/5071] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:12.211415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.212959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.227334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.228945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.229990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.231626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.232818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.233965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.277059 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c HTTP/1.1 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c'} Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.281470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f00a839f-27ff-4ce4-aa41-34e4cd9911fc tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c" status: 404 len: 111 microversion: 2.1 time: 0.082396 Oct 04 21:18:12.298223 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2584/5072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/7d75b603-b2f2-4c15-96c7-0e7ece1e1e5c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:12.310528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.312490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.337061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.338133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.339214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.344554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.345951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.347161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.381072 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 HTTP/1.1 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'ac9280ab-caba-4649-aa61-443e4db87c66'} Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:12.385051 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.392677 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.395639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:12.398643 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53797775-d668-4e5a-89c8-c0f2c0fea8fb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 404 len: 111 microversion: 2.1 time: 0.094648 Oct 04 21:18:12.399974 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2585/5073] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:12 2022] DELETE /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:12.412497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.415038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.428922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.430569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.431749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.434920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.436683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.448470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.625036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.666426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-625ae9e1-f7ec-4c11-9e2e-b54fb77e4a99 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 1.199712 Oct 04 21:18:12.681953 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2489/5074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:12.681953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.681953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: ac9280ab-caba-4649-aa61-443e4db87c66] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.697710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.703175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.703175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.703175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.703175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.703175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.741784 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 HTTP/1.1 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ac9280ab-caba-4649-aa61-443e4db87c66'} Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:12.746255 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance ac9280ab-caba-4649-aa61-443e4db87c66 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:12.753506 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9b0ca4f-7ff3-4b1d-b08b-8b1816b04cbb tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66" status: 404 len: 111 microversion: 2.1 time: 0.078217 Oct 04 21:18:12.754458 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2490/5075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/ac9280ab-caba-4649-aa61-443e4db87c66 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:12.763545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.764716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.776325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.777272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.778366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.780011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.781127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.782505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.930523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:12.962718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c67c1875-fea6-4bb0-b9f3-a2841ebeae45 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 0.560037 Oct 04 21:18:12.964882 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2586/5076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:12.997132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.998628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.028419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.029490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.032351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.035121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.037212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.043359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.109649 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 HTTP/1.1 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7b2e363f-c67a-4079-9b97-599136b1c3c7'} Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:13.120378 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.127573 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.128735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.130348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:13.134399 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6b72e30-9722-4005-aade-483285420c6d tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7" status: 404 len: 111 microversion: 2.1 time: 0.163302 Oct 04 21:18:13.141394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2587/5077] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:12 2022] DELETE /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:13.177127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.182219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 7b2e363f-c67a-4079-9b97-599136b1c3c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.191423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.202962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.217209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38045a97-2a2a-46d4-8a14-7276d0e9ad9d tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.460633 Oct 04 21:18:13.219694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.223370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.228425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.230400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.233744 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2491/5078] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:13.235263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.236556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.266302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.268113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.284970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.286406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.287474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.289314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.291890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.293368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.360486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 HTTP/1.1 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7b2e363f-c67a-4079-9b97-599136b1c3c7'} Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.379189 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 7b2e363f-c67a-4079-9b97-599136b1c3c7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-69aa4f4f-04cc-4c44-8e14-5ca670d8d5a4 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7" status: 404 len: 111 microversion: 2.1 time: 0.215908 Oct 04 21:18:13.386603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2588/5079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/7b2e363f-c67a-4079-9b97-599136b1c3c7 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:18:13.396102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.397167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.413664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.418796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.418796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.418796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.419903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.421708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.503999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:13.549061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.596023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.601201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:13.604394 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bbcf603-0e34-407a-9724-c92e50861353 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.348806 Oct 04 21:18:13.607294 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2492/5080] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:13.711826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.714369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.746326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.749393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.750918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.759093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.760355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.761305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.186415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:14.213710 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d78ef7a-884d-42e8-9f05-d1361bc36ca0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 0.508555 Oct 04 21:18:14.216518 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2493/5081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:14.228626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.230409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:14.245491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b8aefa5f-f4fa-4f5c-8af7-c0c80c04c8af tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 204 len: 0 microversion: 2.1 time: 0.861598 Oct 04 21:18:14.250156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2589/5082] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:13 2022] DELETE /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:18:14.251677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.263613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.267256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:14.267775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.270117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.272015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:14.273653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.274843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.302209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.303980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.307677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.309525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:14.314835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:14.319543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:14.975278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.017403 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ec032bc-7735-42b1-8dc6-7fced3647c2a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1322 microversion: 2.1 time: 0.791647 Oct 04 21:18:15.038864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.040334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2494/5083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:14 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:15.063927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:15.066286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:15.075258 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03a5f081-0957-4073-b7c4-bdff3fdb09bd tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1480 microversion: 2.1 time: 0.815089 Oct 04 21:18:15.077613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.078824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.079828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2590/5084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:14 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1480 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:15.080082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.082001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.083406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.084586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.109525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:15.111152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:15.146022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.149507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.154168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.156735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.158148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.159667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.172823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:15.323657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.350050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.356713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.359835 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a59b6f1b-7421-4639-83b5-a39ec9779e6b tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.317456 Oct 04 21:18:15.361355 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2495/5085] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:15 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:15.371115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:15.373761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:15.393787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.417795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.417795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.417795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:15.417795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:15.417795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:15.418541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.442572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.448625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.458969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f539e57c-f73e-4a0d-83e8-0fab0ba06d8a tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1365 microversion: 2.57 time: 0.374772 Oct 04 21:18:15.548717 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2591/5086] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:15 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:15.734946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:15.752383 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f76b129-975f-4a78-a7d6-faef86ba8ef0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 0.387975 Oct 04 21:18:15.756797 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2496/5087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:15 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.082452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.085023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:16.122224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.123635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.124879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.126646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.128136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.130044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.131768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.133355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:16.149446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.150795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.151724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.156188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.160034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.160034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.826779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:16.857621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-295a60d2-58c7-4704-9524-8afd722a4018 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1517 microversion: 2.1 time: 0.794627 Oct 04 21:18:16.865150 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2592/5088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1517 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:16.891636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:16.893142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:16.928544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.929294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.932760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:16.936678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:16.939243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:16.944426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.273691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.310162 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa2bd4b9-ea05-4409-9c54-a9c106ea8013 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1480 microversion: 2.1 time: 1.193298 Oct 04 21:18:17.323219 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2497/5089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1480 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:17.339960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.344568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.405410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.406374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.420694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.422086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.423596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.425176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.591556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.637987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.641714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.649479 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f71cfc9d-e891-419d-831d-16b2575115b7 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.779639 Oct 04 21:18:17.651784 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2593/5090] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:16 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:17.660120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:17.661550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.672543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.674285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.675528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.676845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.677837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.678740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.817849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.853999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.861706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:17.865805 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f81fc12f-5565-4948-b4e6-5542c516caa4 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1371 microversion: 2.57 time: 0.540008 Oct 04 21:18:17.880956 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2498/5091] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:17.934306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:17.943565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:17.955974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.957465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.958874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:17.966729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:17.966729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:17.966729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.015591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lazy-loading 'flavor' on Instance uuid 9e43762a-dfcc-413c-8c76-f5972cf59658 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:18.293005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:18.376502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:18.403964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d1a2fa5-9746-4d64-8f89-1a228bf6cc71 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 0.749407 Oct 04 21:18:18.405120 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2594/5092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:17 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:18.423679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.425451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:18.455277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.456973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.458132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.459804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.472429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.482476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.723676 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-477912c4-7575-40e1-a891-30fb5f4ac05f tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action" status: 200 len: 32 microversion: 2.1 time: 0.811128 Oct 04 21:18:18.733453 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2499/5093] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:18:17 2022] POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action => generated 32 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:18:18.787909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:18.793289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:18.822170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.823876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.825328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:18.827948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:18.830073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:18.831634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.212029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.244528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.254899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.286822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ddcfb0a-4b65-4e9e-870c-5ba87eb44bb1 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.520178 Oct 04 21:18:19.286822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2500/5094] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:19.295024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.346959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.346959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:19.348814 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e996f5e-686f-4916-b12b-e6a207e95e93 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1480 microversion: 2.1 time: 0.936624 Oct 04 21:18:19.351437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2595/5095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:18 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1480 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:19.373843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.374698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.375503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.376841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.378227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.385861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:19.392929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:19.396755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.430478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.431803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.433150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.434874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:19.437084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:19.438587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:19.952365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:19.991779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:20.007299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:20.015906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40c8f26e-303e-4ea6-86d2-eae09e8f3738 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1371 microversion: 2.57 time: 0.661359 Oct 04 21:18:20.017152 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2596/5096] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1371 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:20.048927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:20.052664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:20.087589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.089980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.096710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.096710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:20.096710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:20.096710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:20.980681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.013115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5934a7a5-4acc-4810-a843-50f873b7c7bf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 1.711821 Oct 04 21:18:21.014791 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2501/5097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:19 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:21.037228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.046943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:21.071389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.072556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.073289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.080445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.080445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.080445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.380481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.420513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.428942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:21.435076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f357b64a-4776-4c8b-800d-a882447716d6 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.418572 Oct 04 21:18:21.451178 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2502/5098] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:21.469137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:21.478308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:21.492205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.493429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.494455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:21.496054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:21.497180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:21.498162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.683148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:22.717876 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aca758a3-1cab-46fe-8b55-8a9cd21d0b32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 2.689794 Oct 04 21:18:22.717876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2597/5099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:20 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:22.745648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7e7c55520c48f59cec34c685a91083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dc68bf379143d0918f3395c2bd67d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:22.785746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ea2a2b5d-0487-4cbf-9127-6f61fa200b7f tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 200 len: 1278 microversion: 2.1 time: 1.329485 Oct 04 21:18:22.789606 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2503/5100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:21 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 1278 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:22.812106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:22.818000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:22.861323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.865419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.870787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:22.873132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:22.892631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:22.895946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.200592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:23.224201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:23.236670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:23.239172 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc048f36-a61a-47d3-b35c-44a9a48210eb tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1356 microversion: 2.57 time: 0.446738 Oct 04 21:18:23.262701 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2504/5101] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:22 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1356 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:23.263776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:23.268872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:23.294711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.295996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.297145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.300312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.305130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.308609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd4dda-1b94-4010-a079-02b68a91dea4", "name": "network-vif-deleted", "tag": "53fe7116-b114-4972-be78-5cfc2974a4fc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:23.309143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.358027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.358929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.359685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.383649 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] Creating event network-vif-deleted:53fe7116-b114-4972-be78-5cfc2974a4fc for instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 on n-h1-851029-13 Oct 04 21:18:23.404531 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1e3bceda-5ca9-4304-9839-13f83f7d0b6b req-cd2c9362-293a-4930-83d7-cea597583d3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.678992 Oct 04 21:18:23.407024 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2598/5102] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:23.436530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ad0f0-f9b9-4a07-876f-1e2db9a4f26a", "name": "network-vif-plugged", "status": "completed", "tag": "d055c4f3-01c1-4f27-8dad-86ffbbbe8b24"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:23.466896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.468429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.469637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.497403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] Creating event network-vif-plugged:d055c4f3-01c1-4f27-8dad-86ffbbbe8b24 for instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a on n-h1-851029-13 Oct 04 21:18:23.510293 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-44466527-58b0-4e02-9a0e-2704c24c1eb7 req-1e42a33b-d94d-4704-a83a-4cf782bfad93 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100061 Oct 04 21:18:23.543647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2599/5103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:23.606300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:23.608314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:23.637872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.650832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.651895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:23.653240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:23.654131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:23.654997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.027147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.089965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.095465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.098009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-949d5423-4e2c-4b3b-bef4-8476785b4aa3 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.554622 Oct 04 21:18:24.099444 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2600/5104] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:23 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:24.136053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.146648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:24.165942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:24.215392 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9a5080e-2b18-4946-a5e4-6834a4d457a0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 0.956481 Oct 04 21:18:24.222700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2505/5105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:23 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:24.228767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.232071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.235393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.241329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.244703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.247149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.256434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:24.258998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:24.287353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.289030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.296626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.296626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.296626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.296626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.358934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:24.785563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:24.805489 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e0a3e77-c868-41fd-af8c-976d52eac189 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1362 microversion: 2.1 time: 0.580110 Oct 04 21:18:24.809644 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2506/5106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:24 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:24.817619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:24.818766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] [instance: 9fbd4dda-1b94-4010-a079-02b68a91dea4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:24.831208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.832114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.832747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.833953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:24.834775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:24.835681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:24.856174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] HTTP exception thrown: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Request method failure captured: Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 HTTP/1.1 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKFAkGnZPDi-RmNtt3RLB6Y0fSuW_ZUEw6zWyD0fBNArPc32_G_6CbOC3X43VgV4gh42My47o1MLLPTIA2B8jd_4WsDOqLCAuE1GoJguHInexeJH6LhIwnQl2CbH2ElWx-4Z8KE5YSMbzPw2sjE3blzqmJ6O2EM1XQo1BIAhYg01668 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_42dc68bf379143d0918f3395c2bd67d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersTestJSON-1834808096 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 42dc68bf379143d0918f3395c2bd67d0 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersTestJSON-1834808096 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 6e7e7c55520c48f59cec34c685a91083 Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersTestJSON-1834808096-project Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9fbd4dda-1b94-4010-a079-02b68a91dea4'} Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:24.926831 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] Returning 404 to user: Instance 9fbd4dda-1b94-4010-a079-02b68a91dea4 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8cdb899e-9265-4ec1-85df-ebdb0e667703 tempest-ServersTestJSON-1834808096 tempest-ServersTestJSON-1834808096-project] 10.222.0.36 "GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4" status: 404 len: 111 microversion: 2.1 time: 0.051539 Oct 04 21:18:24.934954 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2507/5107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:24 2022] GET /compute/v2.1/servers/9fbd4dda-1b94-4010-a079-02b68a91dea4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:25.172605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.186766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.201167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.202097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.203277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.209552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.209552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.209552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.283128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e57ccc5-d14f-43e7-93fc-875949302fa9 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 204 len: 0 microversion: 2.57 time: 1.179381 Oct 04 21:18:25.286544 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2601/5108] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:18:24 2022] DELETE /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:18:25.301832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.315137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.331461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.332529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.333457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.334995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.335974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.336794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.490176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.615762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.628378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:25.631192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ff020b2-94df-4d70-a32c-80bf135f360a tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.470917 Oct 04 21:18:25.634495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2508/5109] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:25.648483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:25.659629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:25.699174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.700262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.703836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:25.708250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:25.709378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:25.717451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.243882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.279828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.286295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.293354 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7157d033-5084-4ee7-a5f0-7eed04ceed3f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1362 microversion: 2.57 time: 0.653990 Oct 04 21:18:26.295700 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2509/5110] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1362 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:26.320694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:26.323195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:26.351346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.355670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.358920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.363229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.364697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.368902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.713031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:26.759489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c9ef59a-c39e-4bea-80af-e4829652a4ad tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 1.458427 Oct 04 21:18:26.765487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2602/5111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:25 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:26.793728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:26.800269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:26.821017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.821294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.822458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:26.824698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:26.827541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:26.831010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.063247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.116409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.125183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.132493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-45d98eb0-a2fe-4cf4-afb4-e04199e462eb tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.358248 Oct 04 21:18:27.151881 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2603/5112] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:26 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:27.367819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:27.369808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:27.416304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:27.417999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.422148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.422148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.422148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.422148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.423061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.448809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-708b116c-1f12-4d55-a648-19917f5a6e34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1548 microversion: 2.1 time: 1.147476 Oct 04 21:18:27.454869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2510/5113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:26 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1548 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:27.503587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:27.504908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:27.517415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.519622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.520824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.522430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:27.523691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:27.524736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:27.983975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.021059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.024887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:28.030008 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7531b22-97a0-413e-b8a7-3336e8c0ff1f tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1362 microversion: 2.57 time: 0.674905 Oct 04 21:18:28.030935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2604/5114] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:27 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1362 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:18:28.055248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:28.056602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.079594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.080545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.081384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.094905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.097156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.097918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.185806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68c84f1b-27af-4fee-8fc8-af8d1967c93a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.691237 Oct 04 21:18:28.187811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2511/5115] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:18:27 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-interface => generated 285 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:28.202899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:28.208028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:28.238590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.241644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.246648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:28.248614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:28.250937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:28.252317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.683011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:29.722432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:29.732201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:29.747036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59f344bf-d56f-45d4-a1fc-48507ba00fbf tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 1.546857 Oct 04 21:18:29.785730 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2512/5116] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:28 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:29.809039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:29.811615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:29.826036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.830997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.830997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.831942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.833108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:29.834230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:29.997823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:29.999877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:30.001226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:30.004928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lazy-loading 'fault' on Instance uuid c40fac68-ee8d-41bc-b8bd-51bb32875d01 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:30.177742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:30.213214 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bf0977a-885e-496e-a40f-130c663d4922 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 2.176341 Oct 04 21:18:30.215532 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2605/5117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:28 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:30.442118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:30.478515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:30.493050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a684380da5f4c4c97800a2ba4c6d13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0f9829125442fc865a57c51fb55fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:30.502824 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5240f1cb-0ef2-4f32-bbfe-a31e127ac2ac tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 200 len: 1367 microversion: 2.57 time: 0.714409 Oct 04 21:18:30.507677 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2513/5118] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:29 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 1367 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:30.822493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:30.823797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:30.856654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:30.857694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:30.858538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:30.860012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:30.860893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:30.871257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.268277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:31.269416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:31.302634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.305033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.309268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.311181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.319817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.321159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.828221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:31.869699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:31.876099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:31.885259 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-748339de-a18e-4cb2-bd30-9b24aa7c1385 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 1.076021 Oct 04 21:18:31.906041 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2606/5119] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:30 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:18:31.946209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:31.948045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] [instance: c40fac68-ee8d-41bc-b8bd-51bb32875d01] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:31.978628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.985859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.987352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:31.989017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:31.992394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:31.996653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:32.044970 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] HTTP exception thrown: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Request method failure captured: Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 HTTP/1.1 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKLwhn_szPdXqiRI7ol4cAhfZz5zBqhxIhy2bJyx9POm9Aj5emFQfuVhrtWMLYYdB-G2dOyoX084we_F6tzgeOVRtV5YxhPMvOB0iWuq9N_h9YfiNu6PUY2sBDGWvCajzsVZNGS_80XSGnPP5EII6y-ZO9yGiS8g-jwCwU6-Q6O1mC4 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0b0f9829125442fc865a57c51fb55fa2 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerShowV257Test-905290105 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0b0f9829125442fc865a57c51fb55fa2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0b0f9829125442fc865a57c51fb55fa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0b0f9829125442fc865a57c51fb55fa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0b0f9829125442fc865a57c51fb55fa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerShowV257Test-905290105 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0b0f9829125442fc865a57c51fb55fa2 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerShowV257Test-905290105 Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerShowV257Test-905290105-project Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9a684380da5f4c4c97800a2ba4c6d13d Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerShowV257Test-905290105-project Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c40fac68-ee8d-41bc-b8bd-51bb32875d01'} Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:32.049214 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] Returning 404 to user: Instance c40fac68-ee8d-41bc-b8bd-51bb32875d01 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:32.058541 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19238997-4550-45a4-8e87-0bb582d837a8 tempest-ServerShowV257Test-905290105 tempest-ServerShowV257Test-905290105-project] 10.222.0.36 "GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01" status: 404 len: 111 microversion: 2.57 time: 0.145303 Oct 04 21:18:32.073551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2607/5120] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:31 2022] GET /compute/v2.1/servers/c40fac68-ee8d-41bc-b8bd-51bb32875d01 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:18:32.959083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:32.960950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:32.979015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:33.002643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.004210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.005403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.008279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.010006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.010913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.027096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:33.972240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:34.022404 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8081790b-6e33-444e-b115-80071ff7c375 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 2.755702 Oct 04 21:18:34.023672 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2514/5121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:31 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:34.096220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:34.114091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:34.117692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:34.121413 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c6c3c96-6560-4d92-85cf-e03a980f9058 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 1.178330 Oct 04 21:18:34.123655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2608/5122] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:32 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:35.068670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:35.069849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:35.100967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=72 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:35.129400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.130308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.137638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.139427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.147954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.149185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.177919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:35.189608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:35.241653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.242913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.244799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.250256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.252094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.257693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.732841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:35.781042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:35.786900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:35.799771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81d3ded1-c6ea-4d47-977c-70775e80fbae tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.625969 Oct 04 21:18:35.802407 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2609/5123] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:35 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:18:36.176241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:36.219282 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b533ce8-2462-401d-8535-24940e2057d8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 1.154735 Oct 04 21:18:36.223885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2515/5124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:35 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:36.886996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:36.895296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:36.924236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.935625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.937464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.939598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.940860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.942008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.275559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:37.283267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:37.313409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.318223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.319640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.325624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.327028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.328738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.390884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:37.432889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:37.438279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:37.448687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:37.452493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b05b43ef-22fc-4468-8e71-64fe41e08622 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 0.587081 Oct 04 21:18:37.458598 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2610/5125] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:36 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:38.516129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:38.524058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:38.567270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.570436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.572982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:38.575052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:38.576382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:38.577562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:39.633887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.686881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.690494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.693021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d07cd55-6fb0-46b2-a72a-5d43aa5c6335 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1605 microversion: 2.42 time: 1.184473 Oct 04 21:18:39.714715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2611/5126] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:38 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1605 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:18:40.713451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:40.744525 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81ddfc90-371a-42c7-ade5-aa3205b6ebc6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1523 microversion: 2.1 time: 3.477595 Oct 04 21:18:40.747819 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2516/5127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:37 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1523 bytes in 3482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:40.803427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:40.806048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:40.862229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.870767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.871650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:40.892656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.893635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.895610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:40.936333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245ad0f0-f9b9-4a07-876f-1e2db9a4f26a", "tag": "d055c4f3-01c1-4f27-8dad-86ffbbbe8b24"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:41.030150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.033484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.039854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.132499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] Creating event network-changed:d055c4f3-01c1-4f27-8dad-86ffbbbe8b24 for instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a on n-h1-851029-13 Oct 04 21:18:41.159163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-53b73d63-e7be-4c9c-8ad1-216c14463e48 req-cc8040dd-8fa2-4ede-8f43-a0ad40b9cf7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240988 Oct 04 21:18:41.175549 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2517/5128] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:41.191071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.195134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.207995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.208548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lazy-loading 'fault' on Instance uuid c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:41.813963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:41.818401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:41.874820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.875664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.885724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.890379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.892145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.901540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:42.226173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:42.280951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:42.299697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eb6c4a90cee48bc965601aef1eacba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c00a4bd820a4e97ad4255a474beaeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:42.299697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-259a9f74-e5ac-4fd7-b32d-6fb312def4e4 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 200 len: 1610 microversion: 2.42 time: 1.525133 Oct 04 21:18:42.310568 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2612/5129] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:40 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 1610 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:18:43.370180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:43.372693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:43.420705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:43.423224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:43.424193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:43.426523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:43.433415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:43.436748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:43.512519 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] HTTP exception thrown: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Request method failure captured: Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 HTTP/1.1 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKBUTAQOhUdg1kusNId9X1GHXpTXaB4ZMfpgfySvkGembRZuYwkFims1EkrKwxg9y7eV17XYHCD1AsCcTXKviy9yXTv_B_G5fyw_IJt-ZLowMOyJcgZS_aoJkCQHoEIube2BB1brLz_z3wZ32c_wo75t7W1sPa1w5QQOr3A0tmdaaqk Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5eb6c4a90cee48bc965601aef1eacba7 Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7'} Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:43.521250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:18:43.535231 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:18:43.538509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Returning 404 to user: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:43.538509 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae0868b4-14dc-47ef-8e6d-dd5fa2f8e2d9 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 404 len: 111 microversion: 2.42 time: 0.176166 Oct 04 21:18:43.542901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2613/5130] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:18:43 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:18:43.569274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d6f585a-ce6d-49d0-bceb-6022e86eb956 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '.version_select at 0x7f54fa64b790>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:43.590508 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d6f585a-ce6d-49d0-bceb-6022e86eb956 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:18:44.604735 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d6f585a-ce6d-49d0-bceb-6022e86eb956 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38518. Oct 04 21:18:44.675964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:44.690840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc45122d-120d-48ee-a48c-790f2075742a tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1503 microversion: 2.1 time: 2.900641 Oct 04 21:18:44.700451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2518/5131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:41 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1503 bytes in 2912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:44.787897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d6f585a-ce6d-49d0-bceb-6022e86eb956 tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708472453" status: 204 len: 0 microversion: 2.42 time: 1.236813 Oct 04 21:18:44.796491 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2614/5132] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 21:18:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708472453 => generated 0 bytes in 1240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:18:44.804803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-727f90f1-3852-4f72-8e74-a0ff44a12a65 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'create', calling method: .version_select at 0x7f54f56bee50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1870397209", "description": "tempest-description-287710082"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:45.523058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:45.527295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:45.531343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:45.535875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:45.542156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:45.544625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:45.545928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:45.650074 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0916c0a-4b1e-42d7-8435-e80157001432 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.947306 Oct 04 21:18:45.652134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2519/5133] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 4 21:18:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:46.100616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-288410742", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "availability_zone": "nova:n-h1-851029-13", "networks": [{"uuid": "60acd51d-e0d7-4287-b99f-294277d3baa0"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:46.389247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] validate_networks() for [('60acd51d-e0d7-4287-b99f-294277d3baa0', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:47.368335 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-727f90f1-3852-4f72-8e74-a0ff44a12a65 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 2.576081 Oct 04 21:18:47.370985 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2615/5134] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 4 21:18:44 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:47.409510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1870397209"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:47.414833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:47.466880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.478794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.488130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.492955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.510039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.513677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:48.199103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Adding security group ac4549a6-4a16-4b4d-8cbf-a25c4ad05ebb to port bab885b8-1160-4eb7-b445-17f36a9025b5 Oct 04 21:18:48.861975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:48.862818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:48.863518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:48.864267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:48.865029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:48.938315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.939308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.942396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:48.950168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.951139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.951989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:49.037832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Getting quotas for project ed5de2a798ce4714bd0af181cecbe1e0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:49.062276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Getting quotas for user d0164321cdcf40a6af14f5579f249db9 and project ed5de2a798ce4714bd0af181cecbe1e0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:49.134769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:49.139948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:49.409650 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc5ac0a3-60eb-4026-8c45-88c170467d95 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317040 Oct 04 21:18:49.424751 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2520/5135] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:18:49.457686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef1fc372-2dd8-478e-a4eb-7c2e5924f908 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:49.469048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef1fc372-2dd8-478e-a4eb-7c2e5924f908 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:49.652350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef1fc372-2dd8-478e-a4eb-7c2e5924f908 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1328 microversion: 2.1 time: 0.223830 Oct 04 21:18:49.674704 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2521/5136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:49 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1328 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:50.058350 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7660e8f2-536b-41c4-b1bc-20f5d7ec3e8d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action" status: 202 len: 0 microversion: 2.1 time: 2.665387 Oct 04 21:18:50.075425 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2616/5137] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:18:47 2022] POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action => generated 0 bytes in 2684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:18:50.078120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1870397209"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:50.092284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:50.133899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.159990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.162103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.164075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:50.173747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.180484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.184937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.264553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.265145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.265719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.378286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] Creating event network-changed:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:18:50.405936 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-bca5ccc0-43f2-44e5-b7a6-2ea4beff81ed req-794a0392-eb9f-493e-9c22-57a993a37352 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260328 Oct 04 21:18:50.425603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2617/5138] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:50.715945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b43b36ca-2395-41cf-9e36-67c1d3078a49 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:50.725857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b43b36ca-2395-41cf-9e36-67c1d3078a49 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:51.400039 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.security_group_api [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Removing security group ac4549a6-4a16-4b4d-8cbf-a25c4ad05ebb from port bab885b8-1160-4eb7-b445-17f36a9025b5 Oct 04 21:18:51.452082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b43b36ca-2395-41cf-9e36-67c1d3078a49 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1328 microversion: 2.1 time: 0.742547 Oct 04 21:18:51.467196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2618/5139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:50 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1328 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:52.513609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37d51a04-842d-46cb-99a9-4bed012da4be tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:52.523734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37d51a04-842d-46cb-99a9-4bed012da4be tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:53.433409 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37d51a04-842d-46cb-99a9-4bed012da4be tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1328 microversion: 2.1 time: 0.934049 Oct 04 21:18:53.450790 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2619/5140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:52 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1328 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.435518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d009f3b5-0f86-4647-92d6-d80885857f1e tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action" status: 202 len: 0 microversion: 2.1 time: 4.367318 Oct 04 21:18:54.437413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2522/5141] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:18:50 2022] POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action => generated 0 bytes in 4371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:18:54.477630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.482020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.484633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e52e058-49d4-4577-92e5-c2e4b25f8ec4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'create', calling method: .version_select at 0x7f54f5f06dc0>, body: {"pool": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:54.532775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.533602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.545797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.548117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.548978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.549745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:55.254574 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7451678-066b-4599-bb2a-b24ca3c35f70 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1345 microversion: 2.1 time: 0.783268 Oct 04 21:18:55.257783 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2523/5142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1345 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:55.273088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:55.317479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:55.321624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:55.323327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:55.360791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] Creating event network-changed:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:18:55.379225 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-76906868-4355-493a-8ccf-c75ba12d9d30 req-d4f19692-2d35-40ae-835d-c73efd818634 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109869 Oct 04 21:18:55.381620 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2524/5143] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:56.303788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:56.324591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:56.377992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:56.962701 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c8118b71-b186-45ff-8b73-b69feb234100 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1417 microversion: 2.1 time: 0.656745 Oct 04 21:18:56.983869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2525/5144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:56 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1417 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:58.011403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.020115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:58.078822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.079450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.083656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.084954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.091350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.092243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.643448 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-692aa66f-be27-41e5-a512-b15ad855451f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1435 microversion: 2.1 time: 0.640983 Oct 04 21:18:58.652516 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2526/5145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1435 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:59.709315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:59.736695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:59.748699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:59.752323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:59.765232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.766709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.767895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:59.769775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.771156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.772275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.164085 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b747f2b-1872-4e29-85e2-31015a15fdbb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1423 microversion: 2.1 time: 0.466220 Oct 04 21:19:00.176316 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2527/5146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:59 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1423 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:00.307532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=38 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:01.241626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:01.246221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:01.277894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.287722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.288391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.289357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.289912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.290703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.712237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62073b13-c5bd-4e4e-8f6a-9daad93baf46 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1423 microversion: 2.1 time: 0.484385 Oct 04 21:19:01.717314 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2528/5147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:01 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1423 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:02.589223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:02.770619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:02.778187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:02.807791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.812430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.812430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.817402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.818591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.823603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:03.416696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:03.981273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7843899-6dc4-4d9e-bc21-3813ec5a561b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 1.224536 Oct 04 21:19:03.986805 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2529/5148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:02 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:04.780798 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e52e058-49d4-4577-92e5-c2e4b25f8ec4 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.331531 Oct 04 21:19:04.789191 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2620/5149] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 4 21:18:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:04.814329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.130"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:04.819970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:04.835179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.836602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.837766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.839236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:04.840415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:04.841709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:04.896578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:19:04.897657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquired lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:19:05.055129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.057006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.071920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.072994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.074052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.075575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.076596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.077471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.899210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce898945-20a8-4d86-b915-dbf0de261f60 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 0.872880 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2621/5150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] HTTP exception thrown: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Request method failure captured: Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 HTTP/1.1 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKBUTAQOhUdg1kusNId9X1GHXpTXaB4ZMfpgfySvkGembRZuYwkFims1EkrKwxg9y7eV17XYHCD1AsCcTXKviy9yXTv_B_G5fyw_IJt-ZLowMOyJcgZS_aoJkCQHoEIube2BB1brLz_z3wZ32c_wo75t7W1sPa1w5QQOr3A0tmdaaqk Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:19:05.977448 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5eb6c4a90cee48bc965601aef1eacba7 Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7'} Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:05.984731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:05.997647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Returning 404 to user: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:05.997647 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63eae028-597f-44bf-a403-8b23fdb19d7f tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 404 len: 111 microversion: 2.42 time: 0.060687 Oct 04 21:19:05.997647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2622/5151] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:19:05 2022] DELETE /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:19:06.005979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:06.006943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] [instance: c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:06.015642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.016345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.016975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.018096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:06.018921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:06.019717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:06.042224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] HTTP exception thrown: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Request method failure captured: Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 HTTP/1.1 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKBUTAQOhUdg1kusNId9X1GHXpTXaB4ZMfpgfySvkGembRZuYwkFims1EkrKwxg9y7eV17XYHCD1AsCcTXKviy9yXTv_B_G5fyw_IJt-ZLowMOyJcgZS_aoJkCQHoEIube2BB1brLz_z3wZ32c_wo75t7W1sPa1w5QQOr3A0tmdaaqk Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2c00a4bd820a4e97ad4255a474beaeee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2c00a4bd820a4e97ad4255a474beaeee Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1609590703 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5eb6c4a90cee48bc965601aef1eacba7 Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1609590703-project Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7'} Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:06.044792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] Returning 404 to user: Instance c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4669f22-13a1-4221-8f1b-c9b8c276717c tempest-TaggedBootDevicesTest_v242-1609590703 tempest-TaggedBootDevicesTest_v242-1609590703-project] 10.222.0.36 "GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7" status: 404 len: 111 microversion: 2.42 time: 0.047215 Oct 04 21:19:06.053873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2623/5152] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:19:05 2022] GET /compute/v2.1/servers/c1a90dbe-3de6-42d5-8fbc-cc68c2c72ac7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:19:07.037193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:07.045301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:07.103699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.111921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.115700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.120886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.121851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.123221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.856197 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8c2e8a6-a41a-4c7d-a5cc-0f4a82597a7d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 0.832340 Oct 04 21:19:07.857366 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2624/5153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:07 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:07.866508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9799302-aefa-4b64-8c2b-61795daad60a", "tag": "38a4156b-679b-4034-8277-0021af1a43d3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:07.926735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:07.927911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:07.928937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:07.965563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] Creating event network-changed:38a4156b-679b-4034-8277-0021af1a43d3 for instance a9799302-aefa-4b64-8c2b-61795daad60a on n-h1-851029-13 Oct 04 21:19:07.974955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b07003cc-a474-468b-8caa-bd28fa092928 req-57975661-0120-4ec1-975e-8aebe1e6add5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115318 Oct 04 21:19:07.975988 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2625/5154] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:08.993124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5614658c-5b2e-4aac-9192-f28b93ec44b3 tempest-ComputeTenantNetworksTest-1269274517 tempest-ComputeTenantNetworksTest-1269274517-project] Calling method '.version_select at 0x7f54f62a1940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.541477 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5614658c-5b2e-4aac-9192-f28b93ec44b3 tempest-ComputeTenantNetworksTest-1269274517 tempest-ComputeTenantNetworksTest-1269274517-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.557837 Oct 04 21:19:09.542580 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2626/5155] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 21:19:07 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:09.558500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.558500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:09.570130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.573319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.574631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.576167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.578108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.579480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.502778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Building network info cache for instance {{(pid=123542) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:19:10.507507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=63 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:10.601883 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-29a824cc-77a0-42eb-8de3-57525a619b79 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 1.056616 Oct 04 21:19:10.604585 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2627/5156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:09 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.613970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c0c29c4-c967-432e-a704-fd36ecda96c2 tempest-ComputeTenantNetworksTest-1269274517 tempest-ComputeTenantNetworksTest-1269274517-project] Calling method '.version_select at 0x7f54f5871430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:10.912091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c0c29c4-c967-432e-a704-fd36ecda96c2 tempest-ComputeTenantNetworksTest-1269274517 tempest-ComputeTenantNetworksTest-1269274517-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks/08a7af04-b865-4320-bb05-d19c3607018a" status: 200 len: 139 microversion: 2.1 time: 0.304425 Oct 04 21:19:10.914340 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2628/5157] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 21:19:10 2022] GET /compute/v2.1/os-tenant-networks/08a7af04-b865-4320-bb05-d19c3607018a => generated 139 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:10.933637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:10.957595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.960029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.961465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.987111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] Creating event network-changed:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:19:11.008124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0188a43e-0793-46d5-8c21-9cc5fb96fc85 req-d96e7c91-1124-43c2-8c99-d779794a0e99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082778 Oct 04 21:19:11.009037 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2629/5158] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:11.660269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:11.663709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:11.732403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.739557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.744618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.755482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.757787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.764345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.395377 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c907901c-98cf-4ae5-b982-273e3672e36b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 0.747101 Oct 04 21:19:12.454334 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2630/5159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:11 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:13.463025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:13.476649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.517496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.521374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.532550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.545910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.549030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.565884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.835068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:15.086223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Updating instance_info_cache with network_info: [{"id": "bab885b8-1160-4eb7-b445-17f36a9025b5", "address": "fa:16:3e:50:67:bb", "network": {"id": "b356aab2-159e-4241-9ad9-490d50407eda", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2013983542-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba1f9e53677d41118bddc2027b32952b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbab885b8-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123542) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:19:15.100007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-27f84886-6496-4b57-98bb-ef4b2d5f2455 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 1.645966 Oct 04 21:19:15.101640 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2631/5160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:13 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:15.283391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Releasing lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:19:15.286003 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-187356a0-48ad-48da-9260-3a6995ccb40d tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action" status: 202 len: 0 microversion: 2.1 time: 10.479038 Oct 04 21:19:15.291224 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2530/5161] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:04 2022] POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action => generated 0 bytes in 10485 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 21:19:15.306621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.130"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:16.102923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:16.120117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.121411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.123148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.125401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.126743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.127949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.157379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:16.162312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:16.198871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.203715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.204927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.208030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.209491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.214154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.849561 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-07efa7b5-89c4-4882-93ae-53250d4efc33 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 0.698910 Oct 04 21:19:16.853375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2531/5162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:16 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:16.913355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 21:19:16.914814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquired lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 21:19:18.496190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9799302-aefa-4b64-8c2b-61795daad60a", "name": "network-vif-plugged", "status": "completed", "tag": "38a4156b-679b-4034-8277-0021af1a43d3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:18.536095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:18.542312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:18.543152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:18.605069 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] Creating event network-vif-plugged:38a4156b-679b-4034-8277-0021af1a43d3 for instance a9799302-aefa-4b64-8c2b-61795daad60a on n-h1-851029-13 Oct 04 21:19:18.647628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8b95f11e-6891-4e2b-912d-9435e12e5f87 req-441c99b5-2ff4-4222-aad8-251e6ec8d809 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.090355 Oct 04 21:19:18.651611 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2532/5163] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:18.692377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:18.694188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:18.710122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:18.711558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:18.713304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:18.715272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:18.716834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:18.718561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.227342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Building network info cache for instance {{(pid=123541) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 21:19:19.347594 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2efbc9d4-539f-4db7-9321-d6ed88bbec86 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 0.686982 Oct 04 21:19:19.348707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2533/5164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:18 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:19.361580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:19.403276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.405160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.413484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.448116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] Creating event network-changed:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:19:19.472836 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-79e159b1-9016-4577-84e2-8efae4cdc0a9 req-5869d4b2-4e7b-45c4-b173-20cdca0b81ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118301 Oct 04 21:19:19.476012 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2534/5165] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:20.410615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:20.414573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:20.458731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.459522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.460595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.461905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.467077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.467947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.367280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Updating instance_info_cache with network_info: [{"id": "bab885b8-1160-4eb7-b445-17f36a9025b5", "address": "fa:16:3e:50:67:bb", "network": {"id": "b356aab2-159e-4241-9ad9-490d50407eda", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2013983542-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba1f9e53677d41118bddc2027b32952b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbab885b8-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123541) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 21:19:21.479457 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-de66648f-33d8-4da6-8fa1-c86cb833327b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1465 microversion: 2.1 time: 1.080392 Oct 04 21:19:21.481959 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2535/5166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:20 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1465 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:21.568517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Releasing lock "refresh_cache-9e43762a-dfcc-413c-8c76-f5972cf59658" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 21:19:21.568517 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9968f443-fd5c-432a-8f0e-6297ebd3faf8 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action" status: 202 len: 0 microversion: 2.1 time: 6.265283 Oct 04 21:19:21.568517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2632/5167] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:19:15 2022] POST /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658/action => generated 0 bytes in 6268 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 21:19:21.586737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b309679-85cb-4e28-a92f-a8d45335c5c3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '.version_select at 0x7f54f550a0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.532878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.535439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:22.585784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.586630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.587492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.588794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.590064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.590449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.931234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a72a29d4-1c3a-48b8-a339-0747277f1e96 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1650 microversion: 2.1 time: 1.408319 Oct 04 21:19:23.951453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2633/5168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:22 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1650 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:23.987529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:23.988574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.018554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.018554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.018554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.023815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.025339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.027771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.591874 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21607a43-76c1-44c3-8fe3-1999eeb211fa tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1650 microversion: 2.1 time: 0.614608 Oct 04 21:19:24.610028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2634/5169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:23 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1650 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:24.635151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.636434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.650222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.651476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.652290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.653544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.654807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.655936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.877965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b309679-85cb-4e28-a92f-a8d45335c5c3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/a7963c4f-5e39-4307-9868-e599ce560f9d" status: 202 len: 0 microversion: 2.1 time: 3.304033 Oct 04 21:19:24.880407 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2536/5170] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 4 21:19:21 2022] DELETE /compute/v2.1/os-floating-ips/a7963c4f-5e39-4307-9868-e599ce560f9d => generated 0 bytes in 3308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:19:24.906095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d6c3149-00db-4283-b785-373e844f0cd6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '.version_select at 0x7f54f549d0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.400619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-387814e0-636a-485f-a9df-b4e5ec398069 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1650 microversion: 2.1 time: 0.772969 Oct 04 21:19:25.401738 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2635/5171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1650 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:25.859401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d6c3149-00db-4283-b785-373e844f0cd6 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/ac4549a6-4a16-4b4d-8cbf-a25c4ad05ebb" status: 202 len: 0 microversion: 2.1 time: 0.963605 Oct 04 21:19:25.862275 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2537/5172] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 21:19:24 2022] DELETE /compute/v2.1/os-security-groups/ac4549a6-4a16-4b4d-8cbf-a25c4ad05ebb => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:19:25.883719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:25.891275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:25.928863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.930577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.934067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.935563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:25.937504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:25.938643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.010920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:26.329741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1135561555", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "availability_zone": "nova:n-h2-851029-13", "networks": [{"uuid": "60acd51d-e0d7-4287-b99f-294277d3baa0"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:26.464217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] validate_networks() for [('60acd51d-e0d7-4287-b99f-294277d3baa0', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:19:26.683829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-194a8d85-fe19-432d-b6e1-1b4ba1b06fb3 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 204 len: 0 microversion: 2.1 time: 0.813109 Oct 04 21:19:26.685523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2636/5173] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:25 2022] DELETE /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:26.713946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.717891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:26.745676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.746696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.749255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.750921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.751819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.752630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.220801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:27.242371 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11048cef-dbae-4a25-a8eb-bf3f740aaecc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1509 microversion: 2.1 time: 0.541823 Oct 04 21:19:27.243866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2637/5174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:26 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1509 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:27.511273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:19:27.513394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:19:27.515335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:19:27.516598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:19:27.518200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:19:27.566894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.568292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.569370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.580788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.587491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.588581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.632092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Getting quotas for project ed5de2a798ce4714bd0af181cecbe1e0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:19:27.645508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Getting quotas for user d0164321cdcf40a6af14f5579f249db9 and project ed5de2a798ce4714bd0af181cecbe1e0. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:19:27.677536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:19:27.683702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:19:27.920894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-547db3fa-83d6-4cbd-823c-b7fc703bcfc2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596355 Oct 04 21:19:27.923495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2538/5175] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:19:27.948000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10e167a6-6093-4f14-9c38-fa4378241570 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.949207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10e167a6-6093-4f14-9c38-fa4378241570 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:28.199404 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10e167a6-6093-4f14-9c38-fa4378241570 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1329 microversion: 2.1 time: 0.261990 Oct 04 21:19:28.200633 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2638/5176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1329 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:28.292871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:28.295546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:28.325838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.327968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.329096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.330839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.332031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.333349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.698918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:28.743331 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f267b36-c67c-462c-be3c-01cdec3a3ddc tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1509 microversion: 2.1 time: 0.458278 Oct 04 21:19:28.749228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2539/5177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:28 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:29.054614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:29.055565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:29.074708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.076794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.078222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.080045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.083510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.087930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.145513 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f06a4e27-9f9d-47fa-b2d5-5638492a3ec7 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/ips" status: 200 len: 146 microversion: 2.1 time: 0.096505 Oct 04 21:19:29.146961 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2639/5178] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:19:29 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/ips => generated 146 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:29.251484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2e4f824-d16a-456a-8359-82c59fe9cf26 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:29.255674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2e4f824-d16a-456a-8359-82c59fe9cf26 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:29.575439 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2e4f824-d16a-456a-8359-82c59fe9cf26 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1329 microversion: 2.1 time: 0.338584 Oct 04 21:19:29.580349 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2540/5179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:29 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1329 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:29.813431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:29.814655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:29.858249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.867646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.868500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.880491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.882702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.887098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.309281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:30.354153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3e4469a-c469-408a-84ed-006fc819ebaf tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1467 microversion: 2.1 time: 0.558131 Oct 04 21:19:30.372502 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2640/5180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:29 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1467 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:30.625905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fab12a8-5b54-440a-85bf-17c86685541a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:30.632232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fab12a8-5b54-440a-85bf-17c86685541a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:30.815311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fab12a8-5b54-440a-85bf-17c86685541a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1329 microversion: 2.1 time: 0.199873 Oct 04 21:19:30.819149 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2641/5181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:30 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1329 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:31.278530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43762a-dfcc-413c-8c76-f5972cf59658", "name": "network-vif-deleted", "tag": "bab885b8-1160-4eb7-b445-17f36a9025b5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:31.307660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.308521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.309681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.338040 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] Creating event network-vif-deleted:bab885b8-1160-4eb7-b445-17f36a9025b5 for instance 9e43762a-dfcc-413c-8c76-f5972cf59658 on n-h2-851029-13 Oct 04 21:19:31.351117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ce597070-0b9f-4063-81d0-47e985d48800 req-006d660f-6a98-4ebd-91c0-b8756c5bc21b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040383 Oct 04 21:19:31.352182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2541/5182] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:31.406386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:31.409496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:31.445466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.467520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.468450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.469935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.474108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.475166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.504032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:31.543484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.545191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.546118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.546963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lazy-loading 'fault' on Instance uuid 9e43762a-dfcc-413c-8c76-f5972cf59658 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:19:31.630328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3527dc5750294371ae96dcccf4a38a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1f9e53677d41118bddc2027b32952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.633529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc7fa368-afc0-40a6-a601-c8963ef59ba0 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 200 len: 1312 microversion: 2.1 time: 0.235451 Oct 04 21:19:31.635542 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2642/5183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:31 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:31.871186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:31.875265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:31.914043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.915103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.915944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.917321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.918198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.919050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.333260 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1285ca1e-c62b-413e-b51b-806fc33e04b8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1346 microversion: 2.1 time: 0.468417 Oct 04 21:19:32.333260 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2542/5184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:31 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1346 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:32.681385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:32.686009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] [instance: 9e43762a-dfcc-413c-8c76-f5972cf59658] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:32.726654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.726654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.726654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.728425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.729426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.730345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.769206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] HTTP exception thrown: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Request method failure captured: Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 HTTP/1.1 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKL0OMQ_rtm-4SOHFwo9UHHXVv_E7l4qsc9SMiqsAiZp1TyrdkFSXFbaYm6w0cyYiVvkXyrz-Iund_PgwHQmjdPzNRpi5GLJSpDK5cx8QCxfNXperS5Y6iJRXYAMbBR1nkuCtkgzTIzzraTmDARRuZw3QROLtQ11wR1knmQvdHZHq4o Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ba1f9e53677d41118bddc2027b32952b Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2021124103 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ba1f9e53677d41118bddc2027b32952b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ba1f9e53677d41118bddc2027b32952b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ba1f9e53677d41118bddc2027b32952b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ba1f9e53677d41118bddc2027b32952b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2021124103 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ba1f9e53677d41118bddc2027b32952b Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2021124103 Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerRescueTestJSONUnderV235-2021124103-project Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 3527dc5750294371ae96dcccf4a38a7c Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2021124103-project Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9e43762a-dfcc-413c-8c76-f5972cf59658'} Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:32.778953 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:19:32.787466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] Returning 404 to user: Instance 9e43762a-dfcc-413c-8c76-f5972cf59658 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:32.790169 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15e489f3-e305-4c26-abc9-eeaa86800829 tempest-ServerRescueTestJSONUnderV235-2021124103 tempest-ServerRescueTestJSONUnderV235-2021124103-project] 10.222.0.36 "GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658" status: 404 len: 111 microversion: 2.1 time: 0.118252 Oct 04 21:19:32.791822 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2643/5185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:32 2022] GET /compute/v2.1/servers/9e43762a-dfcc-413c-8c76-f5972cf59658 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:33.390496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:33.392745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:33.409204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.410136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.410884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.411956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.412919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.414001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.577936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-896354d9-df38-41c8-b479-957c104e62a4 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1338 microversion: 2.1 time: 0.201916 Oct 04 21:19:33.593784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2543/5186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:33 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1338 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:34.617742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:34.622066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:34.660746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:34.667666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:34.670306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:34.682116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:34.683841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:34.687030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:35.038329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7723d466-200e-4997-9189-e726ad98af0c tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1426 microversion: 2.1 time: 0.430367 Oct 04 21:19:35.078489 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2644/5187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:34 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1426 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:36.113012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:36.116577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:36.129153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.130189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.131125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.132235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.132945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.133598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.363369 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66f72f0e-c1f8-4648-ad86-e7d535c5640b tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1424 microversion: 2.1 time: 0.249332 Oct 04 21:19:36.381930 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2544/5188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:36 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1424 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:36.763223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d960fc05-61ec-493c-8be1-13073ca9e993"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:36.771330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:36.790501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:36.811162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.812536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.813999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.815834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.816875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.817911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:37.431256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:37.431256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:37.467706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:37.470545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:37.471960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:37.475011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:37.477734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:37.498868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:37.615526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:37.630311 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fa18c96-5efe-459a-a673-1bd2255b3b98 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1424 microversion: 2.1 time: 0.217826 Oct 04 21:19:37.647608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2545/5189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:37 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1424 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:38.404793 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d5824e1-e51e-4f93-bb99-6c80447960bf tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.655066 Oct 04 21:19:38.406076 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2645/5190] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:19:36 2022] POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments => generated 194 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:38.682204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:38.683502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:38.718596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:38.720577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:38.724729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:38.729397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:38.733284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:38.735824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:39.224237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e3d45336-5e0c-4799-af67-ac0fa029103a tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 0.552326 Oct 04 21:19:39.236689 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2546/5191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:38 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:40.458166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:40.459635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:40.519979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.526137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.533402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.536422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.540361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.541510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.811597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:41.001631 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6eb748c-52f1-4ea9-b152-3f39d8af5324 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 0.554826 Oct 04 21:19:41.011538 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2646/5192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:40 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:42.057051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:42.063461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:42.101165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:42.127697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:42.130362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:42.131609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:42.134530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:42.140836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:42.144244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:42.180192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=66,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:43.407579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa97237d-4a35-41a8-b0dc-b9f40f2ac552 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 1.359091 Oct 04 21:19:43.417146 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2547/5193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:42 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:43.922531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce713d9-469e-4ac9-8b3b-3b626c1ce72d", "tag": "a52608c9-395f-4e7d-939a-b4c6332b96e9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:44.012014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:44.014304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:44.020399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:44.112339 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] Creating event network-changed:a52608c9-395f-4e7d-939a-b4c6332b96e9 for instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d on n-h2-851029-13 Oct 04 21:19:44.132132 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-03c6d074-aa3e-48ee-9989-6efa570929cb req-e981e24d-7f9d-4f5c-acc8-225570f5add0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222004 Oct 04 21:19:44.138394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2647/5194] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:44.473619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:44.479576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:44.542433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:44.545193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:44.548800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:44.555570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:44.562003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:44.567025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:45.908551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58662127-63d0-4735-9abd-b459963bd692 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 1.443966 Oct 04 21:19:45.955500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2548/5195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:44 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:46.963926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:46.970259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:47.015917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:47.019866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:47.021055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:47.028395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:47.028395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:47.032886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:47.536990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16397ef4-983a-42ef-873f-8af0aa5f72ea tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 0.582270 Oct 04 21:19:47.568190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2648/5196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:46 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:48.625233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:48.627618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:48.668260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:48.719972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:48.721442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:48.724594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:48.733667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:48.735673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:48.743700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:49.975882 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-342ee298-59a4-49c5-8934-448510d3296e tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 1.353686 Oct 04 21:19:49.975882 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2549/5197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:48 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:51.025905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:51.035000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:51.064234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.064234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.064234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:51.064234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:51.064234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:51.071898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:52.533579 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7643c8b7-e794-46fb-86a0-85eb87f62aad tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 1.514904 Oct 04 21:19:52.546702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2649/5198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:51 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:53.589324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:53.592711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:53.609718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.624275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.624275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.624275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.624275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.624275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.777016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce713d9-469e-4ac9-8b3b-3b626c1ce72d", "name": "network-vif-plugged", "status": "completed", "tag": "a52608c9-395f-4e7d-939a-b4c6332b96e9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:53.804216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:53.805280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:53.806922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:53.843757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] Creating event network-vif-plugged:a52608c9-395f-4e7d-939a-b4c6332b96e9 for instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d on n-h2-851029-13 Oct 04 21:19:53.857198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9dd7a560-cfcf-422d-8aee-1db3f0916ee2 req-3af7d885-60cd-430d-95b9-6d7c6fca1365 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086625 Oct 04 21:19:53.867523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2650/5199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:54.410420 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7786e1ac-4ad3-4222-a8e0-71c0b191a7db tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 0.831522 Oct 04 21:19:54.431540 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2550/5200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:53 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:55.459497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:55.463520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:55.511062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.512282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.514840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:55.520340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:55.521130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:55.522493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:56.845614 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5c9fc14-8f29-4587-a4e1-37f0bdeee529 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1466 microversion: 2.1 time: 1.396138 Oct 04 21:19:56.848821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2651/5201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:55 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1466 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:57.901006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:57.904614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:57.924470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.924470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.925080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:57.928224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:57.929552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:57.930508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.479041 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13f6548b-2ebd-4a7f-8e39-acacd385c416 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1651 microversion: 2.1 time: 0.591098 Oct 04 21:19:58.483653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2551/5202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:57 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1651 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:58.532284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:58.533412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:58.558368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.558368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.560024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:58.562289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:58.563497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:58.564859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.004768 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4b84323-8979-4072-89d6-8765ffe5d67f tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1651 microversion: 2.1 time: 0.481223 Oct 04 21:19:59.007263 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2652/5203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:58 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1651 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:59.050165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:59.053557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:59.107828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.113263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.115187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:59.117508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:59.118407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:59.124172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.179664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-768b0e65-a97b-4bb0-894f-2f463509fb67 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1651 microversion: 2.1 time: 1.136843 Oct 04 21:20:00.182417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2552/5204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:59 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1651 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:00.226834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:00.227954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:00.266451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.267216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.268182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.269272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.270726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.272235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.363532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:01.199770 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72697b5b-2e57-44fc-9e71-e16c5776f77d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 204 len: 0 microversion: 2.1 time: 0.979604 Oct 04 21:20:01.201910 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2653/5205] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:00 2022] DELETE /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 0 bytes in 986 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:01.217049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.221164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.251266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.252521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.254958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.256396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.257249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.271978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.735128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:01.772548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.773515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.774057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.914550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:20:02.314755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a7da51a-ee72-4ace-9da7-bb052d2d25ef tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action" status: 202 len: 0 microversion: 2.1 time: 0.587717 Oct 04 21:20:02.328075 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2654/5206] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:01 2022] POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:02.341729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:02.343575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:02.357777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.358067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.358825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.360176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:02.361010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:02.361813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.612278 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5afbec5b-ea82-4ae6-a238-ad352d2d5900 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1657 microversion: 2.1 time: 1.401093 Oct 04 21:20:02.615699 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2553/5207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1657 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:03.175903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:03.219661 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d7dabdc-44c3-48fe-a02c-50ec6ad4dad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.885841 Oct 04 21:20:03.347554 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2655/5208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:02 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:03.671899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:03.673702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:03.689138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.690644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.692546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.694375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.695713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.697528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.789192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:03.846499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-212812654", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": "none"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:04.091867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:04.101480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:04.103685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:04.107322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:04.108718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:04.153811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.156748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.157899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.160971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.160971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.162894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.209208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Getting quotas for project 8a2cdbb44e064628a357313e44b1429a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:04.225304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Getting quotas for user ec8b17c543c843eab49aeb116cbfa7fc and project 8a2cdbb44e064628a357313e44b1429a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:04.261623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:04.267953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:04.269467 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2411118-5fe1-4dc3-96b4-3753ba563e0d tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1657 microversion: 2.1 time: 0.602746 Oct 04 21:20:04.287472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2656/5209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:03 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1657 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:04.386587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.387833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.403996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.404820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.405625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.409066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.413251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.418876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.742634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32877807-fdf4-4dc7-a69f-6d2a7af7fb03 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 2.101349 Oct 04 21:20:04.745168 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2554/5210] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:20:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:20:04.808377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.813954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.429108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.466317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.469568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.471839 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-442c82c5-0c8b-4370-a689-776a0d683da3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1277 microversion: 2.54 time: 0.709024 Oct 04 21:20:05.475374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2555/5211] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:04 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1277 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:05.489206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce713d9-469e-4ac9-8b3b-3b626c1ce72d", "name": "network-vif-deleted", "tag": "a52608c9-395f-4e7d-939a-b4c6332b96e9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:05.526923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.527777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.528591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.583114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] Creating event network-vif-deleted:a52608c9-395f-4e7d-939a-b4c6332b96e9 for instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d on n-h2-851029-13 Oct 04 21:20:05.602810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7af68c19-1cea-4825-8598-d8c04ccfbe08 req-4600d7ac-17e1-41ee-baa4-a90e69eae04f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124807 Oct 04 21:20:05.604894 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2556/5212] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:05.629482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:05.633930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.672494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.673359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.679792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.684654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.685760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.689330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.712501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:05.754211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-255e667c-da37-4b76-bda9-80b135f1c97e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 1.371027 Oct 04 21:20:05.758503 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2657/5213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:04 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:06.037969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-042e7d74-018b-44d0-a29b-019f4daf0d14 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1451 microversion: 2.1 time: 0.426719 Oct 04 21:20:06.041525 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2557/5214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:05 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1451 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:06.538448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.541070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:06.762787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.798527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.815723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:06.818778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:06.822521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.825931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9185012b-a642-49fc-b744-ab3924e5d5a3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1277 microversion: 2.54 time: 0.300153 Oct 04 21:20:06.834591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2658/5215] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:06.854786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.082380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.083603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.119420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.119782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.126469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.127568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.128200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.128661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.257022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.257491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.258246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.259801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lazy-loading 'fault' on Instance uuid dce713d9-469e-4ac9-8b3b-3b626c1ce72d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:07.468626 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d86d0fb8-064b-456a-9759-2525e679a834 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 200 len: 1456 microversion: 2.1 time: 0.392283 Oct 04 21:20:07.470156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2659/5216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 1456 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:07.632517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.655236 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1ddee3c-b6c8-4663-acc9-fd5f07344311 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.842127 Oct 04 21:20:07.655236 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2558/5217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:06 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:07.884214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.884214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.896985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.897478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.897912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.898641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.899143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.899573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.988258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.998551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:08.000177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:08.001417 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3726c490-aa70-46b5-ba84-c663750ed740 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1281 microversion: 2.54 time: 0.126459 Oct 04 21:20:08.002021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2660/5218] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:08.514020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.516282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: dce713d9-469e-4ac9-8b3b-3b626c1ce72d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.529444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.530350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.531206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.532601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.533448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.534902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.564704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] HTTP exception thrown: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Request method failure captured: Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d HTTP/1.1 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKMz53g7LGAmvmTTy9oGyWDgZG222OL1wASgtNbuODXEQGQhLcxrwqMfF7IidrHdTy37iJsoaSg3UtDmf_baEx3MnT2sDbyB30qEvyd3Zn2CxfwGtDU2CC4jFUN9M_rZvkAGrRma3FvsRtdNNUZmp3JQyAlZo2YbJkHUC89GUWxAwPQ Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: ed5de2a798ce4714bd0af181cecbe1e0 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestServerMultinode-380286953 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestServerMultinode-380286953 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: ed5de2a798ce4714bd0af181cecbe1e0 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestServerMultinode-380286953 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestServerMultinode-380286953-project-admin Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d0164321cdcf40a6af14f5579f249db9 Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestServerMultinode-380286953-project-admin Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'dce713d9-469e-4ac9-8b3b-3b626c1ce72d'} Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:08.565971 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Returning 404 to user: Instance dce713d9-469e-4ac9-8b3b-3b626c1ce72d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8efe8d6c-0688-4889-b305-0c79496c25c2 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d" status: 404 len: 111 microversion: 2.1 time: 0.062708 Oct 04 21:20:08.580203 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2559/5219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:08 2022] GET /compute/v2.1/servers/dce713d9-469e-4ac9-8b3b-3b626c1ce72d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:08.585496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.586188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.596724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.597573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.598715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.600310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.601055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.601733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.650902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:08.687754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.688765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.702097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.703603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.705078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.707931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.709374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.711272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.091518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.112170 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1dc5b427-8ff5-4aae-889b-96fe5bc26139 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.431040 Oct 04 21:20:09.113842 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2560/5220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:08 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:09.124436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:09.126046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:09.141426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.143021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.144134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.145972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.147456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.148760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.283709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.301305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.303916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2a35321-8429-4d8f-9f35-d193659152de tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 204 len: 0 microversion: 2.1 time: 0.723906 Oct 04 21:20:09.308953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.308953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-67f3c5e2-86bd-48cf-a28b-b7c81a751a37 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1329 microversion: 2.54 time: 0.191345 Oct 04 21:20:09.313183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2661/5221] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:08 2022] DELETE /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:09.323697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2561/5222] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:09 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1329 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:09.324289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:09.325625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:09.340201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.341325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.342207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.344904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.346135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.347359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.646617 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b32d2df-2c61-4b5b-930a-4959b641e9cd tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1656 microversion: 2.1 time: 0.330291 Oct 04 21:20:09.650335 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2662/5223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:09 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1656 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:10.164512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.166924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.182150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.184175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.185369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.187793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.188639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.189697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.361875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.362933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.378454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.379944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.381050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.383077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.384207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.385211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.516074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.533949 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55c2e9ab-1d29-40be-858b-5e815e8062c6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.378660 Oct 04 21:20:10.540702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2562/5224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:10.548421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.577335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.580542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:10.583066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcfec0d4-7b09-4e49-9a38-af6f03d2fce5 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1335 microversion: 2.54 time: 0.229048 Oct 04 21:20:10.584384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2663/5225] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:10.696302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.697123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.709863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.710467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.711392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.713745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.714949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.715652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.599060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:11.601722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:11.615557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:11.618710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.619601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.620416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.624426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.625849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.626867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.771824 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5ddc2f3-5a60-4d89-8bff-956e5c7957e8 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1656 microversion: 2.1 time: 1.082951 Oct 04 21:20:11.782229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2563/5226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1656 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:11.795895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:11.799688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:11.820628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.822569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.824411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.825724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:11.826947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:11.828062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.993445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:12.011628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:12.015347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:12.018099 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63bb1216-15d1-4490-bd9c-356329d069f1 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1335 microversion: 2.54 time: 0.242648 Oct 04 21:20:12.019784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2564/5227] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:11 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:12.128145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:12.167337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c87f61c-6819-46e5-be77-3c8e7097557e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.583665 Oct 04 21:20:12.189777 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2664/5228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:11 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:12.539755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9799302-aefa-4b64-8c2b-61795daad60a", "name": "network-vif-deleted", "tag": "38a4156b-679b-4034-8277-0021af1a43d3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:12.568601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.568601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.568601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.589584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] Creating event network-vif-deleted:38a4156b-679b-4034-8277-0021af1a43d3 for instance a9799302-aefa-4b64-8c2b-61795daad60a on n-h1-851029-13 Oct 04 21:20:12.600074 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fbb60c92-b2f7-4f56-91ee-32c41f626e07 req-bb976cdd-abbe-4eaa-9b72-714715d61874 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069523 Oct 04 21:20:12.601214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2565/5229] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:12.826182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:12.831756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:12.852720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.853756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.855659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.856659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.859904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.860912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.074698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.076076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.097340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.098187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.098956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.109205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3bfcee2e-fba7-404b-9ca9-16a503e272cb tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1450 microversion: 2.1 time: 0.289637 Oct 04 21:20:13.111455 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2665/5230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:12 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1450 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:13.112725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.118247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.119362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.215867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.218903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.232131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.233284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.234600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.236915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.238514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.239764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.273421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.292840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.297699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.298810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-850bd169-996a-469b-a64a-81bcaad57758 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1356 microversion: 2.54 time: 0.235510 Oct 04 21:20:13.300142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2566/5231] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:13 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:13.360891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c349db01-2e73-44e5-ab51-7b8665b80067 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Action: 'create', calling method: .version_select at 0x7f54f54e3ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1646817949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdUrFOMMko2rqaiKJ33YUarWByHLDqMGGME15syHFWG3iS4+4gevXQWnpj4FMkp0aZtXp2EYjJrHq48s4gBsnBEzq0DlO8cV3b/ZeRpOUcfcPL1ja6hSRGdk2KALsrwHQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:13.394344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c349db01-2e73-44e5-ab51-7b8665b80067 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Getting quotas for project 8a2cdbb44e064628a357313e44b1429a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:13.405481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c349db01-2e73-44e5-ab51-7b8665b80067 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Getting quotas for user ec8b17c543c843eab49aeb116cbfa7fc and project 8a2cdbb44e064628a357313e44b1429a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:13.565916 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c349db01-2e73-44e5-ab51-7b8665b80067 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.206429 Oct 04 21:20:13.568482 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2567/5232] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 21:20:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:20:13.591705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1646817949", "imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:13.597850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.625139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.626211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.629060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:13.631380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a59d7b07-e89c-473c-8b57-c8278a8d1cba tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.425956 Oct 04 21:20:13.632692 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2666/5233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:13 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:13.806469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:13.807283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:13.808249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:13.811145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:13.812003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:14.155333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.156588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.169079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.169907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.170732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.172289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.173114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.180545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.189857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:14.257874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.258452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.259736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.261602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lazy-loading 'fault' on Instance uuid a9799302-aefa-4b64-8c2b-61795daad60a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:14.322572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.336378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.337014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.337935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.340793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.342060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.343694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.376859 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46b0da66-24ae-4d20-947a-a78afa00d3a0 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 200 len: 1455 microversion: 2.1 time: 0.227608 Oct 04 21:20:14.378469 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2667/5234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:14 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:14.419211 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88801651-c505-4e73-9736-fcdc44a9060f tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "POST /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958/action" status: 202 len: 1139 microversion: 2.54 time: 0.838119 Oct 04 21:20:14.420000 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2568/5235] 10.222.0.36 () {62 vars in 1320 bytes} [Tue Oct 4 21:20:13 2022] POST /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958/action => generated 1139 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:20:14.452732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.453562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.463292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.464018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.464597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.465475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.466051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.466809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.560931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.574191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.576149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.577641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7736b91-efca-429b-bd9d-a89bc8e9aeff tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.131173 Oct 04 21:20:14.578381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2668/5236] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:14 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:14.680758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.681733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.694696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.695583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.696371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.697646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.698588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.699225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.951017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.967202 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28bb9b2e-b1d0-447a-853c-ea3a12928dc8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.294259 Oct 04 21:20:14.968277 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2569/5237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:14 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:15.421314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:15.423405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] [instance: a9799302-aefa-4b64-8c2b-61795daad60a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:15.438328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.439528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.440513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.442226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.443599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.444776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.476378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] HTTP exception thrown: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Request method failure captured: Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a HTTP/1.1 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKMz53g7LGAmvmTTy9oGyWDgZG222OL1wASgtNbuODXEQGQhLcxrwqMfF7IidrHdTy37iJsoaSg3UtDmf_baEx3MnT2sDbyB30qEvyd3Zn2CxfwGtDU2CC4jFUN9M_rZvkAGrRma3FvsRtdNNUZmp3JQyAlZo2YbJkHUC89GUWxAwPQ Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: ed5de2a798ce4714bd0af181cecbe1e0 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestServerMultinode-380286953 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ed5de2a798ce4714bd0af181cecbe1e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestServerMultinode-380286953 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: ed5de2a798ce4714bd0af181cecbe1e0 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestServerMultinode-380286953 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestServerMultinode-380286953-project-admin Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d0164321cdcf40a6af14f5579f249db9 Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestServerMultinode-380286953-project-admin Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a9799302-aefa-4b64-8c2b-61795daad60a'} Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:15.479320 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] Returning 404 to user: Instance a9799302-aefa-4b64-8c2b-61795daad60a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-110737a5-fe49-46f9-90d0-6e57204d6d01 tempest-TestServerMultinode-380286953 tempest-TestServerMultinode-380286953-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a" status: 404 len: 111 microversion: 2.1 time: 0.067984 Oct 04 21:20:15.488769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2669/5238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:15 2022] GET /compute/v2.1/servers/a9799302-aefa-4b64-8c2b-61795daad60a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:15.614241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:15.615494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:15.629127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.630041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.630863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.632127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.632903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.633550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.768521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:15.786986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:15.790025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:15.792713 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2bb8dafe-387a-4d69-8516-571140be34e0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.186912 Oct 04 21:20:15.793609 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2570/5239] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:15 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:16.008467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:16.009774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:16.022975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:16.023876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.024698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:16.026399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:16.027233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.028148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:16.455888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:16.473811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d24095a3-3c2f-4e6e-a2d8-f5507880b00a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.479730 Oct 04 21:20:16.475612 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2670/5240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:15 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:16.834540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:16.837958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:16.852463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:16.853834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.855927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:16.858064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:16.861473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:16.862847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.008065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.033762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.035699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.037015 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-644d5831-65ac-4da6-84bc-db0790dd9e7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.212502 Oct 04 21:20:17.037591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2571/5241] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:16 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:17.520775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:17.521949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:17.527804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:17.536109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.537416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.538155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.539479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.540301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.541055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.791295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.803667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c87ef5fa-5a00-4dd8-bebb-718b4190ff25 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.290266 Oct 04 21:20:17.814698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2671/5242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:17 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:18.070347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.071660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.082790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.083743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.084583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.086142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.087061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.087861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.189210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:18.201162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:18.202893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:18.204379 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8a951c37-ebde-4460-b0f5-97926055ae33 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.138550 Oct 04 21:20:18.205089 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2572/5243] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:18.842263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.844671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.859125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.859998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.861190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.862518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.863667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.864456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.892139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:19.254624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:19.256920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:19.263091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:19.273865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:19.274770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:19.275514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:19.276840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:19.277655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:19.278381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:19.513663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.536702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6eea750c-9fa7-4e32-bb57-f24d4ff08c7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.705402 Oct 04 21:20:19.540571 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2672/5244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:19.576063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.596446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.601800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.604736 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68bd9402-5fa3-4efb-8857-226603c14c53 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.363874 Oct 04 21:20:19.606512 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2573/5245] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:19 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:20.573922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:20.576691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:20.603354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.605073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.605874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.607629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.608831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.609857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.658626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:20.664332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:20.701017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.701901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.702703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.707980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.708430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.709004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.045797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.139634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.166100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.174243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39123ec7-109c-4f90-a48d-a65a2f200c6b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.523576 Oct 04 21:20:21.180829 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2574/5246] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:20 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:21.404119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.435349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b8696cf-0bd5-491a-9bcd-133cd4f8db1e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.869534 Oct 04 21:20:21.452652 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2673/5247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:20 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:22.239438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:22.240901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:22.257713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:22.259032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:22.259829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:22.261185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:22.262022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:22.262892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:22.461540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:22.478500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:22.487147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:22.489299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c3fef18c-6f69-4ceb-8dfd-a3d395c0f6f0 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.259488 Oct 04 21:20:22.491742 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2575/5248] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:22 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:22.505454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:22.509534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:22.534058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:22.535644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:22.536195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:22.537469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:22.538198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:22.539023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:22.987594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.009720 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-365cf677-821b-454b-ae91-bcbcd398aa2b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.517863 Oct 04 21:20:23.015509 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2674/5249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:22 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:23.545364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:23.555001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:23.575703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:23.602983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.606516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.610831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.612453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.615069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.617701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.065061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:24.075537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:24.131581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.139390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.145664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.151780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.155487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.162622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.379164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.424298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.434731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.443237 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c67b9cd-b770-44a6-8e19-17e440a581be tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.912158 Oct 04 21:20:24.444928 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2576/5250] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:23 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:25.111545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.146986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e393d535-2508-419a-94ee-da22d0d8c617 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 1.095144 Oct 04 21:20:25.172648 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2675/5251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:24 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:25.505014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:25.506244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:25.539484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:25.540398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:25.541220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.543138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:25.555015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:25.556383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.857260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.877216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.897790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.904344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27e34fad-41ae-4860-b688-a38995e33cb3 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.403705 Oct 04 21:20:25.907657 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2577/5252] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:25 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:26.204588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.206524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:26.256951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.265673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.265673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.265673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.265673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.278024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.916867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.966953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.968485 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a933c5fe-098d-4afc-8d33-4d73c39366d1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1723 microversion: 2.1 time: 0.746102 Oct 04 21:20:26.969609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2676/5253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1723 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:26.971876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:27.000908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.002049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.003510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.005776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.007936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.009119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.244407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.280804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.299966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.302520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf358d63-92d6-47be-9876-904a2bb2f8a6 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.350802 Oct 04 21:20:27.312096 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2578/5254] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:28.024229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.031410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:28.066523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.069808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.071576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.078088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.080106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.082827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.360168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.364217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:28.393603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.407159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.408102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.409647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.410718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.418318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.755236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:28.804653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:28.810404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:28.826276 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ed64b0e-67b0-4c64-9b7a-dd78785c8579 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.478040 Oct 04 21:20:28.838761 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2579/5255] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:28 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:29.324568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:29.362261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7404ab0-36b9-42ba-b63a-ffe86c4329d2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1700 microversion: 2.1 time: 1.354970 Oct 04 21:20:29.399507 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2677/5256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:28 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1700 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:29.420289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:29.465181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.466056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:29.466857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.611828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Going to try to start instance {{(pid=123542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:20:29.913021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:29.914139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:29.986253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.991751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:29.993065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.995970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:29.997263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.000620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.126814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb348cff-8c1c-4e9f-b339-16b00401f638 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action" status: 202 len: 0 microversion: 2.1 time: 0.714955 Oct 04 21:20:30.127959 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2580/5257] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:20:29 2022] POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:20:30.159294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:30.161085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:30.189327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.193324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.199218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.203601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.207105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.208769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.284311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:30.367125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.448934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.459413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.472054 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-145dd6b7-9d6c-44f4-9bcc-f58ab854190e tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.564852 Oct 04 21:20:30.482412 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2678/5258] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:29 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:31.550456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.564304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:31.616811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.622164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.626806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.630234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.634107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.635742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.234731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.265832 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e2971b8-efb7-4495-9f57-5dca1d82c65d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1709 microversion: 2.1 time: 2.128878 Oct 04 21:20:32.273182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2581/5259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:30 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1709 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:32.595597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.641395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.646980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.661391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d2cfdbe-72d8-46cb-8c86-9a61588a5a24 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 1.120925 Oct 04 21:20:32.663825 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2679/5260] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:31 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:33.316512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.317610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.370123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.371099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.381633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.383268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.398902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.399881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.710636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.710636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.751077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.761880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.765256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.767782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.777518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.778759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:34.602414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.643233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.652644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:34.670466 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c121c233-e087-4dc2-a7cf-7aac3e48be7a tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.962444 Oct 04 21:20:34.673082 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2680/5261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:35.722568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.739900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.745765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.763083 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-158f92f2-a109-4ae4-854e-ac5ccf17b072 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1709 microversion: 2.1 time: 2.454733 Oct 04 21:20:35.781389 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2582/5262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1709 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:35.789936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.792165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.799070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.804614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.808552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.812380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.226881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:36.245868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:36.251333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:36.259799 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6751a2b0-2ad6-4bf3-a5b7-3ab0ced86ee8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.538049 Oct 04 21:20:36.274462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2681/5263] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:36.824098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:36.826605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:36.849727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.850967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.851858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.853654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.854810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.855858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:37.310008 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:20:37.310839 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 (ip 10.222.0.36) !!! Oct 04 21:20:37.338058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:37.343018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:37.391808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:37.396786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:37.400636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:37.402849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:37.407568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:37.411566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.073908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.098554 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac06472b-3eb6-447d-97a3-4f765580a604 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1713 microversion: 2.1 time: 1.287747 Oct 04 21:20:38.100058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2583/5264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:36 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1713 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:38.144391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.157778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.162835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.164114 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c88e93f6-68af-4adb-9813-91a75c1ac643 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.858147 Oct 04 21:20:38.164713 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2682/5265] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:37 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:39.232178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.237227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.270100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.275672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.279304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.290244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.294958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.295921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.689519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.745176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.763316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.769294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30639900-a502-4e24-a06d-39ed424ccbb8 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.540740 Oct 04 21:20:39.779680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2584/5266] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:40.831821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:40.833211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:40.850350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.852138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.853845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.856150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.857307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.858589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.345825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.371394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.377733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.380288 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51b221d2-bf5f-49a4-b0fd-8288ccd7f9cd tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1408 microversion: 2.54 time: 0.556753 Oct 04 21:20:41.382514 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2683/5267] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:40 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1408 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:42.442344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:42.445453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:42.476261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.477568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.479648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.481794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.487050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.487050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.804194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:42.832646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:42.837940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:42.840800 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9abee3a-c866-4605-bf62-c2f92b511133 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1426 microversion: 2.54 time: 0.406319 Oct 04 21:20:42.846966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2585/5268] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:42 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1426 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:43.894133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:43.895363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:43.923752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:43.926748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.927985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.929042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:43.930622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.933527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.934924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:44.129019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:44.146612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:44.150127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:44.153235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef819123-52ee-4801-839c-70d827395874 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1414 microversion: 2.54 time: 0.268830 Oct 04 21:20:44.155049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2684/5269] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:43 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1414 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:45.204274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.209436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:45.238723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.268838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.270988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.274640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.279982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.282502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.506851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.526918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.530280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:45.532777 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e5f0f492-23ed-4078-80cd-5da7fdaefb28 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1399 microversion: 2.54 time: 0.335951 Oct 04 21:20:45.533876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2586/5270] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:45 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1399 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:45.580496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23c507c8-0e14-4f9a-9a4d-414a9b053fd9 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '.version_select at 0x7f54f5517e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.759684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23c507c8-0e14-4f9a-9a4d-414a9b053fd9 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1646817949" status: 204 len: 0 microversion: 2.54 time: 0.193954 Oct 04 21:20:45.761126 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2685/5271] 10.222.0.36 () {60 vars in 1319 bytes} [Tue Oct 4 21:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1646817949 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:20:45.780621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.781611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:45.793316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.794285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.795191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.797057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.798267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.799505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.873757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:46.407636 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cfef99d-57a8-45be-852b-7d2998721803 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "DELETE /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 204 len: 0 microversion: 2.54 time: 0.630567 Oct 04 21:20:46.407636 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2587/5272] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:20:45 2022] DELETE /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:20:46.419600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:46.442115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:46.462852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:46.463879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:46.465722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:46.467607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:46.468804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:46.470456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:47.238730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1247870054", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "af3506f1-8c3b-4864-aca9-2feac025438e"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:48.282930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:48.322974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:48.326870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:48.345567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7dd1b8f-2470-41bb-9220-b9cd7a3ccc7d tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1405 microversion: 2.54 time: 1.932407 Oct 04 21:20:48.348072 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2588/5273] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:46 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1405 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:20:49.406222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:49.409251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:49.434799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:49.436204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:49.436891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.438214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:49.448872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:49.449800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.621284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:49.622498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:49.624626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:49.625769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lazy-loading 'fault' on Instance uuid 08ad6dfa-b718-46de-8fcf-4200d3513958 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:49.745313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] validate_networks() for [('af3506f1-8c3b-4864-aca9-2feac025438e', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:49.781335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.809299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.812668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec8b17c543c843eab49aeb116cbfa7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2cdbb44e064628a357313e44b1429a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:49.825510 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b6a7bb1-c9ae-4124-8a47-1ab4f9b9f222 tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 200 len: 1410 microversion: 2.54 time: 0.433579 Oct 04 21:20:49.827178 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2589/5274] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:49 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 1410 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:20:50.880481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:50.884423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] [instance: 08ad6dfa-b718-46de-8fcf-4200d3513958] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:50.917496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:50.918845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:50.925497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:50.927888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:50.928461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:50.929095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:51.017623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] HTTP exception thrown: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Request method failure captured: Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 HTTP/1.1 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKOBzOdJQ60WPDdFmNV6sRqi4ucEZZ04z2GoxJpLLY9Abwvln5wsjCgFTmxMTSH5sZQbHVHrrs7eO6QKrqURYOOj0sIYJWtW6sYwoUyYzVGcQhZYfXA2J12-O2x6GvYxXVWHJf4zlnyNA9pFk0YgHGewHoxguwoFM2eBh0_bo03VY1A Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 8a2cdbb44e064628a357313e44b1429a Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerShowV254Test-731215138 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8a2cdbb44e064628a357313e44b1429a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8a2cdbb44e064628a357313e44b1429a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8a2cdbb44e064628a357313e44b1429a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8a2cdbb44e064628a357313e44b1429a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerShowV254Test-731215138 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 8a2cdbb44e064628a357313e44b1429a Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerShowV254Test-731215138 Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerShowV254Test-731215138-project Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: ec8b17c543c843eab49aeb116cbfa7fc Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerShowV254Test-731215138-project Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '08ad6dfa-b718-46de-8fcf-4200d3513958'} Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:51.026885 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. Oct 04 21:20:51.034687 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:20:51.041215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] Returning 404 to user: Instance 08ad6dfa-b718-46de-8fcf-4200d3513958 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:51.041215 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edbc4234-0ed1-4ad7-b1f8-5469e73b4f0b tempest-ServerShowV254Test-731215138 tempest-ServerShowV254Test-731215138-project] 10.222.0.36 "GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958" status: 404 len: 111 microversion: 2.54 time: 0.167033 Oct 04 21:20:51.055194 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2590/5275] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:20:50 2022] GET /compute/v2.1/servers/08ad6dfa-b718-46de-8fcf-4200d3513958 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:20:51.605297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:51.606121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:51.607093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:51.608167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:51.609189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:51.637349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:51.638850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:51.639977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:51.641728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:51.642942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:51.643744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:51.681588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Getting quotas for project 025fa8d6c053422b893930bd8c8fc1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:51.693671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Getting quotas for user dbfc04f931574f4c9939300eee01755e and project 025fa8d6c053422b893930bd8c8fc1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:51.721401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:51.726459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:51.911024 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a59c202e-a9f6-436b-8eea-3b0e70eba038 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.015786 Oct 04 21:20:51.912160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2686/5276] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 6018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:20:51.934361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ff29ed8-c285-4de3-a56d-f223ecd82af5 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:51.935575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ff29ed8-c285-4de3-a56d-f223ecd82af5 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:52.054884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ff29ed8-c285-4de3-a56d-f223ecd82af5 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:52.080326 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ff29ed8-c285-4de3-a56d-f223ecd82af5 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1217 microversion: 2.1 time: 0.153856 Oct 04 21:20:52.082892 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2591/5277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:51 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:53.130474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0d32da6-422a-419e-823b-2b995f511bb9 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:53.132370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0d32da6-422a-419e-823b-2b995f511bb9 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:53.223251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0d32da6-422a-419e-823b-2b995f511bb9 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:53.235823 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0d32da6-422a-419e-823b-2b995f511bb9 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1217 microversion: 2.1 time: 0.114761 Oct 04 21:20:53.236841 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2687/5278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:53 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:54.286090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:54.288152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:54.310968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:54.313882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:54.314387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:54.314891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:54.315659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:54.316135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:54.316586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:54.436465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:54.469746 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0bf7117-409b-43d6-99d7-107b05066c05 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1221 microversion: 2.1 time: 0.196377 Oct 04 21:20:54.471755 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2592/5279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:54 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:55.512153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:55.514190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:55.528663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:55.529751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:55.530735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:55.533600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:55.535058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:55.536599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:55.547486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=78 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:55.776367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:55.793482 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a360b2e4-38f8-4dea-8b11-171fd7d2e6bc tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1269 microversion: 2.1 time: 0.289633 Oct 04 21:20:55.795160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2688/5280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:55 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1269 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:56.844210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:56.845044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:56.891468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:56.892788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:56.899652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:56.901069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:56.901945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:56.902998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:57.066504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:57.087678 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa7a6fef-b16a-4a2a-b106-25be40559c4b tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1275 microversion: 2.1 time: 0.256372 Oct 04 21:20:57.089749 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2593/5281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:56 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:58.135194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:58.136072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:58.191119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.192194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.193043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:58.195639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:58.200018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:58.201272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:58.807207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:58.821812 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19d6e6fc-b5f1-4f7a-80eb-fb9f1fad3c33 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.694391 Oct 04 21:20:58.839509 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2689/5282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:58 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:58.985859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55882693-0277-4795-b3c4-757af45d107e tempest-ExtensionsTest-842182057 tempest-ExtensionsTest-842182057-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:58.991025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55882693-0277-4795-b3c4-757af45d107e tempest-ExtensionsTest-842182057 tempest-ExtensionsTest-842182057-project] 10.222.0.36 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.396500 Oct 04 21:20:59.006471 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2594/5283] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 4 21:20:58 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:59.007049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5056135-7042-4989-978a-da8f9de8186d tempest-ExtensionsTest-842182057 tempest-ExtensionsTest-842182057-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:59.014129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5056135-7042-4989-978a-da8f9de8186d tempest-ExtensionsTest-842182057 tempest-ExtensionsTest-842182057-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013435 Oct 04 21:20:59.016069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2690/5284] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 4 21:20:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:20:59.873023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:59.876043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:59.913356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:59.915643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:59.916572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:59.920334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:59.921553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:59.922363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:00.318260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:00.338398 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5417d27-bb03-4f98-9f15-f5178d1a5a3c tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.474251 Oct 04 21:21:00.343843 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2595/5285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:59 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:01.117522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e17aec9-79d3-4226-a100-3621244153ca", "tag": "827765ce-317d-420e-9de4-15da6d39a8d3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:01.141174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.141678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.142212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.248626 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] Creating event network-changed:827765ce-317d-420e-9de4-15da6d39a8d3 for instance 8e17aec9-79d3-4226-a100-3621244153ca on n-h2-851029-13 Oct 04 21:21:01.295441 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1af9d322-77c1-472d-8a71-9c11689d7a58 req-82c167ba-4857-4c73-acc6-f44cf5edc234 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180386 Oct 04 21:21:01.300395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2691/5286] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:01.388585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:01.390784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:01.417430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.418306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.419151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.420507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:01.421650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:01.422456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:01.716948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:01.753702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c417e88-b2f1-453f-aed9-ba9370c1a905 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.370539 Oct 04 21:21:01.754794 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2596/5287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:01 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:02.805129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:02.807603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:02.818995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:02.824615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.825863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.826718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:02.827864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:02.828745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:02.829503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:03.080664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:03.096120 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f433425f-52c1-444b-bdf3-e9bc6c98eb47 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.299685 Oct 04 21:21:03.097228 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2692/5288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:02 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:04.131567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:04.141429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:04.144386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:04.178179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.179640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.181228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.182569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:04.183709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:04.184558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:04.192499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:04.492748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:04.512099 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63acf330-6eba-451a-8f55-7be37d887a59 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.389807 Oct 04 21:21:04.514490 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2597/5289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:04 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:05.575803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:05.577064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:05.593832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:05.597993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:05.600640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:05.602379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:05.604168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:05.605063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:05.606575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:06.145281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:06.185212 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad0b74e8-87ee-4557-8e89-eff8b7543600 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.627863 Oct 04 21:21:06.194875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2693/5290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:05 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:07.242752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:07.247058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:07.269806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:07.271644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:07.273124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:07.275194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:07.277243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:07.278574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:07.709566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:07.753302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c14f6e1e-663b-4781-a7c5-6fcaad697707 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.520088 Oct 04 21:21:07.756529 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2598/5291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:07 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:08.099409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e17aec9-79d3-4226-a100-3621244153ca", "name": "network-vif-plugged", "status": "completed", "tag": "827765ce-317d-420e-9de4-15da6d39a8d3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:08.119881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.121275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.122426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.142760 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] Creating event network-vif-plugged:827765ce-317d-420e-9de4-15da6d39a8d3 for instance 8e17aec9-79d3-4226-a100-3621244153ca on n-h2-851029-13 Oct 04 21:21:08.152517 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4e8ff3fd-ae78-4d8a-99fb-30bda613d8d9 req-fcf7ddd4-5d07-4b32-abe8-433d4e83f12d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058629 Oct 04 21:21:08.153324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2694/5292] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:08.801228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:08.802738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:08.816733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.818207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.819195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.821149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.822075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.822935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:09.212706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:09.248740 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71e5fd79-72fe-4dfb-b6b1-83c8b197abb7 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1317 microversion: 2.1 time: 0.456968 Oct 04 21:21:09.252877 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2599/5293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:08 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:10.301713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.303059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.316306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.317080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.317689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.318927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.323806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.324596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.824542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:10.840379 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80e1c51d-15b4-412a-9449-edcb48b06413 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1505 microversion: 2.1 time: 0.548137 Oct 04 21:21:10.844252 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2695/5294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:10.892710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.893294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.902196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.902737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.903186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.903918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.904401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.904807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.943444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7942f93-3c7b-4d3e-9e4d-f9cf112f4f5f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips" status: 200 len: 108 microversion: 2.1 time: 0.055562 Oct 04 21:21:10.944429 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2600/5295] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips => generated 108 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:10.959641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.960462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.971367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.972514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.973606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.976375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.979263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.980838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.071176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f023a9f7-7580-4a2d-83cb-203fafb73d41 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips" status: 200 len: 108 microversion: 2.1 time: 0.116614 Oct 04 21:21:11.073263 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2696/5296] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips => generated 108 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:11.094145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:11.095158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:11.129271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.130200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.135912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.137714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.151706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.151706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.302896 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62648bd5-18a6-4b81-8d67-e27d1d62025f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips/tempest-ServerAddressesTestJSON-483400579-network" status: 200 len: 93 microversion: 2.1 time: 0.211123 Oct 04 21:21:11.326709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2601/5297] 10.222.0.36 () {58 vars in 1398 bytes} [Tue Oct 4 21:21:11 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca/ips/tempest-ServerAddressesTestJSON-483400579-network => generated 93 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:21:11.342490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:11.344476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:11.360632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.361913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.363074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.364696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.365869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.366992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.438536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:12.044142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bf3a795-c329-4ee4-85ee-1056856c79bb tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 204 len: 0 microversion: 2.1 time: 0.708352 Oct 04 21:21:12.051650 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2697/5298] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:11 2022] DELETE /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:12.061256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:12.064131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:12.093951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.098940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.102958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.105474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.106884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.108145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.768913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:12.794385 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c43d7578-df2d-49d0-9bc0-0c6a343aae09 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1511 microversion: 2.1 time: 0.740446 Oct 04 21:21:12.796925 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2602/5299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:12 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1511 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:13.852074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:13.853552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:13.902105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.903023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.903687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:13.904845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.905490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.906160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.817981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:14.856205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39c98f3a-22c2-4443-8f52-052576e4487a tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1511 microversion: 2.1 time: 1.017452 Oct 04 21:21:14.864370 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2698/5300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:13 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1511 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:15.464531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e17aec9-79d3-4226-a100-3621244153ca", "name": "network-vif-deleted", "tag": "827765ce-317d-420e-9de4-15da6d39a8d3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:15.505881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.508135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.509483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:15.581786 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] Creating event network-vif-deleted:827765ce-317d-420e-9de4-15da6d39a8d3 for instance 8e17aec9-79d3-4226-a100-3621244153ca on n-h2-851029-13 Oct 04 21:21:15.608000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3463c7c9-d0b3-43cf-8e94-71645f18c434 req-1271fc32-8cbd-4dcb-806e-b44e98052931 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163373 Oct 04 21:21:15.617752 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2603/5301] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:15.900628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:15.902873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:15.967353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:15.982110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.986586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.987719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:15.992433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.994091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.998132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.423328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:16.423328 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b76ee46b-da29-47e8-9676-fd952825bb64 tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1302 microversion: 2.1 time: 0.471126 Oct 04 21:21:16.423328 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2699/5302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:15 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1302 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:17.435851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:17.438719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:17.467408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.476376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.478710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.482310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.483548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.484329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.556969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.557441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.557893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.558415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lazy-loading 'fault' on Instance uuid 8e17aec9-79d3-4226-a100-3621244153ca {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:21:17.731640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbfc04f931574f4c9939300eee01755e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025fa8d6c053422b893930bd8c8fc1f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:17.749139 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ec30f18-540e-4e88-b371-93b4a2031bdf tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 200 len: 1307 microversion: 2.1 time: 0.325903 Oct 04 21:21:17.806872 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2604/5303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:17 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:18.855080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:18.862306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] [instance: 8e17aec9-79d3-4226-a100-3621244153ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:18.934553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.942222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.943576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.953378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.956137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.958774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:19.079922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] HTTP exception thrown: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Request method failure captured: Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca HTTP/1.1 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKOsvWONS-U1EVzbz6RLxssPH09_tAhg-PEHFefjHsAi-YdeVIM-BgechU7NyNnTsjF9SemjF7wfd-jS3KR7lngc9Uw2QNLFrnlDn4yFrbm1gEDJcZrC2jUrRXG9Dp-2eCnDuqXavydYANFWGg3GzatadUYtJuCm31QOz5U5pxy-NEo Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 025fa8d6c053422b893930bd8c8fc1f9 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerAddressesTestJSON-1403374083 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/025fa8d6c053422b893930bd8c8fc1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/025fa8d6c053422b893930bd8c8fc1f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/025fa8d6c053422b893930bd8c8fc1f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_025fa8d6c053422b893930bd8c8fc1f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerAddressesTestJSON-1403374083 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 025fa8d6c053422b893930bd8c8fc1f9 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1403374083 Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerAddressesTestJSON-1403374083-project Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dbfc04f931574f4c9939300eee01755e Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerAddressesTestJSON-1403374083-project Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '8e17aec9-79d3-4226-a100-3621244153ca'} Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:19.091594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. Oct 04 21:21:19.101418 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:19.103450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] Returning 404 to user: Instance 8e17aec9-79d3-4226-a100-3621244153ca could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:19.105343 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4f717ca-1737-4b86-a0a3-ac5e649c255f tempest-ServerAddressesTestJSON-1403374083 tempest-ServerAddressesTestJSON-1403374083-project] 10.222.0.36 "GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca" status: 404 len: 111 microversion: 2.1 time: 0.271922 Oct 04 21:21:19.116926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2700/5304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:18 2022] GET /compute/v2.1/servers/8e17aec9-79d3-4226-a100-3621244153ca => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:26.720750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:26.724508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.759919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.760858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.761690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.771294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.772432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.774217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:27.043128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lazy-loading 'services' on Instance uuid 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:21:27.592477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97f32c0d-1466-41ec-8c36-99bbcac68bc4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments/d960fc05-61ec-493c-8be1-13073ca9e993" status: 202 len: 0 microversion: 2.1 time: 0.889080 Oct 04 21:21:27.608008 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2605/5305] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:21:26 2022] DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments/d960fc05-61ec-493c-8be1-13073ca9e993 => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:28.862818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd27d62e-a8fc-4c42-9686-331ab8818b41 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: .version_select at 0x7f54f55b0af0>, body: {"keypair": {"name": "tempest-keypair-839483287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN45xQAuH4JyLDe0afHu32F54crfNQ4ypGcUVq12GgdaUlUHuxnSmDUER/cmShqpls00e9uLQYFvPVlmCxjpjmM6hL3PmHh5qJUsWuH+oQ+OXMFgHp8W6zkCSfnEDuUyw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:28.993125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:28.998591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dd27d62e-a8fc-4c42-9686-331ab8818b41 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for project c023b0edf8134957951656c8a7b32840. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:29.028815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dd27d62e-a8fc-4c42-9686-331ab8818b41 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for user 4dfa37193e464de6980fbc6c19567048 and project c023b0edf8134957951656c8a7b32840. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:29.304335 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd27d62e-a8fc-4c42-9686-331ab8818b41 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 2.218707 Oct 04 21:21:29.318463 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2701/5306] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 21:21:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 2235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 21:21:37.427624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1162940810", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33308277-a82e-4e3c-bb45-537c08a9d6c3"}], "security_groups": [{"name": "tempest-securitygroup--1343056108"}], "key_name": "tempest-keypair-839483287", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:37.473113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=27 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:37.474365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:37.769434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] validate_networks() for [('33308277-a82e-4e3c-bb45-537c08a9d6c3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:38.879872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:38.885342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:38.886694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:38.887974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:38.889047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:38.940006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.941490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.942560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:38.945210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:38.946318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:38.947383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:39.003330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for project c023b0edf8134957951656c8a7b32840. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:39.017515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for user 4dfa37193e464de6980fbc6c19567048 and project c023b0edf8134957951656c8a7b32840. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:39.050461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:39.055874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:39.341205 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b5526c4-46e1-4cf1-bcaf-fd7b067de7c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.921875 Oct 04 21:21:39.344337 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2606/5307] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:21:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:21:39.361352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.364728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.375964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:39.378224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:39.519340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:39.543504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:39.547755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:39.551408 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-357908aa-241e-4f01-aa47-adc7da2b512e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1281 microversion: 2.20 time: 0.192587 Oct 04 21:21:39.553956 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2702/5308] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:39 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:40.605493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:40.607353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:40.727175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.747643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.752793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.755557 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bbfbe842-eeb6-4396-8320-374ad4c81370 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1281 microversion: 2.20 time: 0.160412 Oct 04 21:21:40.757734 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2607/5309] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:40 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:41.269348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:41.279331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.279836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.282554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.318732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:21:41.647922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46a6dcd1-831f-4eab-8cd4-4d9a149a7d6c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action" status: 202 len: 0 microversion: 2.1 time: 0.367303 Oct 04 21:21:41.657634 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2703/5310] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:41 2022] POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:21:41.666431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:41.674930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:41.685408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.685606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.686138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.687336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.688266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.689476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.814540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:41.816268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:41.989311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.019570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.027667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.036405 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50c7422c-368e-40cd-ab3f-e4112f3c58ad tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1281 microversion: 2.20 time: 0.228254 Oct 04 21:21:42.038189 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2704/5311] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:41 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:21:42.079727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.094519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c9c2a09-5d80-49bf-a115-9f0d6699118d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.435777 Oct 04 21:21:42.095613 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2608/5312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:41 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:42.660421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6d13940-a19a-4658-86bc-4cc0c7274189 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Action: 'create', calling method: .version_select at 0x7f54f55173a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-97074876", "metadata": {"Type": "work"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6d13940-a19a-4658-86bc-4cc0c7274189 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 120 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-97074876", "metadata": {"Type": "work"}}} Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-97074876', 'metadata': {'Type': 'work'}}}} Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:21:42.677571 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6d13940-a19a-4658-86bc-4cc0c7274189 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:42.682739 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6d13940-a19a-4658-86bc-4cc0c7274189 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.477785 Oct 04 21:21:42.687249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2705/5313] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 4 21:21:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:42.698702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce6dd146-4364-46ae-b8db-65538d1ba090 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Action: 'create', calling method: .version_select at 0x7f54fa5a0700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1122765585", "metadata": {"Type": "work"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce6dd146-4364-46ae-b8db-65538d1ba090 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 120 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1122765585", "metadata": {"Type": "work"}}} Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1122765585', 'metadata': {'Type': 'work'}}}} Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi '0' Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:21:42.704446 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce6dd146-4364-46ae-b8db-65538d1ba090 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce6dd146-4364-46ae-b8db-65538d1ba090 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011051 Oct 04 21:21:42.717163 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2609/5314] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 4 21:21:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9f08131-ad96-4cda-ae99-1cca2d422a1f tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Action: 'create', calling method: .version_select at 0x7f54f55175e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1314177975", "metadata": {"Type": "work"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9f08131-ad96-4cda-ae99-1cca2d422a1f tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 119 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1314177975", "metadata": {"Type": "work"}}} Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1314177975', 'metadata': {'Type': 'work'}}}} Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '' Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:42.728404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9f08131-ad96-4cda-ae99-1cca2d422a1f tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:42.738470 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9f08131-ad96-4cda-ae99-1cca2d422a1f tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014964 Oct 04 21:21:42.740813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2706/5315] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 4 21:21:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:21:42.750370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e38018e-f335-45c8-84d7-618513b0f6d9 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Calling method '.version_select at 0x7f54f5016ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:42.837034 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9e38018e-f335-45c8-84d7-618513b0f6d9 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] HTTP exception thrown: Volume tempest-invalid-1366574319 could not be found. Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e38018e-f335-45c8-84d7-618513b0f6d9 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1366574319 HTTP/1.1 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume tempest-invalid-1366574319 could not be found. Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'tempest-invalid-1366574319'} Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1366574319 could not be found. (HTTP 404) (Request-ID: req-fa6ce309-0b6d-406c-b2ad-bc372b4636ff) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:21:42.841285 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1366574319 could not be found. Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1366574319 could not be found. Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1366574319 could not be found. Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.849883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e38018e-f335-45c8-84d7-618513b0f6d9 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 404 to user: Volume tempest-invalid-1366574319 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:42.856336 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e38018e-f335-45c8-84d7-618513b0f6d9 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1366574319" status: 404 len: 99 microversion: 2.1 time: 0.112431 Oct 04 21:21:42.856336 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2610/5316] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 21:21:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1366574319 => generated 99 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:21:42.874242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2853ad7-d612-45f4-88df-fe46b6f8841f tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008069 Oct 04 21:21:42.892586 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecaa4c1b-11cc-4b9e-b449-b586a6037ae7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007056 Oct 04 21:21:42.899400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2707/5317] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 4 21:21:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:21:42.914987 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2611/5318] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 4 21:21:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 21:21:42.915309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-812ee77a-0bc7-44af-840a-6f0a52c47dae tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Calling method '.version_select at 0x7f54f54988b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-812ee77a-0bc7-44af-840a-6f0a52c47dae tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] HTTP exception thrown: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-812ee77a-0bc7-44af-840a-6f0a52c47dae tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-volumes/3d6e432a-9a6f-4dba-9d21-d48735b99446 HTTP/1.1 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: exception: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3d6e432a-9a6f-4dba-9d21-d48735b99446'} Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. (HTTP 404) (Request-ID: req-6cc7e5eb-9cce-401b-9cdc-00a09007a60b) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:21:42.997234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-812ee77a-0bc7-44af-840a-6f0a52c47dae tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 404 to user: Volume 3d6e432a-9a6f-4dba-9d21-d48735b99446 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:43.005488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-812ee77a-0bc7-44af-840a-6f0a52c47dae tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/3d6e432a-9a6f-4dba-9d21-d48735b99446" status: 404 len: 109 microversion: 2.1 time: 0.091355 Oct 04 21:21:43.017413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdbdf95d-900e-444e-9e54-3a1139ce2ab7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Calling method '.version_select at 0x7f54f54695e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:43.018902 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2708/5319] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:21:42 2022] DELETE /compute/v2.1/os-volumes/3d6e432a-9a6f-4dba-9d21-d48735b99446 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:21:43.065707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-fdbdf95d-900e-444e-9e54-3a1139ce2ab7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] HTTP exception thrown: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdbdf95d-900e-444e-9e54-3a1139ce2ab7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Request method failure captured: Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-volumes/d9773336-9e10-4ccf-9497-cecbc5a22d1b HTTP/1.1 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPmAXBqf1HCWt-GNPfxzDPO6jhnrQ0AF2hr3FDBiSZnsGIBXC2GeGWohG1p9lcvrDomZyzDtU3WAWGFue2WDgJ_yP8VMrudFwWf2Qu2qASecM8E78t4sn_Mj0tHxbJX0SLqNDZgP-TLfb5cGLrUcjlA4U2_6STMrza3h5yqBZk4jT8 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dd285e93624a4bd586710179f3dd4a2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: dd285e93624a4bd586710179f3dd4a2a Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesNegativeTest-973958828 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 87f5c6f36fb849f39aefc3fcc0cafe72 Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesNegativeTest-973958828-project Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd9773336-9e10-4ccf-9497-cecbc5a22d1b'} Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. (HTTP 404) (Request-ID: req-ba801964-ec8b-4cab-ac82-14e24112d07a) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:21:43.085108 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:21:43.091914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdbdf95d-900e-444e-9e54-3a1139ce2ab7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] Returning 404 to user: Volume d9773336-9e10-4ccf-9497-cecbc5a22d1b could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:21:43.095391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:43.095391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:43.095645 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdbdf95d-900e-444e-9e54-3a1139ce2ab7 tempest-VolumesNegativeTest-973958828 tempest-VolumesNegativeTest-973958828-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d9773336-9e10-4ccf-9497-cecbc5a22d1b" status: 404 len: 109 microversion: 2.1 time: 0.082613 Oct 04 21:21:43.095645 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2612/5320] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:21:43 2022] GET /compute/v2.1/os-volumes/d9773336-9e10-4ccf-9497-cecbc5a22d1b => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:43.117229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.117993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.119052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.120332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.121321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.122143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.373654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:43.431905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:43.431905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:43.431905 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-503b9811-b328-40ba-a197-b1fc8e73f199 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1277 microversion: 2.20 time: 0.340039 Oct 04 21:21:43.431905 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2709/5321] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:43 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:43.651906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:43.653104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:43.665201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.668961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.668961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.668961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.669760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.669965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.056413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.066954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f4341a2-7768-4a25-8e3a-4b2098d93c45 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.928111 Oct 04 21:21:44.067765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2613/5322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:43 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:44.501746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:44.504733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:44.525861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.526636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.527780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.529650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:44.530543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:44.531578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.668803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.683207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.690152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.690152 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e486e91b-50b9-47ac-b4c8-bde34fe88362 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1341 microversion: 2.20 time: 0.201611 Oct 04 21:21:44.691353 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2710/5323] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:44 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:45.096837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:45.097643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:45.106916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.107790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.108543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.109459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.111049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.111621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.409155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.442893 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c994b53-7dfc-4ecb-a7a3-5ddffa0c8b00 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.350394 Oct 04 21:21:45.458707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2614/5324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:45 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:45.742797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:45.745736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:45.759322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.760348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.761237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.762836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.763758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.764755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.867566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.886562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.894691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.896897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb72779c-dfb7-4e21-88df-36b02bc42fdf tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1339 microversion: 2.20 time: 0.163802 Oct 04 21:21:45.898532 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2711/5325] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:45 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:46.490520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:46.491658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.538191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.539073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.539798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.541061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.541871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.542598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.951206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:46.954099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.980364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.984334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:46.986031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.996995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.997242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.002110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.003422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.008673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5dba53ee-158e-4c8a-9bf2-6fe1944606ae tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.527089 Oct 04 21:21:47.011014 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2615/5326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:46 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:47.648351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.677114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.684399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.687767 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-336acaaf-dbcb-4de8-bc53-2973e4996954 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.749894 Oct 04 21:21:47.704055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2712/5327] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:46 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:48.056762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:48.066729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:48.090679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.094849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.095527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.097180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.098001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.098758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.340771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:48.360577 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c76af18-d157-4d48-ba3d-b1e6f7f54b9a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.312920 Oct 04 21:21:48.362954 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2616/5328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:48 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:48.737435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:48.738728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:48.750370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.763890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.763890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.763890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.763890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.763890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.115837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.134219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.137043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.138834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28c3ca14-d14f-426b-9f80-deb0a5e8de1e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.410784 Oct 04 21:21:49.140175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2713/5329] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:48 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:49.393101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:49.395749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:49.400482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:49.406721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.407587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.408514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.409996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.410741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.413555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.485260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:49.504414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.506613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.507925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.539340 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] Creating event network-changed:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h2-851029-13 Oct 04 21:21:49.551322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6c634c5b-1c0e-45fa-b861-2be00293b197 req-049618cb-074d-43fc-8057-e7afc31b7c6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071154 Oct 04 21:21:49.552228 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2714/5330] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:49.762603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:49.783606 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bcee38f-6c73-4ff9-8680-688b36e6e393 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.397334 Oct 04 21:21:49.793434 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2617/5331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:49 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:50.197891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.198876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.209507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.210704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.211754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.213316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.214197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.214891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.527226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.547670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.551773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.567749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a042f81-03e3-4aa4-bec1-f437a88602b0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.377676 Oct 04 21:21:50.569616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2715/5332] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:21:50.845454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:50.846952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:50.853768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:50.863487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.864619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.865545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.866987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:50.867976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:50.868880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.253362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.270850 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99183bd5-7296-4bd4-8f02-57ca57d3581f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.438509 Oct 04 21:21:51.287358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2618/5333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:50 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:51.634426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:51.635635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:51.663821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.664768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.665298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.667085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.668306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.669456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.914691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.926313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.931128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.932850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-421f85d8-d734-4c1d-8772-af40a934568d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.320028 Oct 04 21:21:51.947022 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2716/5334] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:51 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:52.309866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.310919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.321322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.322416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.323334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.324659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.325524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.326316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.548077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.567764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a29959f8-51e6-464e-b1e1-92dfaf8c970c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1677 microversion: 2.1 time: 0.264811 Oct 04 21:21:52.569593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2619/5335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:52.979597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.981089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.995114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:52.998436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.999045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.999498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.000402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.001715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.003015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.308573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.325843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.329378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.334323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7da6214b-fb53-423b-a4a6-eff28ca50227 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.357282 Oct 04 21:21:53.334323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2717/5336] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:53.621231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:53.629516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:53.654741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.659238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.661726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.663966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.665305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.669065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.017532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.031181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-03b32213-714b-40db-aa36-16fae3f7f1b4 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1654 microversion: 2.1 time: 0.421214 Oct 04 21:21:54.032983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2620/5337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:53 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1654 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:54.097863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:54.119871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.121268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.126028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.217656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:21:54.386314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.387525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.401042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.402999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.404178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.405714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.407627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.409557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.823546 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dedcb9d7-ef3c-4b17-841e-606cca20a09f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action" status: 202 len: 0 microversion: 2.1 time: 0.734106 Oct 04 21:21:54.839964 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2718/5338] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:54 2022] POST /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:21:54.858353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.859793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.876158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.876656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.878484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.879668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.881430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.884585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.885749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.904143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.906843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.908553 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d5ecb7e-c582-4e7f-b3e3-6910ea368904 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.537564 Oct 04 21:21:54.909597 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2621/5339] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:55.249013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:55.268497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d9a2f30-51cd-4a49-91a8-35790ec3605d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1663 microversion: 2.1 time: 0.426563 Oct 04 21:21:55.279966 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2719/5340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1663 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:55.952085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:55.953396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:55.968438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.969401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.970251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:55.971822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.972809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.976600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.119692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "name": "network-vif-plugged", "status": "completed", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:56.161565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.162644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.163475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.194162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] Creating event network-vif-plugged:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h2-851029-13 Oct 04 21:21:56.219047 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d08a05c0-1978-45cf-825a-721d31e97d39 req-2cbb4d1f-5b4b-4cc4-95ee-ecd903a12b88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102266 Oct 04 21:21:56.223139 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2720/5341] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:56.327907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:56.329125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:56.376234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.380855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.385991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.388663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.391667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.399375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.588461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:56.609056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:56.613247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:56.616018 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-816c915d-aaed-4623-848a-1cf810f0d8d9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.673454 Oct 04 21:21:56.624184 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2622/5342] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:55 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:57.045892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.066141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc744113-c5cc-44eb-875f-99fe44e606b2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1663 microversion: 2.1 time: 0.750562 Oct 04 21:21:57.069998 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2721/5343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:56 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1663 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:57.664345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:57.666266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:57.680957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.681250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.682602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.684589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.685745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.686613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.042977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.075187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.079235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.085963 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ec66fce-8b3a-43d6-87e0-96cd51170a75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1407 microversion: 2.20 time: 0.430078 Oct 04 21:21:58.093095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2623/5344] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:57 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:58.105220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.111976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.150956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.156512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.157731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.159836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.163905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.165087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.067999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.129020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5da0db3f-1f88-438a-8d3f-5f2ffda2c49b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1663 microversion: 2.1 time: 1.036725 Oct 04 21:21:59.139286 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2722/5345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1663 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:59.156277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.159932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.180728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.181634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.182319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.183338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.184090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.184852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.722023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.757739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.764738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.775954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-741cee1e-7faf-4707-9704-6073fead83f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1598 microversion: 2.20 time: 0.626785 Oct 04 21:21:59.777378 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2624/5346] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1598 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:21:59.853429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:59.854603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:59.913398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.914272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.917024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.918562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.922356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.926279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.199820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.201980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:00.216057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.217308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.218362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.220216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.221570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.222724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.391509 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1a2c093-dc27-4f01-abb3-b20f6806a6e2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.570424 Oct 04 21:22:00.392168 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2723/5347] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:21:59 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-interface => generated 284 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:22:00.658169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.689374 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5848157-cb34-461e-b98a-358e9909f9c0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1667 microversion: 2.1 time: 0.500096 Oct 04 21:22:00.696283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2625/5348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:04.445933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:04.489931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.490144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.492701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.516968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:04.520851 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] Creating event network-changed:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h2-851029-13 Oct 04 21:22:04.531727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-75aaed1e-a624-44c8-a438-6a5be41db909 req-89bc5556-fff6-480c-ad1e-0caeba797114 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096404 Oct 04 21:22:04.534213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2724/5349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:30.161029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:30.163880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=86 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:30.180841 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:22:30.183758 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/ips (ip 10.222.0.36) !!! Oct 04 21:22:30.199238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:30.200350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:30.213961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.214963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.216504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.218003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:30.218925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:30.219685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:30.287846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35d704dc-f2fb-461d-b63a-73fa3d04975d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/ips" status: 200 len: 151 microversion: 2.20 time: 0.126810 Oct 04 21:22:30.292672 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2626/5350] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Oct 4 21:22:30 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:22:36.067224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:36.077566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:36.079048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:36.093346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.094946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.094946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.096048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:36.096938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:36.097657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:36.155029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lazy-loading 'flavor' on Instance uuid d7d6809e-95b0-4b29-a0ed-14295d65ec2d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:37.184597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51db8caa-b4d7-4a5c-8cd3-ef728c09da8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/action" status: 202 len: 0 microversion: 2.20 time: 1.121711 Oct 04 21:22:37.196786 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2725/5351] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:22:36 2022] POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:22:37.240303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:37.240303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:37.278338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.283447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.284922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:37.286404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:37.287310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:37.295661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:37.711428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:37.735619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:37.740119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:37.743964 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d180b61f-0202-49e4-a85a-116dc896c5ff tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.541656 Oct 04 21:22:37.745866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2627/5352] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:37 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:38.804402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:38.804402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:38.826346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:38.827989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:38.828871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:38.830395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:38.833081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:38.833959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:39.195926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.212854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.216634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:39.219805 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10126c88-faf4-4a36-9264-44a83c2f1f03 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.437525 Oct 04 21:22:39.222545 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2726/5353] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:38 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:40.273411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:40.283855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:40.329900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:40.336876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:40.336876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:40.336876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:40.340451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:40.348176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:40.703303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:40.726912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:40.731165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:40.734420 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bc9429df-ed44-4c93-bc46-02650a9d65ac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.473640 Oct 04 21:22:40.756618 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2628/5354] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:40 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:41.778923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:41.780199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:41.806838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.816263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.821654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.825172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.826030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.826829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:42.213758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:42.232761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:42.245008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:42.247001 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aeace71d-fa03-4fc4-92a1-e86e323825af tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.473763 Oct 04 21:22:42.254191 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2727/5355] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:41 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:43.311389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:43.316418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:43.367332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.369533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.374907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.376409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.377464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.383662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.851446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:43.873250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:43.877564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:43.880317 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5138ba4a-62c9-466f-86b5-16effc65fbb0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.584714 Oct 04 21:22:43.882743 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2629/5356] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:43 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:44.926605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:44.931046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:44.975647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.976298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.980731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.981554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.982038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.982735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.439186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:45.477638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:45.481716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:45.494997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca8bbef7-828e-495f-832a-eeb5eb69bfac tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.578425 Oct 04 21:22:45.496380 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2728/5357] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:44 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:46.560277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.564007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:46.594777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.594938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.595748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.597176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.603392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.605277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.019911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:47.059014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:47.071358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:47.077337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c9ea6c4-a7fb-44e4-8d52-7e8b6f2bbf2b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.521080 Oct 04 21:22:47.079512 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2630/5358] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:48.129461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1484463264", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:48.137829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:48.141897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:48.173753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.176247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.180791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.183392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.186886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.188309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.333166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:49.555606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:49.582456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:49.585831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:49.588275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2dd7fb4-41f4-4075-9f6f-7a7ba7eab413 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 1.462531 Oct 04 21:22:49.589805 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2631/5359] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:48 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:50.046966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:50.052159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:50.052159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:50.052159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:50.052159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:50.074822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.086625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.086625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.086625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.086625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.086625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.127949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.134292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.145676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.149520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.150909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.152134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.155260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.156133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.161264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Getting quotas for project 0477eb2ad6154ec7b1e74cf35a85c31f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:50.191642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Getting quotas for user 151800376dd64e74b43f131a56e05825 and project 0477eb2ad6154ec7b1e74cf35a85c31f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:50.245472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:50.248305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:50.263591 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cbaa6794-7c24-48e6-b0a6-9f55bbda5e40 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143166 Oct 04 21:22:50.264854 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2632/5360] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:22:50.400907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.401847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.415762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.416755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.418288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.420548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.425607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.426741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.536913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:22:50.547380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bccf4ac9-ceeb-4691-b671-c86090dc990b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.425679 Oct 04 21:22:50.558730 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2729/5361] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:50.573322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c53708c3-52b4-4069-a78f-0e49943c426c tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.582011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c53708c3-52b4-4069-a78f-0e49943c426c tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.840690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c53708c3-52b4-4069-a78f-0e49943c426c tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:50.848143 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c53708c3-52b4-4069-a78f-0e49943c426c tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1214 microversion: 2.1 time: 0.281452 Oct 04 21:22:50.865513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2730/5362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:50.886097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.887956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.903670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.903670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.903670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.904618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.905514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.906370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.290599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.323031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.331888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.340748 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e0a2fca-3835-4322-905b-2c3f1abecd7f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.472348 Oct 04 21:22:51.351025 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2731/5363] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:51.410592 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bfe24e9-69fe-4e9f-8fe3-288d3e399319 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 204 len: 0 microversion: 2.1 time: 1.011873 Oct 04 21:22:51.410592 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2633/5364] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:50 2022] DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:22:51.422552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.425133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:51.441936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.442862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.447179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.447179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.451218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.452296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.790881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.797904 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18345f94-d3a6-4ee8-8a1f-685b1c4c39a8 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1673 microversion: 2.1 time: 0.385057 Oct 04 21:22:51.812379 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2732/5365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1673 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:51.908263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dce31e35-c707-49bb-b038-9347145f0481 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.908263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dce31e35-c707-49bb-b038-9347145f0481 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.103363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dce31e35-c707-49bb-b038-9347145f0481 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.118548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dce31e35-c707-49bb-b038-9347145f0481 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1214 microversion: 2.1 time: 0.225482 Oct 04 21:22:52.131524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2634/5366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:52.378762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.379911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.389454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.390218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.390801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.391775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.392430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.393112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.642928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.683907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.697269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.705049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf6e1c85-f903-4ec2-8a3c-5e45f433177a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.331509 Oct 04 21:22:52.716581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2733/5367] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:52.829945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.831591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.847195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.847720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.848728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.849733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.852943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.853429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:53.184075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a1c6e37-be7f-4695-9752-8fbbc05b05ff tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.184075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a1c6e37-be7f-4695-9752-8fbbc05b05ff tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:53.527030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a1c6e37-be7f-4695-9752-8fbbc05b05ff tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:53.554752 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a1c6e37-be7f-4695-9752-8fbbc05b05ff tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1214 microversion: 2.1 time: 0.400879 Oct 04 21:22:53.555962 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2734/5368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:53 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:53.605857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:53.633755 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1128991f-b33c-4ecc-9707-9e4a2e1faab6 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1673 microversion: 2.1 time: 0.805378 Oct 04 21:22:53.647024 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2635/5369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1673 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:53.737553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:53.737852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:53.756116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:53.756508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:53.756965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:53.757705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:53.758169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:53.758611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.548696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:54.589935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:54.591296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:54.607981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:54.610731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:54.620870 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a06d51c-a7c7-4d29-8179-9cbc5e32756a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1744 microversion: 2.20 time: 0.888395 Oct 04 21:22:54.626056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.626948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.627862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.643511 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2735/5370] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:53 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1744 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:54.644523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.654747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.666153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.683819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:54.684592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:54.719163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.719946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.721611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.728685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.728685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.729388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.088237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:55.104159 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e52136b9-1cb0-4d9b-9c8e-3c9758188d97 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1210 microversion: 2.1 time: 0.520397 Oct 04 21:22:55.127652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2636/5371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:54 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1210 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:55.395831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:55.484628 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ab7fd5a-c7c0-4f8b-9a04-de2e56b8b53c tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1673 microversion: 2.1 time: 0.805690 Oct 04 21:22:55.494253 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2736/5372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:54 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1673 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:55.677774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.680439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:55.715917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.717168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.718342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.720941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.730809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.732183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.148035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.149878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:56.170597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.174913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.184385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.185653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.186364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.187427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.667822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.704131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.705682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.706412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.720157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-806e92c5-d1a8-4ce7-9ae1-ada09627ec13 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.050786 Oct 04 21:22:56.735873 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2637/5373] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:22:56.772886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.772886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:56.780998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.781910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.782888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.784869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.785621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.786252 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-980edb12-804d-40ac-9351-fa80a8897f79 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1266 microversion: 2.1 time: 0.637293 Oct 04 21:22:56.786698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.790022 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2737/5374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1266 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:56.966035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.994760 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6aa6706d-2fac-44d2-bb81-cb3c80aab36f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1605 microversion: 2.1 time: 0.239099 Oct 04 21:22:56.995911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2638/5375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:57.795778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.798927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:57.829295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.842363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:57.847355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.847355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.854402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.863635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.867003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.870081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.874445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.900307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.905351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.907037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.908073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.909017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.212119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.267343 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b9170d0-b8af-43dd-9f7e-52d2c03ad8e6 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1272 microversion: 2.1 time: 0.447139 Oct 04 21:22:58.277866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2639/5376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1272 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:58.298975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ad0f0-f9b9-4a07-876f-1e2db9a4f26a", "name": "network-vif-deleted", "tag": "d055c4f3-01c1-4f27-8dad-86ffbbbe8b24"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:58.335544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.336790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.337942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.373790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] Creating event network-vif-deleted:d055c4f3-01c1-4f27-8dad-86ffbbbe8b24 for instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a on n-h1-851029-13 Oct 04 21:22:58.391903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ee66c5d7-ec1b-46b7-933b-bb67564dfa2f req-c8116737-0940-41e8-99eb-d693252658a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107200 Oct 04 21:22:58.397324 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2640/5377] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:58.413362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:58.416218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:58.429925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.431126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.437168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.437168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.437168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.437168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.642365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.702364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.711784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.714249 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cea23aa5-b361-43ca-8cfd-673e7397855b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.935751 Oct 04 21:22:58.714952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2738/5378] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:22:58.815086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.849724 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d593bddb-39fa-4f03-8d75-19adf051cad5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1321 microversion: 2.1 time: 0.436505 Oct 04 21:22:58.849724 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2641/5379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:58 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:59.328816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.330180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.390543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.398499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.402031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.404355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.406454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.414350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.774199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.779425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.837738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.838267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.843925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.848846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.849356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.858195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.901518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:59.937792 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f488bf91-6709-4ba0-9570-ffdf723d0689 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1272 microversion: 2.1 time: 0.618775 Oct 04 21:22:59.938546 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2739/5380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1272 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:59.982434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.982434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.991500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.993531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.994749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.002064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.003568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.005286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.129290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:00.139860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:00.140803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:00.141677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.143450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lazy-loading 'fault' on Instance uuid 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:23:00.520180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.577831 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c818ba4-f3ed-461c-81aa-269e64bafc7a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 200 len: 1326 microversion: 2.1 time: 0.637611 Oct 04 21:23:00.601960 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2740/5381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 1326 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:00.684547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.701125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:00.727802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.747789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.750273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-446a2e6f-5495-4ef1-a0f1-b0e0fd4602f1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.985006 Oct 04 21:23:00.753354 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2642/5382] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:00.988014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:00.988736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.002940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.005131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.006572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.008369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.009345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.010295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.139860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.145889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:01.161187 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b70719e4-ba38-4c53-bbd4-4f22edd0fc35 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1272 microversion: 2.1 time: 0.178777 Oct 04 21:23:01.185535 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2741/5383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:00 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.662798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.665788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.668649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "name": "network-vif-plugged", "status": "completed", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:01.714538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.716097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.720626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.731409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.732725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.734034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.738642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.739574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.740356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.795622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] Creating event network-vif-plugged:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h2-851029-13 Oct 04 21:23:01.818530 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a HTTP/1.1 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '245ad0f0-f9b9-4a07-876f-1e2db9a4f26a'} Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:01.823413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:23:01.833790 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:23:01.834806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c7371586-6553-4cdd-84c6-d682d8255414 req-6c5034ca-d6c1-4fcb-9bb1-6d7a1431d580 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177830 Oct 04 21:23:01.838972 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2643/5384] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:01.848208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:01.850431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ecf4404e-8605-4eba-8096-356eed1bb771 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 404 len: 111 microversion: 2.1 time: 0.195468 Oct 04 21:23:01.852769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2742/5385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:23:01.856926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.863990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.870989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a5c81ff-8d5c-4aaf-b240-659c7203d9b5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '.version_select at 0x7f54fa6a0550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.892988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.893774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.894594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.896008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.896907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.897689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.111644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:02.234361 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a5c81ff-8d5c-4aaf-b240-659c7203d9b5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664901809" status: 202 len: 0 microversion: 2.1 time: 0.374439 Oct 04 21:23:02.243641 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2743/5386] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 21:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664901809 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:23:02.266208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:02.268573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:02.301700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.319792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.320799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.321815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.322628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.323418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.547777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.588145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.607659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.620326 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08dfd398-ec9e-4da7-bf6d-cf12a1884895 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.780243 Oct 04 21:23:02.621475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2644/5387] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:03.053388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:03.080819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2c5994a-4b09-4ba2-ac41-b5289fe98ef0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1272 microversion: 2.1 time: 0.833281 Oct 04 21:23:03.086620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2744/5388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:02 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1272 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:03.690394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.697042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.742403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.743283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.744249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.745811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.746909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.747958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.135540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:04.143720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:04.149676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:04.153233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.153734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.175136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.181002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:04.181778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:04.182450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.811985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.885749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.890707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.897545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-770ff174-04e0-4293-bdee-2d7f27c92cdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.236552 Oct 04 21:23:04.898716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2645/5389] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:03 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:05.081470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:05.122609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8db53af8-6318-4065-97f4-fe8e1540ecd0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 0.985178 Oct 04 21:23:05.126216 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2745/5390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:04 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:05.981629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.986907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:06.015909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.019817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.022101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.029227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.031099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.032321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.189139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:06.191467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:06.311013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.316380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.317334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.318687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.331646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.332568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.220847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.269604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.274043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.285381 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-577e9f2b-0105-49eb-a303-065a27524046 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 2.312078 Oct 04 21:23:08.288116 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2646/5391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:23:08.706907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.751796 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-561ed4f8-561d-4f24-bb7e-72e097238eb1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 2.564885 Oct 04 21:23:08.795941 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2746/5392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:06 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:09.256730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f179ded4-7db5-41f6-a2ca-83ae7ac0ab04 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: .version_select at 0x7f54f6001940>, body: {"keypair": {"name": "tempest-keypair-327434807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaApMlOJ103Qv1/wrfesCU48NidD+zAEA/gTE6pJpk22c4kK9tsnQYPprNGOu4te5JGTdFUhOTBMzdTAMbCbDoilssq0YJ28K2UZ2tedUY+7x0fLDheCER6pSBaq88elQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:09.306438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:09.339714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.340837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.369466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:09.404632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f179ded4-7db5-41f6-a2ca-83ae7ac0ab04 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for project 7cc41a7a78a1428eaef197899143a842. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:23:09.432694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f179ded4-7db5-41f6-a2ca-83ae7ac0ab04 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for user 8faa07a8f88c460fb7972ac174f087e0 and project 7cc41a7a78a1428eaef197899143a842. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:23:09.436731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.442454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.447225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.448298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.452432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.457684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.646890 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f179ded4-7db5-41f6-a2ca-83ae7ac0ab04 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.394745 Oct 04 21:23:09.648577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2647/5393] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:23:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:09.669738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f46080-3c9d-4d17-8907-fe2e80243d8f", "tag": "26f77c76-24ce-4b0f-8498-725e44ea3120"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:09.698904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.698904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.700290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.750145 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] Creating event network-changed:26f77c76-24ce-4b0f-8498-725e44ea3120 for instance 29f46080-3c9d-4d17-8907-fe2e80243d8f on n-h1-851029-13 Oct 04 21:23:09.765508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a7b8e1d4-9b7f-4cd7-a81a-3f5b32c7fd87 req-31760433-e085-4072-a773-89fccdeeb7f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114177 Oct 04 21:23:09.768935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2648/5394] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:09.824846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.847373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.885502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.886546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.893074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.903683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.913916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.915559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:10.815615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.875352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.884498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:10.893602 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f20e6fd4-be5c-45a3-909a-ea66d3f316ae tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.562062 Oct 04 21:23:10.901270 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2747/5395] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:23:10.975005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:11.026181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb8374e6-e5ca-439a-ab7f-ce965a5513de tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 1.210126 Oct 04 21:23:11.046248 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2649/5396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:11.950298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:11.953828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:11.970609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.973051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.976175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:11.978253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:11.979486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:11.981448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.079854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:12.082864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:12.118464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.125468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.128133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:12.131107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:12.133312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:12.138221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:13.886603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:13.901088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c7b85fd-e8c7-4893-807b-aec61486642b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 1.832393 Oct 04 21:23:13.928328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2650/5397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:12 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:13.965056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.009815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.018642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:14.025258 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f094d264-7975-4f93-a096-a3e1560f45e0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 2.090400 Oct 04 21:23:14.035751 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2748/5398] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:11 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:14.944591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:14.956208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:14.979722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.981116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.983307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:14.985663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:14.990758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:14.996347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.107462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:15.108969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:15.123696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.124522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.125809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:15.128053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:15.128825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:15.129617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:16.069095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.097635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.109345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.110751 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-382a0c4a-db77-490f-a6d6-e8620a90920d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.007727 Oct 04 21:23:16.113050 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2749/5399] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:15 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:16.196734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:16.226108 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b428ba8-044e-4d0c-84b4-3fc42472c81b tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 1.289218 Oct 04 21:23:16.242906 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2651/5400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:14 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:17.177668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:17.182791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:17.244066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.246791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.252540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.262743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.263839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.267425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.270182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:17.271894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:17.288906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.290245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.292003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:17.294095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:17.295622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:17.329030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:18.229584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.243972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.247912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.250928 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f00cb57-b216-4314-a36d-6dec94e04779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.096265 Oct 04 21:23:18.252656 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2750/5401] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:17 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:18.441728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:18.554735 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05ec67f0-0af4-4f7d-8e20-4403712e40ad tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 1.290395 Oct 04 21:23:18.564269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2652/5402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:17 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:19.178894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f46080-3c9d-4d17-8907-fe2e80243d8f", "name": "network-vif-plugged", "status": "completed", "tag": "26f77c76-24ce-4b0f-8498-725e44ea3120"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:19.201772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.203010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.204315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.257766 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] Creating event network-vif-plugged:26f77c76-24ce-4b0f-8498-725e44ea3120 for instance 29f46080-3c9d-4d17-8907-fe2e80243d8f on n-h1-851029-13 Oct 04 21:23:19.288964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-157bd29b-38f1-4a06-b473-a56d428d3b06 req-98e80dbc-4543-4eee-a999-3cf99f7b07aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119484 Oct 04 21:23:19.293703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2751/5403] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:19.311391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:19.315311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:19.369788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.371178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.373267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.375120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.376354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.377352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.500233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:19.651232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:19.671881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:19.729154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.731352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.737609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:19.739745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:19.742361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:19.744024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:20.399146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.497206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.511077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.549523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4aabb7b9-736e-473a-ae18-2f5778161a0f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.264444 Oct 04 21:23:20.551353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2653/5404] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:20.785151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:20.821400 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72e35279-e87f-4d75-a68e-546b10a64288 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1314 microversion: 2.1 time: 1.180098 Oct 04 21:23:20.826254 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2752/5405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:19 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:21.610558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:21.611877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:21.663771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.665096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.666272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.667814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.668993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.670395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.880454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:21.886027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:21.930863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.946142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.950374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:21.958466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:21.979835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:21.981040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.487021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.518567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.565366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.600041 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7d7c31c-a2b8-409d-b328-a865efd5fd81 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.000483 Oct 04 21:23:22.601604 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2654/5406] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:21 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:22.612467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-414946665", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d92991c-1b63-4645-9069-bd87a8eb54d3"}], "security_groups": [{"name": "tempest-securitygroup--1029966461"}], "key_name": "tempest-keypair-327434807", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:22.628935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:22.652538 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b78072c-a30d-4eb9-840e-5fc4cc032ec0 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1462 microversion: 2.1 time: 0.782251 Oct 04 21:23:22.659125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2753/5407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:21 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1462 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:22.717537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a295f04d-b903-4317-9c5f-16e18875161f", "device": "/dev/sdb"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:22.753876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:22.799945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.803294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.804023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:22.808329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:22.811896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:22.838703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:23.741993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] validate_networks() for [('2d92991c-1b63-4645-9069-bd87a8eb54d3', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:23:25.008126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17666ecf-f9c3-48e7-aab7-09e9f3243ce4 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "POST /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.297527 Oct 04 21:23:25.016960 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2754/5408] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:23:22 2022] POST /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f/os-volume_attachments => generated 194 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:25.040911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:25.042353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:25.158409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.163306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.164939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.173281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.174596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.180363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.346572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:23:25.349418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:23:25.349418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:23:25.349974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:23:25.350723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:23:25.457620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.458704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.459515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.462468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:25.465833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:25.465833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:25.631769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for project 7cc41a7a78a1428eaef197899143a842. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:23:25.676472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Getting quotas for user 8faa07a8f88c460fb7972ac174f087e0 and project 7cc41a7a78a1428eaef197899143a842. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:23:25.758979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:23:25.768288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:23:26.001032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:26.001032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:26.001032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:26.014367 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd7534a4-40c0-4ec5-ac97-29edf0a09331 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.996201 Oct 04 21:23:26.032798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2755/5409] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:25 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:26.468310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cde1fd4-6cbd-4fa9-abf2-50c38c7f19c3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.864653 Oct 04 21:23:26.475746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2655/5410] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:23:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 3873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:23:26.504971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b87791e1-12fc-48e7-8296-0ade79368e1b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:26.511152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b87791e1-12fc-48e7-8296-0ade79368e1b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:26.971855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b87791e1-12fc-48e7-8296-0ade79368e1b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.018442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b87791e1-12fc-48e7-8296-0ade79368e1b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1236 microversion: 2.1 time: 0.521727 Oct 04 21:23:27.043035 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2756/5411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:26 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1236 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:27.069486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:27.074976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:27.112794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.119546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.120363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.121576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:27.128870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:27.129599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:27.929749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.970685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.995203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:27.999513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ed9e83d-2935-41a3-a0a7-27c8555db92a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.940070 Oct 04 21:23:28.010758 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2656/5412] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:27 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:28.105465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccf2e7e8-2319-44c4-969a-b0a8f6e39fad tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:28.106487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ccf2e7e8-2319-44c4-969a-b0a8f6e39fad tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:28.312507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ccf2e7e8-2319-44c4-969a-b0a8f6e39fad tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:28.341412 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ccf2e7e8-2319-44c4-969a-b0a8f6e39fad tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1236 microversion: 2.1 time: 0.242613 Oct 04 21:23:28.358833 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2757/5413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:28 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1236 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:29.053286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.055670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.136466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.137239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.138001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.144633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.145290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.149301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.400183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:29.400930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:29.423983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.424579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.425035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.425781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:29.437344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:29.438463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:29.758491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:29.841866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc5312e9-3062-4cc4-b02e-caf61194409e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1240 microversion: 2.1 time: 0.445531 Oct 04 21:23:29.855078 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2758/5414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1240 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:30.237944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:30.310090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:30.315999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:30.319380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eae14096-84e2-46dd-827a-1452fc2bd4c1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.273206 Oct 04 21:23:30.321459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2657/5415] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:29 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:30.914418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:30.934387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:30.963450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:30.968688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:30.968688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:30.968688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:30.972142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:30.973376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:31.318912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:31.338180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b9c0ed9-0127-46d6-97a3-0c525db2bd5d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1288 microversion: 2.1 time: 0.447187 Oct 04 21:23:31.351257 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2759/5416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:30 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1288 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:31.379886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:31.383700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:31.427512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:31.427993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:31.429373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:31.430972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:31.433100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:31.434190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.103178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:32.131056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:32.136957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:32.140714 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4c361ed-c34d-4dfa-8c85-b460e9083f47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 0.768276 Oct 04 21:23:32.143136 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2658/5417] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:31 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:32.372130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:32.376258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:32.408306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.412689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.412689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.418585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:32.419569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:32.420668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:32.801119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:32.826119 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a3e636d-0011-455b-a668-3d13404c4784 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1288 microversion: 2.1 time: 0.462441 Oct 04 21:23:32.828660 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2760/5418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:32 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1288 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:33.219735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:33.224557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:33.257917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.258885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.259616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:33.261097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.265093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.266002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:33.876793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:33.899479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:33.956478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.962402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.983503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:33.986311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:33.987935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:33.995191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:34.123426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:34.894852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:34.924476 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc157316-6ef9-4ec8-965e-44cd229fac1a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1306 microversion: 2.1 time: 1.064879 Oct 04 21:23:34.929024 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2761/5419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:33 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1306 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:35.224060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:35.226859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=83 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:35.242105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:35.244468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:35.246626 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3d6ebdf-64d7-4f17-8068-de4345544173 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 2.041119 Oct 04 21:23:35.263776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2659/5420] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:33 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:35.985473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:35.993766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:36.025374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.025374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.028225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:36.029715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.040869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.040869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:36.304416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:36.307935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:36.324003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:36.326126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:36.330107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.331565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.333099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:36.335056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:36.336095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:36.337133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:37.695845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:37.752563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d3d875bc-acb2-4076-bcc0-f8ad4f64eed0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 1.774117 Oct 04 21:23:37.757070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2762/5421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:35 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:37.783972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:37.871062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:37.902395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:37.905092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65a41412-5754-408b-85d3-5c0ae6244a29 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1739 microversion: 2.20 time: 1.610714 Oct 04 21:23:37.908472 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2660/5422] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:36 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1739 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:38.814962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:38.816521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:38.832492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:38.854744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:38.860765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:38.864254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:38.871275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:38.873128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:38.875259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:38.973499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:38.983157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:39.007859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:39.012501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:39.014912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:39.023201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:39.025620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:39.026970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:39.720756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:39.753956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:39.757436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:39.759932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2976e673-a3d7-4e4d-9381-8f9f6e30a5be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1721 microversion: 2.20 time: 0.793931 Oct 04 21:23:39.775214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2661/5423] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:38 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1721 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:23:39.988301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:40.009563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-faee3421-f3da-4e90-8895-c637a1d21af3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 1.215016 Oct 04 21:23:40.011667 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2763/5424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:38 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:40.212318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "name": "network-vif-unplugged", "status": "completed", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:40.234259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.235191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.236441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:40.268979 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] Creating event network-vif-unplugged:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h2-851029-13 Oct 04 21:23:40.283644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7e76da91-6438-4a07-9275-97738cff5a66 req-573554be-742c-4aac-a777-b7b51118fd95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077679 Oct 04 21:23:40.285413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2662/5425] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:23:40.761875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d127956-d09e-4229-9e39-6b283198367f", "tag": "dd227a11-541d-40c4-bee0-2bed04107454"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:40.781223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.782138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.783007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:40.805858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] Creating event network-changed:dd227a11-541d-40c4-bee0-2bed04107454 for instance 6d127956-d09e-4229-9e39-6b283198367f on n-h2-851029-13 Oct 04 21:23:40.816366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:40.816366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:40.817948 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7ae0d6de-4897-439a-81e6-3db08600da63 req-8285d647-a398-487f-899f-19e1d40d7c55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064886 Oct 04 21:23:40.824755 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2764/5426] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:40.849036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.849956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.855366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:40.856944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:40.857817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:40.858785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:41.066731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:41.068782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:41.098634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:41.101462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:41.103484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:41.118117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:41.118117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:41.118117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:41.765607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:41.775916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18d69c1f-6ae8-4ffc-bcc7-0ff42f48da58 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 0.722108 Oct 04 21:23:41.777475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2765/5427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:41 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:41.817268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:41.835784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:41.842052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:41.842052 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59de963e-2989-4ca3-8796-39a302ccfdc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1721 microversion: 2.20 time: 1.037034 Oct 04 21:23:41.842052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2663/5428] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:40 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1721 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:23:42.848383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:42.862759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:42.880559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:42.885945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:42.888163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:42.889841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:42.894547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:42.895704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:42.898012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:42.899557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:42.900700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:42.955271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:23:42.964766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:42.975396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:42.980095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:42.992437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:42.996273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:43.000737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:43.407540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:43.458414 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9d33458-50f8-4b0f-8208-824aae551a09 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 0.631375 Oct 04 21:23:43.485225 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2766/5429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:42 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:43.511563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:43.521600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:43.523187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:43.524671 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-394a7004-abf3-48ff-ab18-f7a5b23bed6d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1724 microversion: 2.20 time: 0.639770 Oct 04 21:23:43.542400 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2664/5430] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:42 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1724 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:43.595956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f05640-328a-425b-8bf9-bdc3bc696726"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:43.601620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:43.616509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:43.632155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:43.639022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:43.644312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:43.650287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:43.655023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.526456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:44.527618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:44.548711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.549606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.550895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.553274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:44.554179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:44.555339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:44.964433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:45.011234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ed61a56-e0ff-4346-b4c3-49321bf6b689 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 0.500811 Oct 04 21:23:45.016157 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2665/5431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:44 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:46.077649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:46.081712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:46.143529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:46.147526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:46.149482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:46.158578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:46.159664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:46.166245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:46.690573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:46.733997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a518416-cef5-4336-a56f-22d322e39f90 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 0.674365 Oct 04 21:23:46.745704 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2666/5432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:46 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:46.761785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83956e00-9b60-4acc-9ed8-bec5cca032e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 3.181254 Oct 04 21:23:46.763393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2767/5433] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 4 21:23:43 2022] POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 188 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:23:47.211558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:47.215459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:47.235655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.236525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.238432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.238432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.272730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.273574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.411093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123542) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:23:47.826204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:47.835399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:47.895778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.896765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.897464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:47.898744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:47.920287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:47.926300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:48.118871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5370a0fc-20fa-464f-ad70-3b621e70d7f3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/action" status: 202 len: 0 microversion: 2.20 time: 0.909924 Oct 04 21:23:48.122633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2667/5434] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:23:47 2022] POST /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/action => generated 0 bytes in 923 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:23:48.176196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:48.188520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:48.209979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:48.216353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:48.225625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:48.229204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:48.230537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:48.241034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:48.914954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:48.916606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:48.949457 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04cfac38-4756-4267-8c12-d21a4ecba275 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 1.151762 Oct 04 21:23:48.964569 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2768/5435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:47 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:48.965093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:48.965093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:48.965093 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-785a2f57-995f-4a8a-9b33-58d9b16e2642 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1750 microversion: 2.20 time: 0.832836 Oct 04 21:23:48.965579 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2668/5436] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:48 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1750 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:50.056048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:50.064289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:50.065890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:50.069089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:50.133058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.135219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.136460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.138282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.141669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.142740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.144577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.146116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.150120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:50.151099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.153729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:50.157174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:50.953767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:50.987037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:50.992309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:50.996363 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aadd1c5d-95d8-428e-9090-13cbfcf16f1d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1750 microversion: 2.20 time: 0.954351 Oct 04 21:23:50.998514 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2669/5437] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:50 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1750 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:51.022510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127956-d09e-4229-9e39-6b283198367f", "name": "network-vif-plugged", "status": "completed", "tag": "dd227a11-541d-40c4-bee0-2bed04107454"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:51.033303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:51.064672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:51.067084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:51.068623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:51.087231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fda8e1f2-eb76-4735-9478-329ea4fd09e3 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 1.058123 Oct 04 21:23:51.091065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2769/5438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:50 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:51.110880 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] Creating event network-vif-plugged:dd227a11-541d-40c4-bee0-2bed04107454 for instance 6d127956-d09e-4229-9e39-6b283198367f on n-h2-851029-13 Oct 04 21:23:51.120684 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-99f07f7b-0708-40f6-9163-11f85643bc7e req-a68c220c-3d25-4408-958f-58a374f15f52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119266 Oct 04 21:23:51.122185 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2670/5439] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:52.053715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:52.054881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:52.064649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:52.065388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:52.066536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:52.067357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:52.068068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:52.068580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:52.125908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:52.127074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:52.157476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:52.160702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:52.160702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:52.160702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:52.161123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:52.161875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:52.705736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:52.792890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:52.797197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:52.805696 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a619e82e-5a2e-4cab-8c38-070379b0dfe5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1750 microversion: 2.20 time: 0.759316 Oct 04 21:23:52.822304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2770/5440] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:52 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1750 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:52.950242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:52.966162 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae816440-8bed-448d-a93c-21943a9abf74 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1362 microversion: 2.1 time: 0.845781 Oct 04 21:23:52.967028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2671/5441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:52 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1362 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:53.889611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:53.892731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:53.973900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:53.986278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:53.989285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.010585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:54.013108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:54.019183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.023199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.030390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.066793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.068206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.070245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.071756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:54.078702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:54.084493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:54.812702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:54.851696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:54.864603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:54.869842 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b788d8b-5d82-4784-bb8e-a8a1f9e49184 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.993769 Oct 04 21:23:54.878458 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2771/5442] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:53 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:54.991711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:55.049406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38feec0c-665c-400f-a737-63bda847184d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1547 microversion: 2.1 time: 1.045949 Oct 04 21:23:55.050699 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2672/5443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:54 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1547 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:23:55.098371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:55.099469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:55.174391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.178911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.181595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:55.195292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.200950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.201943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:55.465188 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16ab1458-84de-4ec0-b644-6f6158c73b5f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.376258 Oct 04 21:23:55.466826 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2772/5444] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:23:55 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:55.929882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:55.930931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:55.974566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.975458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.976176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:55.977873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:55.978653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:55.981603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:56.633453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:56.675357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:56.679220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:56.687462 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3737517b-14b5-4472-8c62-ca7aa086a56b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.763285 Oct 04 21:23:56.703351 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2673/5445] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:55 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:23:57.763637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:57.765208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:57.784254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:57.785256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:57.786134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:57.796577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:57.796577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:57.796577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:58.303620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:58.327778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:58.332129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:58.334924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a60d9e8-ee3c-46cb-ae17-1964bb70aa3e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.590527 Oct 04 21:23:58.342974 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2773/5446] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:57 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:23:59.395054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:59.396437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:59.429527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.431011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.432160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.436761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.438246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.443899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.727146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d127956-d09e-4229-9e39-6b283198367f", "tag": "dd227a11-541d-40c4-bee0-2bed04107454"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:59.832492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:59.833096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:59.834470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:59.922991 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] Creating event network-changed:dd227a11-541d-40c4-bee0-2bed04107454 for instance 6d127956-d09e-4229-9e39-6b283198367f on n-h2-851029-13 Oct 04 21:23:59.968209 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c6bd2d42-6ec9-4ae1-8eca-3e93c1ca343c req-fbc76a1a-d5f1-4bea-9ad5-61d43448ee1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250424 Oct 04 21:23:59.997797 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2774/5447] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:00.199305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:00.255619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:00.260026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:00.265206 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58434041-73af-43d8-9a67-629113c90b75 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.881866 Oct 04 21:24:00.302789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2674/5448] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:23:59 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:01.334923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:01.336288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:01.394081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:01.397092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:01.403478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:01.409781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:01.410691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:01.411523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:02.135100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:02.155987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:02.171935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:02.174792 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21a28227-bee5-4e5b-9ec2-e88b428a697b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.849230 Oct 04 21:24:02.190122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2775/5449] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:01 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:03.241665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:03.246731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:03.302135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.305201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.316174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:03.317824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:03.318781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:03.319851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:04.152368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:04.183191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:04.190989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:04.190989 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8adce6de-eb95-4ccc-8d9b-a5b311f92750 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.962444 Oct 04 21:24:04.235342 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2675/5450] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:03 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:05.253106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:05.278170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:05.317186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.320437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.324035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.327824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:05.330173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:05.333189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:05.492641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:06.173624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:06.191282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:06.194293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:06.195929 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61c639c5-9442-4447-8bda-1d269cf62bdc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.954522 Oct 04 21:24:06.197384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2776/5451] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:05 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:07.260318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:07.268205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:07.322597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:07.338049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:07.339749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:07.342256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:07.344542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:07.345639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:07.411858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:08.786578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:08.823205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:08.824964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:08.826397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66cca9da-4529-4876-a9bd-2ca4ffa9dfc7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 1.588960 Oct 04 21:24:08.848577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2676/5452] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:07 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:09.866638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:09.874507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:09.891575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.892455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.893384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:09.894406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:09.895340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:09.898195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:10.646641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:10.688090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:10.708829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:10.710983 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65820fac-6d14-4803-b8dc-424e197f0ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.850953 Oct 04 21:24:10.713179 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2777/5453] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:09 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:11.751475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:11.752792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:11.791371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:12.341519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:12.361105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:12.380647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:12.384018 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c51897d-dd2d-423a-aae2-f803f41a2a56 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1752 microversion: 2.20 time: 0.637480 Oct 04 21:24:12.385142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2677/5454] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:11 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1752 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:13.438286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:13.440320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:13.444050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=24 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:13.457877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:13.459030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:13.459884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:13.461185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:13.462708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:13.470481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:14.290955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:14.324101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:14.338299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:14.341827 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a4a7eab7-4135-48bf-a6a5-a76211cd77c0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.919560 Oct 04 21:24:14.357027 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2778/5455] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:13 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:15.401264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:15.402362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:15.416505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:15.417387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:15.418209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:15.419892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:15.420794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:15.421522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:16.257060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:16.276387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:16.280367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:16.283049 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78183df8-930d-48b2-a1bc-2a6301302266 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.888317 Oct 04 21:24:16.284188 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2678/5456] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:15 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:17.089030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:17.129154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:17.129636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:17.130422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:17.155491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] Creating event network-changed:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h1-851029-13 Oct 04 21:24:17.205311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f21f9412-2927-4cde-9564-88363c60ba1e req-aedf0c62-94b6-4447-bf4f-2e36630afe41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135076 Oct 04 21:24:17.207447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2779/5457] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:17.340256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:17.340256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:17.342428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:17.351187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:17.360024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:17.360024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:17.360024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:17.360024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:17.360024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:17.949369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:17.982018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:17.986074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:17.993059 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cbc5423a-d5bf-4343-95ac-df7e226b4cbd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.664674 Oct 04 21:24:18.000793 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2679/5458] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:17 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:19.048204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:19.049615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:19.061285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:19.063175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:19.063175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:19.063175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:19.064032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:19.064180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:19.531560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:19.558890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:19.562435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:19.564967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57b0cc87-e019-4e72-8119-d7d62f545e42 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.522596 Oct 04 21:24:19.587852 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2780/5459] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:19 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:20.629237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:20.640468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:20.668807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:20.677532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:20.679032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:20.681347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:20.684678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:20.684678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:21.270449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:21.309838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:21.315446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:21.318840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d5eaccf2-bd89-4bc7-815f-7d57ee42661c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.700647 Oct 04 21:24:21.330822 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2680/5460] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:20 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:22.377317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:22.378552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:22.430287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:22.431641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:22.432868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:22.434598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:22.436312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:22.439473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:23.128731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:23.167967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:23.170601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:23.172101 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38bef012-41dd-439a-970e-83337a8908dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.805765 Oct 04 21:24:23.182249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2781/5461] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:22 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:24.219274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:24.227698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:24.274046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:24.285207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:24.286032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:24.289812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:24.299739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:24.300912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:24.833805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:24.863074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:24.879270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:24.892402 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34051b30-24f3-430e-a62b-5e95dc823e3c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.679512 Oct 04 21:24:24.896328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2681/5462] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:24 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:25.981066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:25.990708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:26.028977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:26.030102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:26.037279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:26.045695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:26.047659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:26.053470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:27.570104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:27.662328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:27.677631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:27.679972 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a66a305-ac22-4520-9299-96848f3659b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.732598 Oct 04 21:24:27.698030 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2782/5463] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:25 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:28.739873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:28.742733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:28.785398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:28.786372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:28.794194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:28.794194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:28.794194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:28.795364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:29.340370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:29.359973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:29.364135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:29.367324 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15454d48-29c0-4ac8-baae-47954f716c14 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.633041 Oct 04 21:24:29.392209 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2682/5464] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:28 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:30.416801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:30.420070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:30.430834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:30.432237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:30.433159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:30.434547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:30.435269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:30.435884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:31.021428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:31.023573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:31.088098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:31.099518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:31.099518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:31.099518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:31.099518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:31.099518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:31.244600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30c64c87-c468-4758-98bd-794d1e6b80c2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/ips" status: 200 len: 145 microversion: 2.1 time: 0.228087 Oct 04 21:24:31.266990 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2683/5465] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:24:31 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/ips => generated 145 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:31.284277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:31.305114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:31.310869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:31.316877 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e08aae27-0a9d-45e9-a5fa-b8ed0b3dfd10 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.904241 Oct 04 21:24:31.318545 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2783/5466] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:30 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:32.381036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:32.390235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:32.447877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.472727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.476309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:32.484518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:32.485427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:32.491865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:33.720437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:33.799457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:33.808425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:33.812919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-492da7f4-e9d7-48b7-9887-4b5fc1acfee8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.440196 Oct 04 21:24:33.825706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2684/5467] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:32 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:34.889618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:34.891854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:34.940926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:34.944549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:34.948982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:34.956554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:34.959478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:34.966510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:37.883132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:37.921160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=48 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:37.953844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:37.964435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:37.972807 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b8964a7-cde5-444f-9075-3608a82e3502 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 3.091734 Oct 04 21:24:37.979394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2784/5468] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:34 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 3101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:39.040855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:39.041977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:39.094108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.095452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.097976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.099333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.110494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.117320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.119389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=52 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:39.482150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:39.525583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:39.538400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:39.544161 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-000f346c-2da4-4b2e-94c0-d3a58d722cc4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.505965 Oct 04 21:24:39.546052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2685/5469] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:39 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:39.802011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b9be7d7-8f1f-49d5-b14d-b758acdafad6"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:39.811910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:39.829508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.831361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.832561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:39.835034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:39.836285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:39.841082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.612144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:40.627465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:40.676879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.684570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.684570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:40.684570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:40.684570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:40.684570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:41.447701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff01bde4-7d50-433a-9d72-46e52c5c4a49 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.667001 Oct 04 21:24:41.451677 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2785/5470] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:24:39 2022] POST /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 194 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:42.681412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:42.743334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:42.747596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:42.752993 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abee37e0-56a5-4126-8c1d-759e284cc7d2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 2.151447 Oct 04 21:24:42.819006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2686/5471] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:40 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:43.839173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:43.839173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:43.853794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:43.895936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:43.900079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:43.901209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:43.902854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:43.911106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:43.912126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:45.120545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:45.172188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:45.192599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:45.210457 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-272578ad-75a8-4181-831e-9b72de4ad7e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.398325 Oct 04 21:24:45.219919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2786/5472] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:43 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:46.279992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:46.281338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:46.343539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:46.352140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:46.355461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:46.362358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:46.365865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:46.367209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:47.255223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.281726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.288956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:47.293404 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c78b0db1-837e-428a-afa0-b7a693344427 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.032001 Oct 04 21:24:47.312883 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2687/5473] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:46 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:48.345643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:48.346725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:48.366418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.367011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.367497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.368282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:48.368787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:48.369288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:48.768962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.788107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.792245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:48.795583 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-854ef957-c313-4d86-994b-d6f51aecc75d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.453789 Oct 04 21:24:48.797209 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2787/5474] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:48 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:24:49.849222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:49.850043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:49.869265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.869831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.870274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:49.880304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:49.906011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:49.907534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:51.176185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:51.197830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:51.201877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:51.206896 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35a298a3-3fb2-43b7-8082-f27873ed72ce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.363388 Oct 04 21:24:51.208876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2688/5475] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:49 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:52.263781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:52.267959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:52.298578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:52.301250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:52.302688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:52.306452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:52.306452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:52.306452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:53.121723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.168483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.179035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:53.185338 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cb76a9b-fd34-4bd7-a4be-b2281ccc6dee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.929100 Oct 04 21:24:53.189259 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2788/5476] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:52 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:54.255710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:54.262099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:54.290568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:24:54.296709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.303601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.307838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:54.312939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:54.314229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:54.320740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:55.030295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:55.072694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:55.082215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:55.089245 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c3df3c01-9f60-4276-9d83-3fdae218b036 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.845233 Oct 04 21:24:55.097472 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2689/5477] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:54 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:56.155239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:56.155239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:56.170309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.179222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.180724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.189743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:56.191268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:56.192056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:56.569032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.593883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.597353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:56.599723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30cab8e8-a79f-4400-80e9-921c57597210 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.464397 Oct 04 21:24:56.601268 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2789/5478] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:56 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:57.647271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:57.654929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:57.676371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.677644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.678869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:57.684439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:57.686033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:57.687201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.063627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "name": "network-vif-plugged", "status": "completed", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:24:58.088968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:58.090709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:58.091831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:58.121233 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] Creating event network-vif-plugged:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h1-851029-13 Oct 04 21:24:58.137287 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7ced7c1d-5917-4a82-8e82-2d71bd9b695a req-7ba34ad2-8d40-4014-af13-ef9e9c990e3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.596699 Oct 04 21:24:58.140242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2690/5479] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:24:58.417981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.451823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.455055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:24:58.461218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0397b53-0f9a-4b5f-aecd-8d0d19586d72 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.821365 Oct 04 21:24:58.483217 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2790/5480] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:57 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:24:59.525307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:24:59.539115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:24:59.569292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:59.579703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:59.580586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:24:59.581928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:24:59.585915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:24:59.587177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:00.087431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:00.112083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:00.115189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:00.117474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5051016-aa7f-4c26-8069-b364a3bb9a32 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.601568 Oct 04 21:25:00.119004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2691/5481] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:24:59 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:25:01.182090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:01.236398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:01.270507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.274299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.281659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.283133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.284352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.285432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.844016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:01.893169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:01.899875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:01.902055 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87593545-5478-4759-94f8-36d69d385a6f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 0.754380 Oct 04 21:25:01.928872 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2791/5482] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:01 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:02.957306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:02.958186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:02.985627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.986560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.987407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.995958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.997363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.998533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.064961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.105554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.110386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.113956 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34ce6ac0-6bb1-4598-ac53-16a9369dd563 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1808 microversion: 2.20 time: 1.162805 Oct 04 21:25:04.131047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2692/5483] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:02 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1808 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:05.185290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:05.186573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:05.222458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.226392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.227235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.228597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:05.235321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:05.238011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:05.710941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.764989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.781196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:05.802968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2280328-f8da-4be9-9bd4-0e238c1d4042 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1795 microversion: 2.20 time: 0.609785 Oct 04 21:25:05.802968 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2792/5484] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:25:05 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1795 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:25:14.584696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.602974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.617303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:14.625823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=43 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:14.686292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.687599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.688841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.694741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.699123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.708622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.829518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6fc4813-03dd-45df-a642-6c45a93b468a tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.252231 Oct 04 21:25:14.845914 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2693/5485] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:14.905822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.906779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.968211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=14 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:14.984929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.986605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.987404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.988735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.989596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.990375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.009617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:15.219388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8bc5f21d-2db6-4cdc-8d3e-0b4c9d38794f tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6" status: 200 len: 194 microversion: 2.1 time: 0.358855 Oct 04 21:25:15.229753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2793/5486] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6 => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:20.787673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1894128-d912-43c0-b746-c46298788f18"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:20.799598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:20.823215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.824665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.825853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.827647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.828907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.830088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.623731 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d4b5890-584d-4959-8274-bd8c498e8c88 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "POST /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.841669 Oct 04 21:25:22.628936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2694/5487] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:25:20 2022] POST /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 194 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:45.107369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.117893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.154592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.157120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.158788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.165877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.165877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.165877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.326363 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08e27e7c-5964-4503-a59e-9bfd2efe3cc1 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.241276 Oct 04 21:25:45.343837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2794/5488] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:25:45 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:45.490414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:45.492270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:45.504141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.514374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.553699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.559530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.560892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.562453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.568634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.570312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.704686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-838f5a91-82f5-4fdb-95c8-565761ca8f4b tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6" status: 200 len: 194 microversion: 2.1 time: 0.218405 Oct 04 21:25:45.706474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2695/5489] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 4 21:25:45 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6 => generated 194 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:25:45.726545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:45.728484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:45.742317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.744248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.745551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:45.747466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:45.748593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:45.750780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:46.018440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lazy-loading 'services' on Instance uuid 6d127956-d09e-4229-9e39-6b283198367f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:25:46.486991 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0e06d9f5-f74c-4655-a485-1df74abb2c48 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6" status: 202 len: 0 microversion: 2.1 time: 0.768143 Oct 04 21:25:46.488110 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2795/5490] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:25:45 2022] DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/6b9be7d7-8f1f-49d5-b14d-b758acdafad6 => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:50.468186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Calling method '.version_select at 0x7f54f5e9f820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:50.488176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.491675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.491675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.556489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.557645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.559306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.615541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:50.618602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:50.620685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:50.640003 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f73638bc-904c-443c-98d9-4803d78402bd tempest-PortsAdminExtendedAttrsTestJSON-1154149417 tempest-PortsAdminExtendedAttrsTestJSON-1154149417-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.652129 Oct 04 21:25:50.641104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2696/5491] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 21:25:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:00.272101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:00.274435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:00.295284 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:26:00.300338 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 (ip 10.222.0.36) !!! Oct 04 21:26:00.302646 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:26:00.304060 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 (ip 10.222.0.36) !!! Oct 04 21:26:00.341707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:00.347217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:00.400193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.400802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.401633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.409424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.410789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.411983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.511360 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1c7f4bb-e24a-4ba2-8a8e-2879f12ad861 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18" status: 200 len: 194 microversion: 2.1 time: 0.249771 Oct 04 21:26:00.513636 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2796/5492] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 4 21:26:00 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:00.545606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:00.546721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:00.560994 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:26:00.561993 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 (ip 10.222.0.36) !!! Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 (ip 10.222.0.36) !!! Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:00.581712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:00.585694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:00.587598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.326565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:01.341486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:01.367251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.371846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.375809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.380351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.381378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.388835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.427661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lazy-loading 'services' on Instance uuid 6d127956-d09e-4229-9e39-6b283198367f {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:01.514503 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de6eb291-2bbd-4546-8ac1-3e6f684608bc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments/65f05640-328a-425b-8bf9-bdc3bc696726" status: 200 len: 194 microversion: 2.20 time: 0.196855 Oct 04 21:26:01.548524 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2797/5493] 10.222.0.36 () {60 vars in 1454 bytes} [Tue Oct 4 21:26:01 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments/65f05640-328a-425b-8bf9-bdc3bc696726 => generated 194 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:01.886750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:01.888035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:01.966405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.979735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.984038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:01.993824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:01.994051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2021d43-d214-4cfc-912f-ad2c360b4453 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18" status: 202 len: 0 microversion: 2.1 time: 1.462922 Oct 04 21:26:01.994051 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2697/5494] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:26:00 2022] DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments/b1894128-d912-43c0-b746-c46298788f18 => generated 0 bytes in 1466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:01.994996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:01.994996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:02.535493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lazy-loading 'services' on Instance uuid d7d6809e-95b0-4b29-a0ed-14295d65ec2d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:02.956539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77c01daf-56b6-4801-bba9-18415e25e70e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments/65f05640-328a-425b-8bf9-bdc3bc696726" status: 202 len: 0 microversion: 2.20 time: 1.077735 Oct 04 21:26:02.962194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2798/5495] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 4 21:26:01 2022] DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments/65f05640-328a-425b-8bf9-bdc3bc696726 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:26:02.983584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:02.988521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:03.013257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.017376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.018157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.019198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:03.020709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:03.021839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:03.115988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-159e3b87-271e-4c48-8142-8ea4e4549520 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149074 Oct 04 21:26:03.126025 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2698/5496] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:02 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:04.145768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:04.163401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:04.219758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.220510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.221318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.222571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:04.223470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:04.224243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:04.402701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8352240-0d34-4267-bec3-6f49935f6104 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.264181 Oct 04 21:26:04.428268 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2799/5497] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:04 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:05.427606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:05.435368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:05.484106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.486693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.488247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.489720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:05.490591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:05.495802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:05.660997 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0496390-eb79-4f7b-ae0a-84e39091d571 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.236753 Oct 04 21:26:05.665216 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2699/5498] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:05 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:06.684684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:06.695891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:06.743096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.743612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.744438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.752045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:06.753000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:06.753812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:06.853002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2111badc-daf7-4b86-9fd5-7157ee95cfbc tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172930 Oct 04 21:26:06.875035 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2800/5499] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:06 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:07.883721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:07.903220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:07.937794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.941117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.950819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:07.957450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:07.959618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:07.964780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:08.140960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b1125ab-0a91-4b81-acb3-41e5a4c4ccb1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.276350 Oct 04 21:26:08.145344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2700/5500] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:07 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:09.159054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:09.162641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:09.192813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.194118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.195036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.197647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:09.199111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:09.200335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:09.325262 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10c49896-1564-4402-8a61-db458e65f247 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.173598 Oct 04 21:26:09.354428 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2801/5501] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:09 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:10.372664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:10.376734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:10.420539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.421432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.432395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.434225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:10.444216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:10.445598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:10.531132 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ea2ab3e-dcce-42db-b5df-c12443fb2fce tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189223 Oct 04 21:26:10.533528 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2701/5502] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:10 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:11.553812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:11.561925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:11.639405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:11.645145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:11.649450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.653998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:11.666054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:11.674182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:11.787931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b8d16a15-00d2-49da-8f40-4b53f88854d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.240685 Oct 04 21:26:11.800354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2802/5503] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:11 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:12.820140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:12.827382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:12.846564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.860746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.863748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.870920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:12.879135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:12.880098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:12.952151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d99e92b-7403-47bd-b24d-f9aa13016973 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139253 Oct 04 21:26:12.960616 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2702/5504] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:12 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:13.973985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:13.981670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:14.052326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.060393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.076522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:14.077613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:14.078259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:14.087105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:14.149540 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-543f267e-5132-4523-b9e3-28e546a71b00 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182635 Oct 04 21:26:14.150972 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2803/5505] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:13 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:15.169121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:15.173617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:15.187111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.188211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.191362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.191362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:15.192057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:15.192842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:15.242575 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4ab7786-e3a9-41fa-8189-f02e3be08029 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078745 Oct 04 21:26:15.243698 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2703/5506] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:15 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:16.035202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.038789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.053130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.054720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.055514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.056647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.057356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.058334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.170129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6efec09e-bbd0-4a27-af47-0a9d604827f2 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139121 Oct 04 21:26:16.178001 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2804/5507] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:26:16.264506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.280556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=21 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.510591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.518649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18a9f340-8427-4751-b8af-c034e950af65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.261007 Oct 04 21:26:16.521852 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2704/5508] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:16.605071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.608720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.618553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.619699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.620557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.621522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.622310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.623848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.714644 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bee15e46-2a04-4ae4-909d-548ebae79cd5 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117382 Oct 04 21:26:16.715295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2805/5509] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:26:16 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:26:16.940638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:16.943763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:16.975630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.976940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.978008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:16.980611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:16.983665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:16.987770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.104468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:26:17.539368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:17.546079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:17.602249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.603254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.604091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.605485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.606348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.607164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.726738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a423557-d4de-4bdf-a5bc-9a4271b84e20 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194112 Oct 04 21:26:17.728856 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2806/5510] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:17 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:17.761801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b82007b7-adb3-41db-8ec5-7f8a96db422d tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 204 len: 0 microversion: 2.1 time: 0.828833 Oct 04 21:26:17.769527 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2705/5511] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:26:16 2022] DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 0 bytes in 833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:26:17.781037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:17.785451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:17.813845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.820570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.826031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:17.828080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:17.829407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:17.837836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:18.395127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:18.410125 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b2bc05a-ef39-4ba6-b0b4-f329c463af10 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1672 microversion: 2.1 time: 0.638036 Oct 04 21:26:18.411728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2807/5512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:17 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1672 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:18.746722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:18.749761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:18.763869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.770785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.771572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:18.773234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:18.774033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:18.774768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:18.866069 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47049357-1ae0-47c8-96e0-77f04a29d1c4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125036 Oct 04 21:26:18.876255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2706/5513] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:18 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:19.445192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:19.450000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:19.484044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.489645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.489645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.499192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.499821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.502835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.887989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:19.901049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:19.941304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.941802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.942576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:19.971536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:19.972559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:19.973279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:20.097618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:20.149555 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-14756ac5-3fd5-4b72-8f64-a7624c37beed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.268135 Oct 04 21:26:20.151960 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2707/5514] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:19 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:20.930703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:20.953324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1769ac05-0107-4409-b911-d327bc140aa0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1672 microversion: 2.1 time: 1.516164 Oct 04 21:26:20.955926 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2808/5515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:19 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1672 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:21.171766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:21.175601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:21.214330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.215171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.216525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:21.217648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:21.219055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:21.219905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:21.312121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3f1c3f3-eefd-4477-9d05-8ea2c9797be4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148998 Oct 04 21:26:21.338504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2708/5516] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:21 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:22.004818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:22.005964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:22.041403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.042286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.043150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.050368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.052237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.053566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.337493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:22.353683 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb33a3bc-a647-484b-b691-d40882aae0af tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1672 microversion: 2.1 time: 0.357059 Oct 04 21:26:22.356484 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2809/5517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:21 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:22.363393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:22.378239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:22.417650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.417650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.417650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.424853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:22.427777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:22.430028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:22.525891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b89d1735-1b12-412e-a25a-4cba15ea28b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179528 Oct 04 21:26:22.533255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2709/5518] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:22 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:23.396655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.405584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:23.428297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.429260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.436401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.438136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.439554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.442256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.552745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:23.555735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:23.576985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.590968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.590968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.601718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:23.609882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:23.614478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:23.681632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4446ad0-a09b-47d1-86d7-b87d2053b08e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139183 Oct 04 21:26:23.683819 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2710/5519] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:23 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:23.700508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:23.765043 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d284e6fb-8099-4320-9e14-c5d84730148e tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1604 microversion: 2.1 time: 0.358977 Oct 04 21:26:23.781528 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2810/5520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:23 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1604 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:24.722925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:24.725333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.770892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.811952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:24.813912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:24.868890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.875875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.877114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.881009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:24.883486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:24.891476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:24.900147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66ffe20c-1e5d-4532-bb6f-f355b4b1cf86 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198999 Oct 04 21:26:24.901728 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2711/5521] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:24 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:26:25.367254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:25.385114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:25.456877 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0cdfd6dc-0112-45e3-befc-3c6258899e32 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1604 microversion: 2.1 time: 0.651238 Oct 04 21:26:25.460961 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2811/5522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:24 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1604 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:26:25.935482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:25.954248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:25.993281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:25.996319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.003008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.006298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.011212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.013478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.183730 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-419b35f7-7faf-419f-bee7-86f80886237a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.264516 Oct 04 21:26:26.187558 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2812/5523] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:25 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:26.377026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d127956-d09e-4229-9e39-6b283198367f", "name": "network-vif-deleted", "tag": "dd227a11-541d-40c4-bee0-2bed04107454"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:26.404396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.405443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.406645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.437449 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] Creating event network-vif-deleted:dd227a11-541d-40c4-bee0-2bed04107454 for instance 6d127956-d09e-4229-9e39-6b283198367f on n-h2-851029-13 Oct 04 21:26:26.447869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e25a06c9-4c5b-4b5c-9e56-8438429bbf6c req-b5ac7087-ed62-41a2-9316-b28af1e75005 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.090535 Oct 04 21:26:26.450189 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2712/5524] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:26.528555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:26.529872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:26.580578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.583365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.591460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.605196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.611886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.614585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.841502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:26.842562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:26.843382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:26.846443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lazy-loading 'fault' on Instance uuid 6d127956-d09e-4229-9e39-6b283198367f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:26:26.982594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8faa07a8f88c460fb7972ac174f087e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc41a7a78a1428eaef197899143a842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:27.018888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6231c17e-3be5-412c-93dc-27a97a24ed86 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 200 len: 1326 microversion: 2.1 time: 0.524919 Oct 04 21:26:27.039124 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2813/5525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:26 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 1326 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:27.877940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:27.907877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:27.941605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.966910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.966910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:27.966910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:27.966910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:27.966910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.057939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:28.063225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:28.071956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.077915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.083155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.084234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:28.085696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:28.086546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f HTTP/1.1 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '6d127956-d09e-4229-9e39-6b283198367f'} Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:28.118344 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e942369f-afd5-4b6f-8fc0-10a08d761612 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 404 len: 111 microversion: 2.1 time: 0.060274 Oct 04 21:26:28.125095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2814/5526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:28 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:26:28.126318 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e867f1be-d429-422b-8ce0-a5fb019be103 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.918321 Oct 04 21:26:28.126318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2713/5527] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:27 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 197 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:26:28.132635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b46945fc-395f-4261-a01d-dc168231cf12 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '.version_select at 0x7f54f4e2f8b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:28.302163 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b46945fc-395f-4261-a01d-dc168231cf12 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327434807" status: 202 len: 0 microversion: 2.1 time: 0.172605 Oct 04 21:26:28.302163 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2815/5528] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 21:26:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327434807 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:26:29.140694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:29.145837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:29.192105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.199749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.200369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.201408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.202114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.202915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.332614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53ffb68f-f293-4fd0-aa50-9a5e23dfde79 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.202279 Oct 04 21:26:29.336617 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2714/5529] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:26:29 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:26:29.527188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:29.528557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:29.571913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.573240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.574722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.576189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:29.577171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:29.578293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:29.697711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:26:30.419967 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4d9256c-464f-4060-b12e-b653c04fe62a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 204 len: 0 microversion: 2.20 time: 0.894409 Oct 04 21:26:30.419967 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2816/5530] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:26:29 2022] DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 0 bytes in 896 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:26:30.430167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:30.431068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:30.456727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:30.458821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:30.460225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:30.463084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:30.465237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:30.467084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:31.101500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:31.154643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:31.160177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:31.166209 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5af1f4b5-8874-4ba3-9040-44e8c88ca3e7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.739128 Oct 04 21:26:31.167596 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2715/5531] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:30 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:26:32.241597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:32.246541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:32.266978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:32.294708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:32.298898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:32.300342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:32.302172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:32.307505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:32.308609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:33.744579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:33.766415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:33.770867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:33.776070 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2edadc53-3a9a-4231-b5f5-1bf9ae208327 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 1.551500 Oct 04 21:26:33.788750 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2817/5532] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:32 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:26:34.859490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:34.860502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:34.891218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.896599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.897296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:34.899580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:34.901936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:34.917367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:35.473762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:35.498971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:35.508651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:35.513114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5d318eb-3fec-4a0d-aa3f-0980c90eab44 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1723 microversion: 2.20 time: 0.694837 Oct 04 21:26:35.514171 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2716/5533] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:34 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1723 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:26:36.561442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:36.562265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:36.588687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:36.589195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:36.589642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:36.590390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:36.590995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:36.591442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:36.930598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:36.950454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:36.952413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:36.957436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b944b20a-9af5-4838-a5aa-e8562760cad2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1655 microversion: 2.20 time: 0.400110 Oct 04 21:26:36.957436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2818/5534] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:36 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1655 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:26:37.776829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6809e-95b0-4b29-a0ed-14295d65ec2d", "name": "network-vif-deleted", "tag": "353569f3-4e85-4136-99d1-432dff620da3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:37.848102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:37.848965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:37.855639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:37.930721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] Creating event network-vif-deleted:353569f3-4e85-4136-99d1-432dff620da3 for instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d on n-h1-851029-13 Oct 04 21:26:37.949479 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8e31209c-fb16-4090-8d84-a6a6efbfa821 req-041bd14a-4e3e-45c8-b8c7-f5ea66284a04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187695 Oct 04 21:26:37.953571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2717/5535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:26:38.011821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:38.016418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:38.049496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:38.055436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:38.056655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:38.058266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:38.065951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:38.067236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:38.796681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:38.859763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:38.875867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:38.878214 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd9dba1c-1af3-4084-8db9-e7c25971bcb3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 200 len: 1366 microversion: 2.20 time: 0.875722 Oct 04 21:26:38.879295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2819/5536] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:38 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 1366 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:26:39.935042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:39.939641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:39.991080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:39.995876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:39.998103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:40.007183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:40.013975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:40.016894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:40.088031 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d HTTP/1.1 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd7d6809e-95b0-4b29-a0ed-14295d65ec2d'} Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:40.094728 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:26:40.104218 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:40.110639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:40.112485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2b544f7-3e6b-44a4-92d1-80bce7e8c2fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 404 len: 111 microversion: 2.20 time: 0.190635 Oct 04 21:26:40.119180 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2718/5537] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:39 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:26:40.139474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07a4bea7-ca6b-4d64-b039-53de3b9a8bed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '.version_select at 0x7f54f4e2fb80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:40.390001 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07a4bea7-ca6b-4d64-b039-53de3b9a8bed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839483287" status: 204 len: 0 microversion: 2.20 time: 0.258900 Oct 04 21:26:40.392222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2820/5538] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 4 21:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839483287 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:26:46.783816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-446e49b4-54ec-4034-a2ac-facdca2c2858 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: .version_select at 0x7f54f5e21b80>, body: {"keypair": {"name": "tempest-keypair-1585271884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSFoJer0T9jM/rXqMzo6mSVJckO7fX742VW9v6IqU9hFfIG2bJK0UShtHVziwZL9ypgHPvSB8Vpe1fJOQmLCyGH+qssBBcRTM/sCLm/zN10jyBz5Jr7cykaoZo5oILnvg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:46.845485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-446e49b4-54ec-4034-a2ac-facdca2c2858 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for project c023b0edf8134957951656c8a7b32840. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:46.858719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-446e49b4-54ec-4034-a2ac-facdca2c2858 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for user 4dfa37193e464de6980fbc6c19567048 and project c023b0edf8134957951656c8a7b32840. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:47.058056 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-446e49b4-54ec-4034-a2ac-facdca2c2858 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.281099 Oct 04 21:26:47.059306 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2719/5539] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 4 21:26:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 284 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:26:55.962901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:55.976062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:55.976062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:55.976062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:55.984240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.989288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.993989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:55.995094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:55.995769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:55.999550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.038706 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f HTTP/1.1 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '6d127956-d09e-4229-9e39-6b283198367f'} Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:56.050986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f61cca9f-2c0a-4a70-a387-c16de4655ac0 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 404 len: 111 microversion: 2.1 time: 0.091782 Oct 04 21:26:56.064899 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2821/5540] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:26:55 2022] DELETE /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:56.073073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:56.078048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 6d127956-d09e-4229-9e39-6b283198367f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:56.090362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=57 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:56.093549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:56.100912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.101817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.107911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.109360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:56.110122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:56.115984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:56.135190 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f HTTP/1.1 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '6d127956-d09e-4229-9e39-6b283198367f'} Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:26:56.137797 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 6d127956-d09e-4229-9e39-6b283198367f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:26:56.148750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94ea734f-680f-459d-ba71-5764e0f74995 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f" status: 404 len: 111 microversion: 2.1 time: 0.081701 Oct 04 21:26:56.161158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2720/5541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:26:56 2022] GET /compute/v2.1/servers/6d127956-d09e-4229-9e39-6b283198367f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:26:56.516494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1746949944", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33308277-a82e-4e3c-bb45-537c08a9d6c3"}], "security_groups": [{"name": "tempest-securitygroup--1168539953"}], "key_name": "tempest-keypair-1585271884", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:26:57.223127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] validate_networks() for [('33308277-a82e-4e3c-bb45-537c08a9d6c3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:26:59.184892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:26:59.187213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:26:59.189832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:26:59.190453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:26:59.191417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:26:59.226789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:59.227884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:59.228700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:59.233759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:26:59.234749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:26:59.235569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:26:59.331573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for project c023b0edf8134957951656c8a7b32840. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:26:59.345458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Getting quotas for user 4dfa37193e464de6980fbc6c19567048 and project c023b0edf8134957951656c8a7b32840. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:26:59.392876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:26:59.397169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:26:59.678790 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74500cc7-4f33-4d5d-83a3-277d90693e23 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.175562 Oct 04 21:26:59.680893 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2822/5542] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 4 21:26:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 21:26:59.698104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:26:59.704169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:26:59.725092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:26:59.887145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:59.904823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:59.912488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:26:59.915653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5083f70a-e4bd-4c5c-b871-51175903695a tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1282 microversion: 2.20 time: 0.224830 Oct 04 21:26:59.915653 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2721/5543] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:26:59 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:00.973253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:00.974434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:01.209975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:01.255125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:01.264902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:01.277141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23802dc6-45e8-4cdb-97b5-01f277134ff9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1282 microversion: 2.20 time: 0.310783 Oct 04 21:27:01.303621 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2823/5544] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:00 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:02.358508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:02.367757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:02.828931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:02.853211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:02.857683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:02.860982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7272baa-a525-4723-aa69-6aa6df0d5007 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1282 microversion: 2.20 time: 0.531033 Oct 04 21:27:02.867593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2722/5545] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:02 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1282 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:03.917712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:03.918558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:03.941976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.942955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.943473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:03.944566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:03.945064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:03.945660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:04.227738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:04.249848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:04.254100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:04.259136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-545adf84-d117-4ada-a4df-c265cc101921 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1334 microversion: 2.20 time: 0.345970 Oct 04 21:27:04.262602 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2824/5546] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:03 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1334 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:05.315690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:05.316590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:05.355600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.361017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.361689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.362609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:05.363152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:05.373066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:05.911550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.977012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.990643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:05.994299 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb429787-3f2f-4a20-a6ac-6f8e00bbb22c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1342 microversion: 2.20 time: 0.682498 Oct 04 21:27:05.997042 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2723/5547] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:05 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1342 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:27:06.030100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:06.031805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:06.058194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.060473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.064543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.066823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.068023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.068991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.133356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a HTTP/1.1 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '245ad0f0-f9b9-4a07-876f-1e2db9a4f26a'} Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:06.136886 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.145588 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.149497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:06.153358 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7d0cd19-8cf0-434e-b143-bf84b7887719 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 404 len: 111 microversion: 2.1 time: 0.125890 Oct 04 21:27:06.154697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2825/5548] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:06 2022] DELETE /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:06.166492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:06.167365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] [instance: 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:06.181390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.190099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.190646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.191733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:06.193985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:06.219162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:06.281651 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] HTTP exception thrown: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Request method failure captured: Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a HTTP/1.1 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKLua1WLXKJscQvRlSqC4H4vEBWk32Hl9Ttptj03pu70mY9ihzATHYXE7IU0UBgQCNdlwRfPVZ2J-qHrB9cA5lbLH16OE4Alef2C6RGDeT8ez6Jd_zTEVPXgAtQk7ouGvVaWtA5WcuVb6aM8lqKy7emT9njicwiAbX72casg9MDiSM8 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7cc41a7a78a1428eaef197899143a842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7cc41a7a78a1428eaef197899143a842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7cc41a7a78a1428eaef197899143a842 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1918787450 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8faa07a8f88c460fb7972ac174f087e0 Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeTestJSON-1918787450-project Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '245ad0f0-f9b9-4a07-876f-1e2db9a4f26a'} Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:06.292136 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] Returning 404 to user: Instance 245ad0f0-f9b9-4a07-876f-1e2db9a4f26a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0eb1f84-177a-4fc1-a786-e030d1a0ff34 tempest-AttachVolumeTestJSON-1918787450 tempest-AttachVolumeTestJSON-1918787450-project] 10.222.0.36 "GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a" status: 404 len: 111 microversion: 2.1 time: 0.134032 Oct 04 21:27:06.302307 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2724/5549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:06 2022] GET /compute/v2.1/servers/245ad0f0-f9b9-4a07-876f-1e2db9a4f26a => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:27:07.049351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:07.050185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:07.070921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.071456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.071983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.074846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:07.075451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:07.075908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:07.325282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.335136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.347017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:07.356633 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78b458fb-ef4c-4e7d-9179-fb4ca981b6d7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1340 microversion: 2.20 time: 0.293676 Oct 04 21:27:07.360075 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2826/5550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:07 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1340 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:27:08.422482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:08.423583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:08.446436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.448825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.449358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.454358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:08.454944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:08.457451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:08.728103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:08.742178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:08.744405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:08.746179 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4202bb4b-b610-42f9-b7ad-81eea6fe021f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1340 microversion: 2.20 time: 0.331046 Oct 04 21:27:08.747210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2725/5551] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:08 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1340 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:09.783126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:09.783814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:09.787832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:09.804408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.804908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.805450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.807232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:09.807766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:09.808413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:09.928294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.961452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.968392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:09.969745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f0d05e3-c23f-4fb8-8e22-a415e1515d40 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1340 microversion: 2.20 time: 0.196838 Oct 04 21:27:09.986830 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2827/5552] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:09 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:11.005348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:11.006470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:11.020174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.021255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.021714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.022554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:11.023066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:11.023502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:11.219801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.236803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.241498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:11.245607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df05b68a-db4c-48a9-8f2a-f0724d5c81dd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1340 microversion: 2.20 time: 0.243815 Oct 04 21:27:11.245607 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2726/5553] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:10 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1340 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:12.280392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:12.282770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:12.291133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:12.303921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.306368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.308147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.310227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:12.311455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:12.312546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:12.998075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:13.033115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:13.035536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:13.038173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f8bc9ad-db7f-42c0-b539-797ff97a62bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.767831 Oct 04 21:27:13.055156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2828/5554] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:12 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:14.071375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:14.072550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:14.119050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:14.125212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.132108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.134062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.139592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.143863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.146401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.826812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.837485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.841855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:14.846071 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a57eb4c-c887-44b5-a592-fd7796c0d578 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.782950 Oct 04 21:27:14.848180 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2727/5555] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:14 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:15.890815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:15.893066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:15.901758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.902858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.906731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:15.906731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:15.906731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:15.906731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.190645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.212933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.215507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.217300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6220cb39-5e12-419e-9f22-78dcad8c6779 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.330844 Oct 04 21:27:16.218126 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2829/5556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:15 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:16.796216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:16.850553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.852360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.853977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.891451 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] Creating event network-changed:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:27:16.900525 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-72600eb6-d9eb-46dd-ac6f-368b60cc9a38 req-8a53cf4b-5873-43d9-858f-0fa6fefe78ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116621 Oct 04 21:27:16.901831 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2728/5557] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:17.253493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.254940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.269398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.271263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.272421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.274593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.279630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.279630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.670007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.695856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.700397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:17.706260 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0db7f3b8-0c83-47a4-878f-88a9576b4172 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.460912 Oct 04 21:27:17.709702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2830/5558] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:18.755660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:18.760291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:18.776478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.777105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.777555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.778985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.779819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.787481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.295018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.315349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.323020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.325290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4025ac59-b7fc-448d-a6d1-afc67fd9f457 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.574086 Oct 04 21:27:19.327697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2729/5559] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:18 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:20.374539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.375894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.393485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.394518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.396358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.401182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.454290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.055s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.457836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.586422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.587787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.621096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.625771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.627154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.628233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.628962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.630773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.906318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lazy-loading 'services' on Instance uuid 29f46080-3c9d-4d17-8907-fe2e80243d8f {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:21.362087 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3a0219b2-5978-48ca-adf3-ac4ad5a6124f tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "DELETE /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f/os-volume_attachments/a295f04d-b903-4317-9c5f-16e18875161f" status: 202 len: 0 microversion: 2.1 time: 0.784876 Oct 04 21:27:21.376866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2730/5560] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:27:20 2022] DELETE /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f/os-volume_attachments/a295f04d-b903-4317-9c5f-16e18875161f => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:27:21.854439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.886991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.891612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:21.895082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f300d3bd-eac5-44ff-b710-888fce5ab1fa tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 1.529204 Oct 04 21:27:21.896725 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2831/5561] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:22.940015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:22.944717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:22.953951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.954927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.955389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.956155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:22.964006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:22.964006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.355236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.376929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.378815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.393222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a94acbd3-c6ba-4dd6-80d2-57e3a00bf4a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.452130 Oct 04 21:27:23.394014 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2731/5562] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:22 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:23.617903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "name": "network-vif-plugged", "status": "completed", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:23.667733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.668237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.668718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.704536 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] Creating event network-vif-plugged:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:27:23.725252 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b17b54cb-1fec-44e2-97b7-9d32b2e6d81d req-bc8e0f43-5725-4618-8a35-19bbab861959 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113011 Oct 04 21:27:23.726233 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2832/5563] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:24.422706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.423323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.431912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.432387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.432838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.433980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.434526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.434994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.813894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.828967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.835741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.837466 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57d8313a-0325-4c76-a91c-0f6438edc193 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1408 microversion: 2.20 time: 0.419610 Oct 04 21:27:24.843276 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2732/5564] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:27:25.897308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.898187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.934329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.935430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.936345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.944463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.945776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.946571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.360006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.384876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.399524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.399524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8751d1f5-9c83-4319-9560-f11170419cf6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1600 microversion: 2.20 time: 0.509886 Oct 04 21:27:26.404170 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2833/5565] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:27:25 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1600 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:27:26.454892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.458985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:26.486223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.489387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.492037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.510850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.514923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.515902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.801130 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-230884ab-185f-471c-a5b6-35a4cace0545 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.354070 Oct 04 21:27:26.802553 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2733/5566] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 4 21:27:26 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-interface => generated 285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:27:31.683856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:31.716850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:31.743433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.744457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.752738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.769283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=57 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:31.841997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] Creating event network-changed:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:27:31.902510 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-50b3d1f8-b5da-441a-bd08-0755c27f433c req-5c761d08-683d-4058-b1e3-6bdd40d816dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595395 Oct 04 21:27:31.914616 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2834/5567] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:33.278471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:33.278471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:33.292102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=32 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:33.322620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.326059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.331594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.333235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.334230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.337899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.379638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:33.387865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:27:33.913138 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3b94876-7218-48c4-a817-e32e8ca07da1 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "DELETE /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 204 len: 0 microversion: 2.1 time: 0.661656 Oct 04 21:27:33.920329 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2734/5568] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:27:33 2022] DELETE /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:27:33.930720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:33.935700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:33.948765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.949980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.951183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.952788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.954103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.955161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.319065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:34.333263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b09198b6-5302-4616-adfb-7e1f1665c178 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1468 microversion: 2.1 time: 0.409037 Oct 04 21:27:34.335183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2835/5569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:33 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:35.372253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.373155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.382385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.382957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.383428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.384135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.384598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.385019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.780428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:35.798797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a2311bc-7a72-4e40-9792-4b0bf09f2c0d tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1468 microversion: 2.1 time: 0.431037 Oct 04 21:27:35.799426 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2735/5570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:35 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1468 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:36.852668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:36.854772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:36.897385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.899873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.904205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:36.909850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:36.912278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:36.915860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.137144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f46080-3c9d-4d17-8907-fe2e80243d8f", "name": "network-vif-deleted", "tag": "26f77c76-24ce-4b0f-8498-725e44ea3120"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:37.156481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.158471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.159010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.187204 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] Creating event network-vif-deleted:26f77c76-24ce-4b0f-8498-725e44ea3120 for instance 29f46080-3c9d-4d17-8907-fe2e80243d8f on n-h1-851029-13 Oct 04 21:27:37.207933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c89f97ed-8d17-4ab2-9ae6-3ad806be62d7 req-e9a60a10-abed-4609-8b0b-1dad4cf0911c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074778 Oct 04 21:27:37.209213 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2736/5571] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:37.232040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:37.279085 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-804d3929-80a5-412c-a80e-db13e4d4fb7e tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1426 microversion: 2.1 time: 0.432761 Oct 04 21:27:37.293816 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2836/5572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:36 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1426 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:38.331260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:38.337931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:38.356872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.358030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.359117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.360661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.361715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.362790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.441654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:38.442569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:38.443429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:38.444639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lazy-loading 'fault' on Instance uuid 29f46080-3c9d-4d17-8907-fe2e80243d8f {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:27:38.697571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151800376dd64e74b43f131a56e05825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0477eb2ad6154ec7b1e74cf35a85c31f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:38.737357 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f80a8535-f6a7-499e-ad28-56de29563630 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 200 len: 1304 microversion: 2.1 time: 0.431467 Oct 04 21:27:38.739062 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2737/5573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:38 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 1304 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:39.791221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:39.799193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] [instance: 29f46080-3c9d-4d17-8907-fe2e80243d8f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:39.820718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.827788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.828629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.829663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:39.830417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:39.834044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:39.865436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] HTTP exception thrown: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Request method failure captured: Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f HTTP/1.1 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKQhMmCoWoG6Q6j2QUtdtStVclIiy0np7TJFPGMCvjlJWrfvhJ_D98nMMJ0J-qq1EZgZA0qnVhtLteuhZ-wTGK2xaO-cMdNjpW1W3cy-P-xvfm5_uEJhce__Ixo9s1HnuZ8dDgKhedCqvHRIhT-hGi6kyeAlF1oSkMeRuRHbc9kTa3A Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0477eb2ad6154ec7b1e74cf35a85c31f Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesBackupsTest-566438773 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0477eb2ad6154ec7b1e74cf35a85c31f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0477eb2ad6154ec7b1e74cf35a85c31f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0477eb2ad6154ec7b1e74cf35a85c31f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0477eb2ad6154ec7b1e74cf35a85c31f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesBackupsTest-566438773 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0477eb2ad6154ec7b1e74cf35a85c31f Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesBackupsTest-566438773 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesBackupsTest-566438773-project Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 151800376dd64e74b43f131a56e05825 Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesBackupsTest-566438773-project Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '29f46080-3c9d-4d17-8907-fe2e80243d8f'} Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:27:39.869314 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. Oct 04 21:27:39.879029 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:27:39.884650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] Returning 404 to user: Instance 29f46080-3c9d-4d17-8907-fe2e80243d8f could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:27:39.887641 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f4239f5a-d16e-482d-b76d-f6d8831c4487 tempest-VolumesBackupsTest-566438773 tempest-VolumesBackupsTest-566438773-project] 10.222.0.36 "GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f" status: 404 len: 111 microversion: 2.1 time: 0.104699 Oct 04 21:27:39.889041 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2837/5574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:39 2022] GET /compute/v2.1/servers/29f46080-3c9d-4d17-8907-fe2e80243d8f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:28:03.251011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:03.251948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:03.269632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:03.272783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:03.293639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:03.295214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:03.296397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:03.300084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:03.304836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:03.309669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:03.402451 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a62b60a5-7ed1-4a13-9083-3faf3a973ef2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/ips" status: 200 len: 151 microversion: 2.20 time: 0.155000 Oct 04 21:28:03.407945 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2738/5575] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Oct 4 21:28:03 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/ips => generated 151 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:28:09.091969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:09.097247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:09.104071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=7 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:09.124227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:09.136097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:09.137048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:09.141127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:09.141127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:09.141810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:09.143217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:09.241444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lazy-loading 'flavor' on Instance uuid e4803609-04c4-4a1d-9ab3-2c9544adc5a9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:28:10.319941 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-239f5790-fcc8-47a9-a10b-1c3c7e104411 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/action" status: 202 len: 0 microversion: 2.20 time: 1.235123 Oct 04 21:28:10.329607 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2838/5576] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:28:09 2022] POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/action => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:28:10.345878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:10.358974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:10.398503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:10.398503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:10.398503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:10.402803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:10.402803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:10.402803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:10.766027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:10.790039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:10.793752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:10.797487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a1fae970-2f46-4b47-b1c1-08a650cd37a4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.467960 Oct 04 21:28:10.799626 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2739/5577] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:10 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:11.854425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:11.856935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:11.874189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.876476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.878189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:11.880224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:11.881488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:11.882502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:12.216418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:12.246970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:12.250645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:12.255696 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20883720-61f9-493d-b597-7b4877c7e285 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.408349 Oct 04 21:28:12.260199 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2839/5578] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:11 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:13.307733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:13.309937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:13.349920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.355336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.357406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.363952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:13.372871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:13.372871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:13.924640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.956854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.960871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:13.965713 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6760ac6d-f688-45ec-9f5f-7242e27b89c6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.670781 Oct 04 21:28:13.965713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2740/5579] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:13 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:15.018462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:15.019332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:15.034153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:15.035126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:15.036363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:15.037725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:15.038893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:15.039873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:15.763968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:15.815901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:15.825452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:15.836389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-445d58f2-577a-4a1b-b541-7a2afebe2049 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.824132 Oct 04 21:28:15.859262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2840/5580] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:14 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:16.894094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:16.895797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:16.907010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.907620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.908738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:16.909966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:16.911044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:16.911734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:17.114543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:17.127149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:17.129278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:17.130639 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86e4ee7d-d1bc-4e30-a2b4-cdac51813c3d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.245214 Oct 04 21:28:17.131430 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2741/5581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:16 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:18.164105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:18.165188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:18.190880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:18.195853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:18.196653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.199075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:18.210525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:18.211131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:18.844279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.863668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.867506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:18.870533 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c62199c0-28e8-4260-b09c-ce75ed27a1ee tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.713974 Oct 04 21:28:18.917579 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2841/5582] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:18 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:19.959685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:19.965538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:20.010332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:20.013542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:20.015520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:20.020730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:20.023515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:20.024678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:20.868367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:20.910569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:20.928149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:20.935069 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7297a08-bc03-4b82-86d3-814c496f00d8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 1.004878 Oct 04 21:28:20.936462 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2742/5583] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:19 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:21.989585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:21.990465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:22.018326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:22.020835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:22.024417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:22.029058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:22.029916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:22.030569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:22.465973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:22.481086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:22.491052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:22.493883 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dc0a71a-61dc-4acb-9898-f18834649af6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1745 microversion: 2.20 time: 0.512975 Oct 04 21:28:22.498746 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2842/5584] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:21 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1745 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:23.531825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:23.537635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:23.562586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:23.563377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:23.564234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:23.565534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:23.573223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:23.573771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:23.883616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "name": "network-vif-plugged", "status": "completed", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:28:24.000046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:24.002627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:24.005026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:24.072437 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] Creating event network-vif-plugged:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:28:24.100781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-52164f72-f0e5-410f-9f96-76319b51a8b6 req-b5709508-316a-4fef-a534-9c9f2db2aa64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226860 Oct 04 21:28:24.102421 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2843/5585] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:28:24.112105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:24.143755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:24.149468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:24.171213 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bbbc3b5-7a7b-48d9-a330-250530287fdd tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.631831 Oct 04 21:28:24.172715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2743/5586] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:23 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:25.242922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:25.244681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:25.269253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:25.274254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:25.275758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:25.281083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:25.284843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:25.303079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:26.101828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:26.143295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:26.149402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:26.154059 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0fc06c1-8495-45dd-b831-0916c0b17052 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.923146 Oct 04 21:28:26.162999 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2844/5587] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:25 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:27.224007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:27.225237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:27.261909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.263532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.269570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:27.271404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:27.272548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:27.273689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:28.132824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:28.154071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:28.163568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:28.166079 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68d1945a-002d-47b9-a15c-4ef597267b19 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.954772 Oct 04 21:28:28.167424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2744/5588] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:27 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:29.232608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:29.236100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:29.326181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:29.331196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:29.334504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:29.340451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:29.341280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:29.342402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:29.966265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:30.049766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:30.057755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:30.074123 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b712872-7418-4408-9e8b-219e54279b7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.869905 Oct 04 21:28:30.116053 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2845/5589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:29 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:31.131602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:31.138686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:31.202909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:31.203817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:31.209532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:31.216215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:31.217076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:31.223872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:32.426010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:32.478373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:32.513883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:32.568951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c2a657d-f48a-45fb-812a-8dfb6f79dc87 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.449687 Oct 04 21:28:32.579659 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2745/5590] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:31 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:33.625864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:33.631842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:33.663311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:33.668591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:33.670099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:33.671880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:33.676458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:33.678008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:35.459112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:35.529977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:35.552294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:35.567513 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d65db00c-c415-44b3-9498-aa73f3cdaf47 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.945248 Oct 04 21:28:35.575384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2846/5591] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:33 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:36.635147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:36.639572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:36.708418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.717343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.721544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:36.734801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:36.745102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:36.747557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:39.427167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:39.458073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:39.462314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:39.508854 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-632957e6-2254-4652-8f75-24fc51272b70 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 2.874864 Oct 04 21:28:39.512353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2746/5592] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:36 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:40.583590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:40.586410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:40.599350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=19 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:40.607201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.611524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.614437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.616136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:40.619064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:40.620731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:40.630581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:42.306396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.405236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.409321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:42.421334 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-90f8da36-e563-435d-a546-5489c1565499 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.845693 Oct 04 21:28:42.425669 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2847/5593] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:40 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:43.484485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:43.490717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:43.505327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=19 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:43.534031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.547107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.550158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.560844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:43.567334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:43.572816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:43.606562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=53 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:28:44.139405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.168355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.172120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:44.175458 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa6181b4-04b5-4b30-ab69-79855d244677 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.699711 Oct 04 21:28:44.183647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2747/5594] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:43 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:45.243923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:45.247488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:45.301979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.303472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.309335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.311410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:45.312605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:45.315588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:45.836329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.861612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.865494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:45.873000 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4dbbb6e-1c07-429b-8fb2-3278e2b05224 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.650077 Oct 04 21:28:45.901043 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2848/5595] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:45 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:46.935377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:46.941416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:47.001828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.003177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.004016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:47.005209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:47.006098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:47.007125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:47.556349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:47.575831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:47.599348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:47.601722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b51bc77-84af-4050-8afb-639d908a3e28 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.683327 Oct 04 21:28:47.602769 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2748/5596] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:46 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:48.650483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:48.651398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:48.676254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.676767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.677281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:48.678318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:48.681808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:48.682763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:50.673666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.717808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.727812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:50.730081 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6748d393-fb53-4744-9962-4cb8bf25e8b1 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 2.083729 Oct 04 21:28:50.740252 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2849/5597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:48 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:51.833199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:51.834485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:51.889147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.897345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.898220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:51.901521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:51.905143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:51.907175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:52.452035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:52.509578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:52.529395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:52.543840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f77d78e-baaf-4615-9278-4d6e28a770d0 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.727796 Oct 04 21:28:52.628613 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2749/5598] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:51 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:28:53.630709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:53.640234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:53.756857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.757914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.766499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:53.768174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:53.769938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:53.769938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:54.551329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:54.568263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:54.572325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:54.583923 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b0a61a8-5d1e-468c-9d13-96aee1febf7b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.955018 Oct 04 21:28:54.583923 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2850/5599] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:53 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:55.650497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:55.664503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:55.749558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.750641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.763141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:55.766192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:55.767076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:55.767658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:56.925079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.012677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.017667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:57.021919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae86093f-d16c-4290-bae3-1b356440ce65 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.380603 Oct 04 21:28:57.023500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2750/5600] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:55 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:28:58.097405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:28:58.101745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:28:58.155470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.158295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.162562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:58.171440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:28:58.180816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:28:58.194720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:28:59.306730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.374345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.397157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:28:59.422563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a602d555-a441-41ea-8318-0de2f39562f8 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.337975 Oct 04 21:28:59.423576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2851/5601] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:28:58 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:00.475455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:00.476644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:00.558400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.570978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.572742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:00.592632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:00.594019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:00.602108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:01.632590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.715036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.733235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:01.738581 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a53d2c6a-4d67-4bef-b793-0e926916d04c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.270361 Oct 04 21:29:01.746394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2751/5602] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:00 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:02.801315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:02.804108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:02.832696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.833692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.835027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:02.837437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:02.839914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:02.841306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:05.290882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:05.313648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:05.316421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:05.319841 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f365709f-3095-4038-8d47-e3a1cbb80187 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 2.537450 Oct 04 21:29:05.329195 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2852/5603] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:02 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:06.364177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:06.366948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:06.412457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.431343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.431343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:06.439771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:06.441080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:06.444572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:08.403410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.499723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.520765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:08.523764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3964d31f-3f0f-456d-b6f6-6f78ee223fd7 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 2.165807 Oct 04 21:29:08.525801 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2752/5604] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:06 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:09.563419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:09.569486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:09.634525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.644778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.650216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:09.656418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:09.662446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:09.669540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:10.427576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.460141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.469609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:10.490495 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-155b8cd5-c160-4a04-a7fc-ebc7657a0b09 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 0.931128 Oct 04 21:29:10.496756 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2853/5605] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:09 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:11.573124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:11.576049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:11.674452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.678920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.684611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:11.697776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:11.707917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:11.710064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:12.460704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.558864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.562989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:12.576845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae783776-140e-420b-9d75-cb31ee8f92b6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.019866 Oct 04 21:29:12.595120 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2753/5606] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:11 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:13.642869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:13.645056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:13.658914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=14 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:13.675310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:13.679027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:13.682746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.685176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:13.692329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:13.694941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:13.843412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:14.842014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:14.875136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:14.898502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:14.923356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e733114-726f-4a8c-b037-156e55f6fe55 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1740 microversion: 2.20 time: 1.291901 Oct 04 21:29:14.947564 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2854/5607] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:13 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1740 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:15.962770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:15.968250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:16.033713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:16.076577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.089003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.095077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.098106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:16.110722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:16.111554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:16.134828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.335963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.353199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.354952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.363357 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-976bcfe7-1762-4cce-9070-4f90f9be8ad5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1722 microversion: 2.20 time: 1.412114 Oct 04 21:29:17.369008 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2754/5608] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:15 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1722 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:18.421810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:18.423024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:18.437433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.438030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.438711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.439555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.440032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.440586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.000690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:19.064239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:19.071444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:19.075680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1047b0d-2f6a-4b1b-8516-bc55e82f5d90 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1722 microversion: 2.20 time: 0.656273 Oct 04 21:29:19.076769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2855/5609] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:18 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:20.137875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:20.143590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:20.241793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.247940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.250567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.255545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.266640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "name": "network-vif-unplugged", "status": "completed", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:20.271849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.290874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.355412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.365866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.367363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.453050 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] Creating event network-vif-unplugged:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:29:20.503989 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-121b6806-7a68-40f5-86b7-f0d517f9335a req-0c320a1c-c318-470b-80bc-5e82da4b85b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.229151 Oct 04 21:29:20.505805 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2856/5610] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:21.424146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:21.448313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:21.452484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:21.455406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26f95484-e1f9-4bb3-aa43-37778b3856e4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1725 microversion: 2.20 time: 1.326478 Oct 04 21:29:21.457888 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2755/5611] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:20 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1725 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:21.499747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec91a6f6-f8e1-40c8-adf7-0dba249f7c14"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:21.503554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:21.579413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.591344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.594706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.595916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.596748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.597611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.008921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08aed43a-6051-45b8-9cf2-fc1481fa6197 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.516857 Oct 04 21:29:24.009944 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2857/5612] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 4 21:29:21 2022] POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments => generated 188 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:29:25.064895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.065833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:25.132654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.139963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.144687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.154839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.156083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.161960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.736493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c18a2852-8e1f-483c-8706-fe64bd997a99 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments/ec91a6f6-f8e1-40c8-adf7-0dba249f7c14" status: 202 len: 0 microversion: 2.20 time: 1.674115 Oct 04 21:29:26.744400 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2756/5613] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 4 21:29:25 2022] DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments/ec91a6f6-f8e1-40c8-adf7-0dba249f7c14 => generated 0 bytes in 1689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:26.893801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:26.895181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:26.926905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.932059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.933207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:26.936187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:26.949750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:26.950928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:27.629033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123541) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:29:28.277652 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:29:29.288938 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52514. Oct 04 21:29:29.296200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89f4f3f8-20b3-40b9-843b-ade6f1dc1115 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/action" status: 202 len: 0 microversion: 2.20 time: 2.411469 Oct 04 21:29:29.306555 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2858/5614] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 4 21:29:26 2022] POST /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/action => generated 0 bytes in 2420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:29.322423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:29.327422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:29.381369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.382492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.387629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:29.389708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:29.391017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:29.393230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:30.418489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.447522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.462559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:30.473639 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-112704c1-c2fb-4090-87f8-9d08e7bc2445 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1673 microversion: 2.20 time: 1.156505 Oct 04 21:29:30.475235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2757/5615] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:29 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1673 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:31.530525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.531731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.600649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.625802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.625802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.625802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.627407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.628195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:32.377747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:32.441879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:32.454355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:32.462045 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed2f18fd-3639-410c-988f-447dd7df974b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1673 microversion: 2.20 time: 0.935339 Oct 04 21:29:32.463663 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2859/5616] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:31 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1673 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:33.522035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:33.522925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:33.541988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.542630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.544119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.546595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.547236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.547466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.352079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.394970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.406008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.415018 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8287d677-30f4-42d7-83bd-a9ed3cc197ed tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1673 microversion: 2.20 time: 0.895169 Oct 04 21:29:34.421902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2758/5617] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:33 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1673 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:29:35.472471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:35.473552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:35.543646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.546184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.546433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.563274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.564235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.565053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.438971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.515973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.537869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.554218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b9687d1-ce0e-47aa-8b79-2b7bfb0ab6a5 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1673 microversion: 2.20 time: 1.091723 Oct 04 21:29:36.571294 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2860/5618] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:35 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1673 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:37.620781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:37.621566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:37.648138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.649161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.649683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:37.660154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.660154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.660154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.296782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.327718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.338248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.348344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f98d1310-ef59-4c05-bec3-4fac29faf8a2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.733217 Oct 04 21:29:38.351249 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2759/5619] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:37 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:39.402530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.403790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.422247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.423585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.424548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.442335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.443181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.443832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.761402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.775393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.779139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:39.782178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a79206d-b515-492d-b1a7-6d7fa1584cb2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.389023 Oct 04 21:29:39.784149 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2861/5620] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:40.832906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.835758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.866461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.868035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.869110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.872008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.874999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.876093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:41.270386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.292833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.297712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:41.300568 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3eb533a2-3bc6-46a6-b0aa-0bae5b0e5ce2 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.477405 Oct 04 21:29:41.321182 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2760/5621] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:42.364482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:42.369296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:42.424095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.430051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.442131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:42.445018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:42.450957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:42.460098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:43.811744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.847836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.850072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:43.851857 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2edeaef-85c1-42cb-aab8-b8369287aff4 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 1.500486 Oct 04 21:29:43.852537 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2862/5622] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:42 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:44.918541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:44.920840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:44.941134 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:29:44.941134 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 (ip 10.222.0.36) !!! Oct 04 21:29:44.943902 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:29:44.944110 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 (ip 10.222.0.36) !!! Oct 04 21:29:44.971645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.972813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.973964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:44.975795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:44.977192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:44.978323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:45.601684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.681823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.693140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:45.702384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b34d97d-4121-4594-a7f3-49ff1a2e9d0d tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.796663 Oct 04 21:29:45.725823 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2761/5623] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:44 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:46.781606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:46.787356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:46.816400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:46.841167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.845134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.845836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.846859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:46.854792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:46.854792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:46.900940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:48.253214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.314534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.323213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:48.326789 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d70000e3-dd27-4bfd-9a64-9d98c82a5bb9 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 1.576951 Oct 04 21:29:48.339619 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2863/5624] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:46 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:49.394067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:49.405328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:49.513015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:49.532419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.539622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.544073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.555704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:49.558207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:49.568667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:49.623875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:51.015211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:51.060113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:51.072936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:51.075413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f172d19-710b-43de-82fb-352caf05d22b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 1.692385 Oct 04 21:29:51.077259 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2762/5625] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:49 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:52.134400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:52.135610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:52.160065 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:29:52.160322 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 (ip 10.222.0.36) !!! Oct 04 21:29:52.203725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.204559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.205452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:52.206835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:52.216506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:52.221000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:56.130887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.166903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.174219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:56.190704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10b4a25f-eaa8-4100-93e7-bca03c9ca382 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 4.048652 Oct 04 21:29:56.195603 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2864/5626] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:52 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 4068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:57.255957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:57.259118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:57.300694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.301319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.306516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:57.312351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:57.316345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:57.323132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:58.130395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:58.194351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:58.216930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:58.222152 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46995254-7874-4e87-95b0-e644f0e8a1bb tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.976055 Oct 04 21:29:58.223163 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2763/5627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:57 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:29:59.269158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:59.273753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:59.340068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:59.344543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:59.345734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:59.347225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:59.351154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:59.352659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:00.645733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.738836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.742191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:00.758793 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e4e2dbd3-45c8-4f50-8f03-6cb76b926f2c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 1.487322 Oct 04 21:30:00.760476 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2865/5628] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:29:59 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:01.817263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:01.819616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:01.857280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.869378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.877715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:01.883731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:01.890654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:01.892330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.750458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:03.814480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:03.832755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:03.847100 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f298495c-4d1b-467e-99ad-d592b33d1f82 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 2.040947 Oct 04 21:30:03.854935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2764/5629] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:01 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:04.915996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:04.921262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:04.982612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.983765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.995739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:04.997241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:04.998189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:04.999275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.247758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:06.407993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:06.421494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:06.432609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0225eec8-a4ce-4027-b05e-3ffe6d13782f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 1.532917 Oct 04 21:30:06.447015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2866/5630] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:04 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:07.498220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:07.503351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:07.549085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.550489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.551431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.554026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.555250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.556318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.361222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.400447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.434168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.438546 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-585131e7-a277-47a5-8e7e-920f41c1320b tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.958769 Oct 04 21:30:08.448635 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2765/5631] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:07 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:09.490654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:09.491582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:09.534334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.535652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.537820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:09.541488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.546145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.547732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.129580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.160874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.164864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.165568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8349da43-0819-46c9-941f-e5cd97e50419 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.680529 Oct 04 21:30:10.204270 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2867/5632] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:09 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:11.235541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:11.236752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:11.283331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.284175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.284961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.286293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.287227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.297232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.882562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "name": "network-vif-plugged", "status": "completed", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:11.959523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.960259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.960479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.961541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.999837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:12.006885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:12.016918 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fcd98f9-0c90-4d56-9e78-fc1d4cd191a6 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.804117 Oct 04 21:30:12.036891 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2766/5633] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:11 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:12.047646 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] Creating event network-vif-plugged:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:30:12.077803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-33d370de-44a5-40bd-9b5e-b59ba5ab78fb req-208c542a-d723-4956-bb7a-dad86013c12c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.702415 Oct 04 21:30:12.092666 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2868/5634] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:13.086052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:13.111248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:13.138133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.139115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.140212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.141898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.142698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.143541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.582214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.610429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.627821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.629485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebd0a6b4-9fdc-482d-86ec-786af524138c tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.548844 Oct 04 21:30:13.630554 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2767/5635] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:13 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:14.694012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:14.719857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:14.758205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.763002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.773580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.780825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.793085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.796533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.510171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.549476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.552916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.561864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92d43678-33b6-4ceb-a354-893d3a0c1799 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.873679 Oct 04 21:30:15.562929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2869/5636] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:14 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:16.625567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.656879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.661810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.674844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.675945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.677419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.678277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.679323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.183674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.232166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.243272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.260050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e27b8ffe-0279-4dcc-991c-2191f728c03e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1731 microversion: 2.20 time: 0.652034 Oct 04 21:30:17.275477 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2768/5637] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1731 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:18.327179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:18.329456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:18.337072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=14 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:18.351619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.352823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.353876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.355469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.357150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.359311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.404601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=38 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:19.156425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:19.207738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:19.210109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:19.216666 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd2f9d8f-536b-4d13-bc2a-df9964aaeaf3 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1718 microversion: 2.20 time: 0.896235 Oct 04 21:30:19.233467 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2870/5638] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:18 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1718 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:44.821677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:44.834284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:44.842725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=13 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:44.842725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=41 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:44.865926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:44.867082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:44.872430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:44.873737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:44.874570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:44.875572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:44.983182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebdb5da0-1988-49cd-b5a1-2cc7beb80091 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.167681 Oct 04 21:30:44.995670 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2769/5639] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 4 21:30:44 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:45.201037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:45.204975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:45.218558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:45.219385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:45.221562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:45.222419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:45.223186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:45.225838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:45.226778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:45.228255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:45.347320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:45.971042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2e1cd94-bf23-4143-9b5c-cfa2a31f64ab tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 204 len: 0 microversion: 2.20 time: 0.779420 Oct 04 21:30:45.972222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2871/5640] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:30:45 2022] DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:30:46.002611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:46.005699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:46.025970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.026826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.032782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.032782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.032782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.032782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.661784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.702153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.718886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.723647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7b69242-dc7b-4fde-be80-bdea20d76770 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 1.744960 Oct 04 21:30:47.730266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2770/5641] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:45 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:48.781615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:48.783955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:48.804784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.805969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.809840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.809840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.810579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.811806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.644494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.662197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.665491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.672686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-446fcd79-b3e4-4037-822e-9161f0bc8d8f tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1724 microversion: 2.20 time: 0.900245 Oct 04 21:30:49.675324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2872/5642] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:48 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1724 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:30:50.724954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:50.728515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:50.765814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.766511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.767145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.768262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.782701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.788518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.063204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.094244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.111093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.122988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6551485b-6132-401b-859b-8fb05925e92e tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1656 microversion: 2.20 time: 0.401469 Oct 04 21:30:51.124048 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2771/5643] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:50 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1656 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:52.187480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.199762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.252562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.255376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.257257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.258635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.262747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.263521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.644862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.677838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.681936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfa37193e464de6980fbc6c19567048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c023b0edf8134957951656c8a7b32840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.695531 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57840e43-cbbe-4c51-a080-a0a08abf6e83 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 200 len: 1656 microversion: 2.20 time: 0.519316 Oct 04 21:30:52.701108 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2873/5644] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 1656 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:30:53.748688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:53.749775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:53.785894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.787048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.788038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.796115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.800936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.805132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.847115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4803609-04c4-4a1d-9ab3-2c9544adc5a9", "name": "network-vif-deleted", "tag": "28a5bcd5-21d7-429a-b4b0-47ee4ad54659"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:53.897032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:30:53.902648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.903638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.906360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 HTTP/1.1 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e4803609-04c4-4a1d-9ab3-2c9544adc5a9'} Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:30:53.912991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:30:53.924519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:53.930702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58a99cd9-c723-4096-84b8-6c4acd2403be tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 404 len: 111 microversion: 2.20 time: 0.183846 Oct 04 21:30:53.930702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2874/5645] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:30:53 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:30:53.945012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] Creating event network-vif-deleted:28a5bcd5-21d7-429a-b4b0-47ee4ad54659 for instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 on n-h2-851029-13 Oct 04 21:30:53.959891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2e49a7c5-67d4-4f41-be8d-8c80116d345f req-3443ef3c-5fbb-421d-8fe2-ca0caac88dea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.312250 Oct 04 21:30:53.961729 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2772/5646] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:53.970742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a6a90579-8ca7-4a5c-8532-d4b45fa5ea16 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '.version_select at 0x7f54f5498310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:54.123918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a6a90579-8ca7-4a5c-8532-d4b45fa5ea16 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585271884" status: 204 len: 0 microversion: 2.20 time: 0.182012 Oct 04 21:30:54.129821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2875/5647] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 4 21:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585271884 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:31:07.035487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.036545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.044503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:07.046245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=20 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:07.062133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.063073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.064800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.066185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.067083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.068315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 HTTP/1.1 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'e4803609-04c4-4a1d-9ab3-2c9544adc5a9'} Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:31:07.185973 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7fdc337-2b32-43a4-a4ac-609358ef4808 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 404 len: 111 microversion: 2.20 time: 0.082224 Oct 04 21:31:07.193579 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2773/5648] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:31:07 2022] DELETE /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:07.195510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:07.195510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:07.198716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.198716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: e4803609-04c4-4a1d-9ab3-2c9544adc5a9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.212564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.213172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.214133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.220075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.221188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.222849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.321002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 HTTP/1.1 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e4803609-04c4-4a1d-9ab3-2c9544adc5a9'} Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.330324 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance e4803609-04c4-4a1d-9ab3-2c9544adc5a9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:07.338220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-deb18d26-cd69-4cc8-8e72-200aac7b1975 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9" status: 404 len: 111 microversion: 2.20 time: 0.144242 Oct 04 21:31:07.343561 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2876/5649] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/e4803609-04c4-4a1d-9ab3-2c9544adc5a9 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:17.903438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:17.903438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:17.925688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.926189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.926764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.927584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:17.928207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:17.928743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.997766 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d HTTP/1.1 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'd7d6809e-95b0-4b29-a0ed-14295d65ec2d'} Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:18.000060 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.008225 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.011149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:18.020942 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15c20cb6-9a5c-42c8-b85b-72b4fd164071 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 404 len: 111 microversion: 2.20 time: 0.135306 Oct 04 21:31:18.020942 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2774/5650] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 4 21:31:17 2022] DELETE /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:31:18.041675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:18.053976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] [instance: d7d6809e-95b0-4b29-a0ed-14295d65ec2d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:18.228780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:18.236825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:18.239239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.245685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:18.256200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:18.260123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:18.361737 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] HTTP exception thrown: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Request method failure captured: Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d HTTP/1.1 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKPWpvSAeKR6XX2ooRM1ZaDTTgWhi0fegCQgT9XzdbHdEOzo-7ZJ3GAl6u9kCQN9WjlVTuJYVYwJ-JB2rQxFFd_fEtKZo7XgJUoH9URhn5amCrNaw4SjOSm0J6cgVCpXRJZi7GSuMtu28vEr-51mhoG121v4mHvc6vh2JFIO5yu8izo Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c023b0edf8134957951656c8a7b32840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c023b0edf8134957951656c8a7b32840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c023b0edf8134957951656c8a7b32840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c023b0edf8134957951656c8a7b32840 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222343391 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4dfa37193e464de6980fbc6c19567048 Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222343391-project Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd7d6809e-95b0-4b29-a0ed-14295d65ec2d'} Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.369248 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. Oct 04 21:31:18.374753 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:31:18.383446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] Returning 404 to user: Instance d7d6809e-95b0-4b29-a0ed-14295d65ec2d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:18.386066 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f64ce66-b4fc-44d2-a591-4d7ca90e0200 tempest-AttachVolumeShelveTestJSON-1222343391 tempest-AttachVolumeShelveTestJSON-1222343391-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d" status: 404 len: 111 microversion: 2.20 time: 0.365806 Oct 04 21:31:18.391384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2877/5651] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 4 21:31:18 2022] GET /compute/v2.1/servers/d7d6809e-95b0-4b29-a0ed-14295d65ec2d => generated 111 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:32:03.442134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:03.446587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:03.919056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9d63e3b-d000-4269-bd78-edc855db8ea4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: .version_select at 0x7f54f64f5790>, body: {"keypair": {"name": "tempest-keypair-2106209014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMc946+w6bUJxKlb44AhjiHAAG7qe4QOKBA8mXXl5klanL2wFk0KEBMqajNaGNPo6znXSFnqNwMtLyGRnWprmMRel/buywJpkQwdJvyuFBRMdwZi6ItZ/JkHaaSG2StcQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:04.017588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b9d63e3b-d000-4269-bd78-edc855db8ea4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:04.041501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-b9d63e3b-d000-4269-bd78-edc855db8ea4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:04.222825 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9d63e3b-d000-4269-bd78-edc855db8ea4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.799328 Oct 04 21:32:04.228686 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2775/5652] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:32:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:07.987151 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:32:08.893757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-031dab38-3733-4a6e-935d-2b0dbac6764d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: .version_select at 0x7f54f4df2d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-944519102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0mkbkWadYXwoiUr8Or4fqNgGI3M2Xs+BZbGZBGgThY6eNd+J6WoDT5t+8szkNGxPbE9lkUoISFXcSZ/g9V8an4Vk4WNxqvVp4Umi0S4JX97yycTnNcw3RpuEoU57jQVA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:09.015326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-031dab38-3733-4a6e-935d-2b0dbac6764d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:09.041431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-031dab38-3733-4a6e-935d-2b0dbac6764d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:09.280239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-031dab38-3733-4a6e-935d-2b0dbac6764d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.300921 Oct 04 21:32:09.282211 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2878/5653] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:32:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:14.787835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-770739570", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1"}], "security_groups": [{"name": "tempest-securitygroup--812612666"}], "key_name": "tempest-keypair-2106209014", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:14.879611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:14.899539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:15.610868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] validate_networks() for [('b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:18.324726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:18.325766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:18.326413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:18.328228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:18.329137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:18.351143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.352113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.352931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.354553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.355488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.356314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.403354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:18.416275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:18.447103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:18.452365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:18.695188 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d8ff798-ddd1-48ad-8f0c-eae7d03961b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.917775 Oct 04 21:32:18.697008 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2776/5654] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:32:18.719820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67668373-6cf1-4414-be63-5317fc2da3b4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:18.720979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67668373-6cf1-4414-be63-5317fc2da3b4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:18.725652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:18.925727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-67668373-6cf1-4414-be63-5317fc2da3b4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:18.943239 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67668373-6cf1-4414-be63-5317fc2da3b4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1241 microversion: 2.1 time: 0.232022 Oct 04 21:32:18.945285 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2879/5655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:18 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1241 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:19.983299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3093d621-f0f3-44b9-b66f-8a8e3a743aeb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:19.984735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3093d621-f0f3-44b9-b66f-8a8e3a743aeb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.166900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3093d621-f0f3-44b9-b66f-8a8e3a743aeb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:20.186446 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3093d621-f0f3-44b9-b66f-8a8e3a743aeb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1241 microversion: 2.1 time: 0.211795 Oct 04 21:32:20.188736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2777/5656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:19 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:21.232591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2774b642-42df-4b4f-8a3d-9a21c2629b58 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:21.240218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2774b642-42df-4b4f-8a3d-9a21c2629b58 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:21.502378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2774b642-42df-4b4f-8a3d-9a21c2629b58 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:21.527381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2774b642-42df-4b4f-8a3d-9a21c2629b58 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1241 microversion: 2.1 time: 0.302048 Oct 04 21:32:21.542879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2880/5657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:21 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1241 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:22.583772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a86a4a52-cebe-410c-9602-fb79965a914e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:22.594297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a86a4a52-cebe-410c-9602-fb79965a914e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:22.859931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a86a4a52-cebe-410c-9602-fb79965a914e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.881808 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a86a4a52-cebe-410c-9602-fb79965a914e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1241 microversion: 2.1 time: 0.313532 Oct 04 21:32:22.883000 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2778/5658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:22 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1241 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:23.917232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.918184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:23.939332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.940277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.940883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.942238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.943190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.948084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.247401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.276037 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-af89467d-8080-4c3d-8251-88c52559093e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1245 microversion: 2.1 time: 0.362930 Oct 04 21:32:24.278226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2881/5659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1245 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:25.316645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:25.322529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:25.346258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.353827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.354732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.355884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.358747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.361223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.570202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:25.594780 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5edbb162-1e50-4d04-b46b-aee2924e0223 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1293 microversion: 2.1 time: 0.291238 Oct 04 21:32:25.597595 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2779/5660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:25 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:26.638992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:26.640731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:26.651764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.652784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.653453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.659122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.659122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.659122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:27.091641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:27.139543 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16d901ac-595c-47cf-a6a6-2071d9f3608f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1299 microversion: 2.1 time: 0.507314 Oct 04 21:32:27.155182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2882/5661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:26 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1299 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:28.175200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:28.176030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.202055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.202721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.203358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.204350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.204865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.205382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.383038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:28.968149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.994155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97c58526-d28f-4303-b183-6758d65c3b82 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1299 microversion: 2.1 time: 0.824045 Oct 04 21:32:28.998858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2780/5662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:28 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1299 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:30.025652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:30.027330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:30.048189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.049297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.050477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.052168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.053912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.055749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.346382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:31.392463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5335da2e-e589-487c-8ac5-cd6981d1bdae tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 1.369005 Oct 04 21:32:31.394182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2883/5663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:30 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:32.447835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:32.459222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:32.547613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:32.866918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:33.656460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:33.701841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57d70f06-9c00-4683-97bf-53d02aabe63d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 1.257415 Oct 04 21:32:33.710104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2781/5664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:32 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:34.754134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:34.759810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:34.770263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:34.794314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.809243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3885b224-a1d5-4fbb-b05b-f318b25bf34a", "tag": "5eaa60c7-eb7f-405e-9454-e9491ca6fe93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:34.811182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.817638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.820858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.831619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.839009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.885371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.898234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.900664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.974407 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] Creating event network-changed:5eaa60c7-eb7f-405e-9454-e9491ca6fe93 for instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a on n-h2-851029-13 Oct 04 21:32:34.994334 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f26498de-c54d-41a3-a2d8-a157a393d9bd req-6228369f-0527-4946-a895-8cb4a67193bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193443 Oct 04 21:32:35.002951 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2782/5665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:36.331413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:36.348421 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-88e029b2-eaa5-4bcc-a903-f8787da2302b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 1.602175 Oct 04 21:32:36.350906 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2884/5666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:34 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:37.394385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:37.395957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:37.428515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.429983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.430937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:37.433762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.435305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.436435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.111207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:38.137849 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29cf5761-078e-406e-8ecb-e24cdd5721b3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 0.755147 Oct 04 21:32:38.140701 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2783/5667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:37 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:39.182320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:39.183574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:39.228448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.250935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.966180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1436280744", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "7951c81b-ad5c-4e95-b83c-554f0cb1d61f"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:40.104603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] validate_networks() for [('7951c81b-ad5c-4e95-b83c-554f0cb1d61f', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:40.134183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:40.155245 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-809346cd-aa22-495d-9c23-decfc640c3ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 0.977918 Oct 04 21:32:40.157698 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2885/5668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:39 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:41.210914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:41.213773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:41.231843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.233483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.234646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.236219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.237340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.238363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.597315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:41.597961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:41.601326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:41.605425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:41.606999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:41.636288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.637592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.639042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.640864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.641821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.644180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.746603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Getting quotas for project f9cd4ebe3e544579b3b905bbed16647a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:41.764319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Getting quotas for user 5440df8e46804301a9d9d16ad6b1a3a9 and project f9cd4ebe3e544579b3b905bbed16647a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:41.792205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:41.795644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:41.797852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:41.829170 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-012fc1f2-11b7-4423-9a79-cdf276eb4464 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 0.632494 Oct 04 21:32:41.851419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2886/5669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:41 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:42.078057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8643f170-eb31-4ba2-b683-c2ff4a2a18f8 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.590710 Oct 04 21:32:42.080944 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2784/5670] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:32:42.104021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56b6c259-cb78-4651-bb66-dc0ae4e71bdb tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:42.106069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56b6c259-cb78-4651-bb66-dc0ae4e71bdb tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:42.257529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56b6c259-cb78-4651-bb66-dc0ae4e71bdb tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:42.270311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56b6c259-cb78-4651-bb66-dc0ae4e71bdb tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1214 microversion: 2.1 time: 0.176513 Oct 04 21:32:42.271521 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2887/5671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:42 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:42.883716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:42.885251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:42.904540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.906502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.907477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.909206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.910245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.911018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:43.265196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:43.293163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ec83ad1-2b40-4a43-8ef5-34d605f91232 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 0.418556 Oct 04 21:32:43.295239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2785/5672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:42 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:43.325512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6aafe8f-dd07-47e5-998a-6149c30dff83 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:43.327471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6aafe8f-dd07-47e5-998a-6149c30dff83 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:43.432552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3885b224-a1d5-4fbb-b05b-f318b25bf34a", "name": "network-vif-plugged", "status": "completed", "tag": "5eaa60c7-eb7f-405e-9454-e9491ca6fe93"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:43.457285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:43.458497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:43.460034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:43.496738 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] Creating event network-vif-plugged:5eaa60c7-eb7f-405e-9454-e9491ca6fe93 for instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a on n-h2-851029-13 Oct 04 21:32:43.496999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6aafe8f-dd07-47e5-998a-6149c30dff83 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:43.520741 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d0907407-15c6-460e-8b5b-9a4093d86824 req-effb27c9-5069-433a-adb7-45f6023ef6b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093929 Oct 04 21:32:43.523976 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2786/5673] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:32:43.548082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6aafe8f-dd07-47e5-998a-6149c30dff83 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1214 microversion: 2.1 time: 0.236883 Oct 04 21:32:43.549650 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2888/5674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:43 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:44.339941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:44.342414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:44.357849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.359304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.374975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.377203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.379329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.382732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.594503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:44.594938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:44.609219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.616460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.619595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.619595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:44.622436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:44.623968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.843582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:44.860337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7bf5c3c-a686-4c03-a847-8583d7f81de3 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1218 microversion: 2.1 time: 0.271679 Oct 04 21:32:44.863762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2889/5675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:44 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1218 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:44.885687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1075374549", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "4b5b2dd3-1b01-4c90-8902-642996b64019"}], "key_name": "tempest-TestNetworkAdvancedServerOps-944519102", "security_groups": [{"name": "tempest-secgroup-smoke-860405652"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:45.098420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:45.102555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=43 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:45.129834 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edc6439e-f904-45d5-8a52-b81bd696811a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1366 microversion: 2.1 time: 0.800114 Oct 04 21:32:45.157597 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2787/5676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:44 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1366 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:45.414866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] validate_networks() for [('4b5b2dd3-1b01-4c90-8902-642996b64019', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:45.929271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:45.931769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:45.945335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:45.967363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.970618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.975845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.978061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.981263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.984573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.273987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:46.295340 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8a5b0b62-eff7-423c-ba31-396287a60046 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1266 microversion: 2.1 time: 0.388566 Oct 04 21:32:46.296800 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2788/5677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:45 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:46.306480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:46.308411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:46.321727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.324401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.325374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.327027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.327934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.329087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.036725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:47.051905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b9c1cfe6-1923-4a2f-b554-4fc78ef23d5f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1556 microversion: 2.1 time: 0.753578 Oct 04 21:32:47.057171 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2789/5678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:46 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1556 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:47.089367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:47.090458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:47.108089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.109031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.110013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.115388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.116235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.117015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.178615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:47.180315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:47.180315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:47.181008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:47.181777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:47.228292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.235572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.236519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.238727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.257777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.260807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.386777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:47.419465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:47.419739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74589e7d-f166-460d-bc8d-499f9f445809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.334593 Oct 04 21:32:47.421017 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2790/5679] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:32:47 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:47.427319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:47.431128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:47.447604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.459546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.460367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.461644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.462351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.463173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.467713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:47.472320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:47.630024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:47.642358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1e26530-c966-4a72-84ed-ee8f45e77fce tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1272 microversion: 2.1 time: 0.219782 Oct 04 21:32:47.643389 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2791/5680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:47 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:48.294235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3beeb878-59ee-457c-8de8-3ea00ccdf003 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.428875 Oct 04 21:32:48.295176 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2890/5681] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:32:48.312848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0cd35a89-f5cd-4ee7-ae09-a8c60599edd4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:48.314335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0cd35a89-f5cd-4ee7-ae09-a8c60599edd4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:48.678926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0cd35a89-f5cd-4ee7-ae09-a8c60599edd4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:48.688111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:48.688870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:48.694643 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0cd35a89-f5cd-4ee7-ae09-a8c60599edd4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1266 microversion: 2.1 time: 0.388862 Oct 04 21:32:48.697610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2792/5682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:48 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:48.729812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.729812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.729812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.729812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.733583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.734240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:49.012102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:49.020666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=49 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:49.062086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ff4a7ef-1e86-49fd-a4c3-e799bda3247a tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1272 microversion: 2.1 time: 0.378820 Oct 04 21:32:49.074813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2891/5683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:48 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1272 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:49.722949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cdf1544-5188-4dcf-bf7a-5a8778c73160 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:49.726325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cdf1544-5188-4dcf-bf7a-5a8778c73160 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:49.955904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4cdf1544-5188-4dcf-bf7a-5a8778c73160 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:49.970111 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cdf1544-5188-4dcf-bf7a-5a8778c73160 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1266 microversion: 2.1 time: 0.251347 Oct 04 21:32:49.972102 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2793/5684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:49 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:50.101146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:50.101943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:50.127339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:50.127896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:50.128544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.129466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:50.129962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:50.130599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.999099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:51.000007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:51.012106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.015490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.024079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.025000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.025594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.026136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.320549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:51.353036 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a4a6de24-d305-4785-b3c4-abaff4af6f42 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 1.258017 Oct 04 21:32:51.356095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2892/5685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:50 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:51.425921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:51.455266 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80d3970b-dc2d-4e82-ac2b-407b2be91b74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1270 microversion: 2.1 time: 0.460000 Oct 04 21:32:51.479184 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2794/5686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:50 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1270 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:51.858124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3885b224-a1d5-4fbb-b05b-f318b25bf34a", "tag": "5eaa60c7-eb7f-405e-9454-e9491ca6fe93"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:51.898344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.899131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.899775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.934703 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] Creating event network-changed:5eaa60c7-eb7f-405e-9454-e9491ca6fe93 for instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a on n-h2-851029-13 Oct 04 21:32:51.945856 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6ebae230-2786-4136-a2e0-cd8f98d3d7c6 req-5b0cdc69-7dd3-4e1b-bfff-9b179894b76f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279132 Oct 04 21:32:51.947061 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2893/5687] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:52.395016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:52.397345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:52.410331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:52.417443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.418706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.419817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.422037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.423667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.426340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.488990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:52.493969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:52.531018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.531832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.532336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.537775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.540672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.547587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.921955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:52.942263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56986410-a865-453f-b0a7-b00379297818 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1318 microversion: 2.1 time: 0.464791 Oct 04 21:32:52.959293 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2894/5688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:52 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:53.171338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:53.193306 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5042ac4-f360-454e-ae61-357d5da8f84d tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.799542 Oct 04 21:32:53.198120 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2795/5689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:52 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:53.979188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:53.986231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:54.016444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c58703-8f6a-4101-a07a-3a0f72a87ed4", "tag": "2869f678-9a86-4c81-b11b-b436157ac8f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:54.018942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.020122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.021162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.024161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.025271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.026227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.067986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.068317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.068783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.134217 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] Creating event network-changed:2869f678-9a86-4c81-b11b-b436157ac8f6 for instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 on n-h1-851029-13 Oct 04 21:32:54.141021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-68c1b4bc-aea5-431c-9a7a-31fdeab657ff req-48e5ceef-17cb-49e9-98de-7adf091e4e17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135751 Oct 04 21:32:54.141913 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2796/5690] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:54.234835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:54.235779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:54.257055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.258689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.260468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.262194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.263566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.270236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.462715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:54.472181 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-091e65e1-d1d5-40de-b279-3560e487072d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1324 microversion: 2.1 time: 0.503769 Oct 04 21:32:54.487528 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2895/5691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:53 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:54.975630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:54.997717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-268ade56-8765-4a8f-9c7d-002de5213689 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.770960 Oct 04 21:32:55.001511 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2797/5692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:54 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:55.509767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:55.511253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:55.526085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.527141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.527973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.529417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.530417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.531323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.647976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:55.674582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89043334-d03f-4035-ab9e-d5c7889a1a82 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1324 microversion: 2.1 time: 0.174517 Oct 04 21:32:55.674582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2896/5693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:55 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:56.045166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:56.046955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:56.082053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.085839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.087534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.088704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.093532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.096565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.463118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:56.505207 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ecd0fc1-c7fd-43ed-89ec-7891f4efb1e4 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.468143 Oct 04 21:32:56.520718 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2798/5694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:56 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:56.709463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:56.712145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:56.751990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.225815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:57.252811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc6977b3-94f8-4eb4-a352-9d8b4b6141ac tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.552633 Oct 04 21:32:57.273617 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2897/5695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:56 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:57.582059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:57.584466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:57.596221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.597725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.599127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.601232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.602592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.603793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.309915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:58.310742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:58.329712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:58.330495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:58.342798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.343745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.344619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.345872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.346960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.347779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.382417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:58.420155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b161b65-90aa-4d2f-9d7c-940995a6e650 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.868163 Oct 04 21:32:58.421396 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2799/5696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:57 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:59.074572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:59.113397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-717d65c2-7ef9-4fa0-a98e-c2c71cbcb9ef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.809863 Oct 04 21:32:59.121214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2898/5697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:58 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:59.486078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:59.491733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:59.520275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.522017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.525588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.527785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.529190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.531566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.967558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:00.200505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:00.208996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.229339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.230622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.231738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.233359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.234530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.235555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.260589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:00.290447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09cea0a5-fa3e-4e72-8301-d23d9a50db14 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.815604 Oct 04 21:33:00.303223 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2800/5698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:59 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:00.324043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:00.362342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.363681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.365309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.402033 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] Creating event network-changed:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h2-851029-13 Oct 04 21:33:00.413132 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b4646c87-e8d6-4643-9ae6-de61e467790f req-d7e61f5d-994e-44d5-ab22-32c85beaee65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106300 Oct 04 21:33:00.415092 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2801/5699] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:01.347590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:01.351466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:01.362823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:01.363638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:01.364853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.367311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:01.368631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:01.369802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.400533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:01.437257 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae8fb776-203a-414d-9e69-bb34ecf74f01 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 1.251904 Oct 04 21:33:01.455262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2899/5700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:00 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:01.934480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c58703-8f6a-4101-a07a-3a0f72a87ed4", "name": "network-vif-plugged", "status": "completed", "tag": "2869f678-9a86-4c81-b11b-b436157ac8f6"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:01.960528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:01.973123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:01.974598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:01.975314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.980840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eeba9a6c-368b-4cc1-a8fc-04bec785a676 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.644570 Oct 04 21:33:01.981985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2802/5701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:01 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:02.006632 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] Creating event network-vif-plugged:2869f678-9a86-4c81-b11b-b436157ac8f6 for instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 on n-h1-851029-13 Oct 04 21:33:02.020261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-75b1e5ed-4a6a-4bda-a874-d6c4226713b2 req-17868f9d-7248-4c22-8142-e7497a1af80b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100720 Oct 04 21:33:02.022859 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2900/5702] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:02.487762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:02.491230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:02.509970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.511067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.511984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.513758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.514755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.515639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.912238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:02.925937 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec7c3d90-eadd-4c4b-b24e-c2f4aec73483 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.445071 Oct 04 21:33:02.927421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2803/5703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:02 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.040512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.045752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.055003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.055919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.056739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.058115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.059042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.059858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.369817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:03.384510 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-188f2d2e-511e-4610-b9b0-b0b10b576f45 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1314 microversion: 2.1 time: 0.355307 Oct 04 21:33:03.397851 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2901/5704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.959084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.960675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.975146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.976601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.977904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.979597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.980796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.981906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.427793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:04.429086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:04.442561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.443685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.444485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.446534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.446725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.447590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.469138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:04.488082 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d6030dde-ff2c-461f-a769-234e28db006e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.536592 Oct 04 21:33:04.492456 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2804/5705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:04.938751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:04.956292 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-243c8b9a-d13e-47d1-93a6-5677f6d7e662 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1499 microversion: 2.1 time: 0.537456 Oct 04 21:33:04.958919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2902/5706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:04 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1499 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:05.538611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:05.540589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:05.553697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.554598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.555768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:05.557142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.558023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.558842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:05.912049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:05.936290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-157a8d5a-a2f6-4c83-a18e-6e17235a214c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.404752 Oct 04 21:33:05.940361 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2805/5707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:05 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:06.983520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:06.984970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.000277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.001317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.002129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.003633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.004543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.005509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.257745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:07.293870 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a7f1b8d-afd1-4af4-bebd-bf3fd63a0118 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.318807 Oct 04 21:33:07.295357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2903/5708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:06 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:08.330173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:08.335250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:08.373236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.377731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.377731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.379327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:08.380702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:08.381801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:08.890972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:08.912148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df673314-9559-4ac7-8f91-37ef76607090 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.590009 Oct 04 21:33:08.914381 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2806/5709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:08 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:09.347011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "name": "network-vif-plugged", "status": "completed", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:09.371847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:09.373382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:09.374614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:09.415764 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] Creating event network-vif-plugged:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h2-851029-13 Oct 04 21:33:09.431494 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-44d6c7d9-f10e-4975-90e2-794e0604c62d req-0abd1b58-cde6-40e7-bfe3-e7bc7c663169 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091292 Oct 04 21:33:09.435859 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2904/5710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:09.961631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:09.969902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:09.990954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:09.995929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:09.998646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:10.004670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:10.005899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:10.007309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:10.489103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:10.512364 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3428c861-f85a-4589-906a-8bc7e6f77bc8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1391 microversion: 2.1 time: 0.563816 Oct 04 21:33:10.514382 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2807/5711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:09 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1391 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:11.562430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:11.565946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:11.571913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:11.596090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:11.597445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:11.599167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:11.601736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:11.603386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:11.605046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:11.989105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:12.010419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f74324d7-2771-4770-831d-7be87a4eda5f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1564 microversion: 2.1 time: 0.456626 Oct 04 21:33:12.013145 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2905/5712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:11 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1564 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:12.046572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:12.048962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:12.059568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.060380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.061239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.062582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:12.063787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:12.064570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:12.106199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:12.464699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:12.477148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94d2d186-6b71-4e99-8f59-99cf333f5811 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1564 microversion: 2.1 time: 0.438988 Oct 04 21:33:12.481129 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2808/5713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:12 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1564 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:13.916854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:13.918615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:13.934050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:13.935636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:13.938904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:13.940704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:13.945170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:13.946170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:14.007142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:33:14.736685 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-489bd706-7eb1-45fa-a3f5-beedb61b55c9 tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "DELETE /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 204 len: 0 microversion: 2.1 time: 0.830251 Oct 04 21:33:14.739089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2906/5714] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:13 2022] DELETE /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:14.750464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:14.751491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:14.769937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:14.773403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:14.774174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:14.775384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:14.776135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:14.778227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:15.637359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:15.660054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2762ff9e-9410-4f0c-b840-12aeb3d9e7bf tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1505 microversion: 2.1 time: 0.908252 Oct 04 21:33:15.660054 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2809/5715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:14 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1505 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:16.699629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:16.701219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:16.710606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.711605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.712309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:16.713392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:16.714251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:16.714994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:17.195125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c58703-8f6a-4101-a07a-3a0f72a87ed4", "name": "network-vif-deleted", "tag": "2869f678-9a86-4c81-b11b-b436157ac8f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:17.209391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:17.214280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:17.218112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:17.219625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:17.220500 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94559e0e-26b3-4e6c-a59f-6cc2092b686b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1505 microversion: 2.1 time: 0.526219 Oct 04 21:33:17.221088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:17.221449 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2907/5716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:16 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:17.240234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] Creating event network-vif-deleted:2869f678-9a86-4c81-b11b-b436157ac8f6 for instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 on n-h1-851029-13 Oct 04 21:33:17.246578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-34ffff40-9bd8-4d00-81ec-af363dde1c54 req-cecd6262-2c7d-4c97-8d0c-ec9c627f2783 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062358 Oct 04 21:33:17.247420 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2810/5717] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:33:18.264685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:18.268091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:18.281719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:18.283379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:18.284469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:18.297712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:18.298913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:18.300827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:18.353647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:18.354587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:18.355763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:18.357217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lazy-loading 'fault' on Instance uuid 70c58703-8f6a-4101-a07a-3a0f72a87ed4 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:33:18.368182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:18.786724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5440df8e46804301a9d9d16ad6b1a3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cd4ebe3e544579b3b905bbed16647a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:18.808986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79953d86-2eb4-4415-b3a6-5a6bfea4c86f tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 200 len: 1304 microversion: 2.1 time: 0.550341 Oct 04 21:33:18.811813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2908/5718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:18 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 1304 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:19.222611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:19.229871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:19.244975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:19.258070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.258572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.259261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.267790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.268693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.269514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.271501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.272364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.273155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.310473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] Creating event network-changed:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h2-851029-13 Oct 04 21:33:19.335349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8800f667-c49a-448d-b390-f5cc1ad88354 req-4169cb5d-ae14-475d-9c67-a7138a424f99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119560 Oct 04 21:33:19.344526 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2909/5719] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:19.755063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:19.790376 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff40e38b-0b51-47dd-a3c6-8f9a9a4a0da0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1564 microversion: 2.1 time: 0.584316 Oct 04 21:33:19.820899 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2811/5720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:19 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1564 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:19.852030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:19.855536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] [instance: 70c58703-8f6a-4101-a07a-3a0f72a87ed4] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:19.880909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.882209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.883235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.888987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.890875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.892093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.926186 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] HTTP exception thrown: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Request method failure captured: Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 HTTP/1.1 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZv_6-vvypW5podfPVv4MvEO_vnO0M1XrRtivsh0zCTsdoANKAFsjBrQZSLHMH4vmM0x1liNH2pMn-zRFgePL05RnrMmP8v5EeKbOt1ZEulvq9Nc173IgeTaBYxo9EmdMcWipC9Yq7KyJBdP1i1lHjB4ll3FfF2aaEs_2ecsxIV644 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: f9cd4ebe3e544579b3b905bbed16647a Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesActionsTest-1769755260 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9cd4ebe3e544579b3b905bbed16647a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9cd4ebe3e544579b3b905bbed16647a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f9cd4ebe3e544579b3b905bbed16647a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f9cd4ebe3e544579b3b905bbed16647a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesActionsTest-1769755260 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: f9cd4ebe3e544579b3b905bbed16647a Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesActionsTest-1769755260 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesActionsTest-1769755260-project Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 5440df8e46804301a9d9d16ad6b1a3a9 Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesActionsTest-1769755260-project Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '70c58703-8f6a-4101-a07a-3a0f72a87ed4'} Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:19.931166 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] Returning 404 to user: Instance 70c58703-8f6a-4101-a07a-3a0f72a87ed4 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b6008d8-63f5-4da7-a944-970a5f0b6b6b tempest-VolumesActionsTest-1769755260 tempest-VolumesActionsTest-1769755260-project] 10.222.0.36 "GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4" status: 404 len: 111 microversion: 2.1 time: 0.100230 Oct 04 21:33:19.948637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2910/5721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:19 2022] GET /compute/v2.1/servers/70c58703-8f6a-4101-a07a-3a0f72a87ed4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:23.538637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:23.539604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:23.588749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.589864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.590530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:23.603151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.609933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.610870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:23.768109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-caa6a20d-350c-4483-a55b-77ce3383edfc tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/ips" status: 200 len: 149 microversion: 2.1 time: 0.239500 Oct 04 21:33:23.773308 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2812/5722] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:33:23 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/ips => generated 149 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:28.796522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e467f6f4-5cad-47e1-81ef-94c180c8acf0"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:28.805347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:28.841022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.842224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.843387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.845033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.846194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.847270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.115531 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bb60877-8624-4b3f-896d-cf01806b067f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.324216 Oct 04 21:33:30.115531 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2911/5723] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:33:28 2022] POST /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 194 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:36.794461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:36.813509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:36.827690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=5 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:36.837818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=23 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:36.868275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.875682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.876990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.878878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:36.881287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:36.882426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:36.973450 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d6bbeb72-09fb-43ba-8165-bf95308748d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action" status: 200 len: 24567 microversion: 2.1 time: 0.185384 Oct 04 21:33:36.978637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2813/5724] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:36 2022] POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action => generated 24567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:33:43.352614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:43.358212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:43.389503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:43.394498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:43.437012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.438556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.438556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:43.443349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:43.445506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:43.446178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:44.959481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcf7ab2e-bfca-4fc5-91a1-8e0bc54163e3 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1836 microversion: 2.1 time: 1.606099 Oct 04 21:33:44.961789 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2912/5725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:43 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1836 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:45.048049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:45.049327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:45.077998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.079206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.080162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.083120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:45.084418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:45.085596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:45.849858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:45.874913 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db414b98-ed00-4f90-a50d-fbedf3014cef tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1683 microversion: 2.1 time: 0.857321 Oct 04 21:33:45.877664 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2814/5726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:45 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1683 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:46.207089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:46.212576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:46.229506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.231121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.232908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.234744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.236532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.243763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.338011 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c1eb93a-373e-4b31-bdae-5a456eaab09d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action" status: 200 len: 32641 microversion: 2.1 time: 0.159027 Oct 04 21:33:46.341391 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2913/5727] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:46 2022] POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action => generated 32641 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:33:46.567994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:46.572211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:46.610713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.612232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.613917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.616968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:46.618467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:46.619705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:46.714054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a709fb0f8c64a50a1e05cc26fc3bbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6df54e3af2472c9892daeb07385c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:46.715498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] flavor_id is None. Assuming migration. {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:33:46.716328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:33:47.809418 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e50f1872-46a5-470d-a515-e80bc819a3cd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action" status: 202 len: 0 microversion: 2.1 time: 1.249352 Oct 04 21:33:47.811896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2815/5728] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:46 2022] POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action => generated 0 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:33:47.832288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:47.833906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:47.861865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.867643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.867643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:47.868884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:47.869734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:47.870653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:48.278777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:48.304595 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-516351ef-083f-4df4-8645-cf0870dc8ca9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1692 microversion: 2.1 time: 0.480748 Oct 04 21:33:48.308509 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2914/5729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:47 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1692 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:49.395157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:49.401023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:49.435253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.439597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.444151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.445253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:49.449725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:49.451758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:49.936876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:49.988273 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-36c65370-1cd7-47ab-b0f6-0336781396c9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1692 microversion: 2.1 time: 0.637626 Oct 04 21:33:49.989856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2816/5730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:49 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1692 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:51.041455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:51.043848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:51.060635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.062024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.063536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.065262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:51.067023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:51.068172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:51.408094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:51.438994 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85c47e92-542f-4d76-9b81-0a678ced0865 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1692 microversion: 2.1 time: 0.406662 Oct 04 21:33:51.440507 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2915/5731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:51 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1692 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:52.470052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:52.471106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:52.505607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.509367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.511106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:52.516161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:52.517328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:52.520468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:53.020587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:53.061032 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96ad8e3c-d1b2-49c2-ae32-2fe07c8a7cbc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1692 microversion: 2.1 time: 0.596401 Oct 04 21:33:53.064650 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2817/5732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:52 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1692 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:53.410255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe4a9dc9-ffc9-4003-97d6-b0a3340fb846 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: .version_select at 0x7f54f5579ca0>, body: {"keypair": {"name": "tempest-keypair-120643284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXS8SHBigEA6ny2Pyo0aPXoZiBX3M7PIngc+BVSfn3Svf1oRP+EXpXKQgpPkRzZJeIff44EqWD274zhimERVx/SxBlSELjJl1XnSv7pv+7MGi4WTa++GO0Q6UVgkqLjcA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:53.464130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fe4a9dc9-ffc9-4003-97d6-b0a3340fb846 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:53.476558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-fe4a9dc9-ffc9-4003-97d6-b0a3340fb846 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:53.639154 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe4a9dc9-ffc9-4003-97d6-b0a3340fb846 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.234653 Oct 04 21:33:53.640091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2916/5733] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:33:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:33:54.111143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:54.112050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:54.131388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:54.497068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:54.516298 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c0a199a-cbc5-4580-83ac-96ea6d6bc7b6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1692 microversion: 2.1 time: 0.409357 Oct 04 21:33:54.517755 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2818/5734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:54 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1692 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:55.587533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:55.588713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:55.604037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.604989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.605833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.607279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:55.608495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:55.609351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:55.875695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:55.888923 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92cc5f1e-df8f-4b16-a7f4-7ca79477fdae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.321717 Oct 04 21:33:55.890547 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2917/5735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:55 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:56.945674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:56.946872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:56.960329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.961013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.961539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:56.962481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:56.963240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:56.963762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:57.323450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:57.339884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-185a2a27-7e42-4ddd-aedf-ec6c4f3fed3f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.410827 Oct 04 21:33:57.344881 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2819/5736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:56 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:58.392378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:58.393240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:58.410141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.410709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.411695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:58.412630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:58.413115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:58.413571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:59.310444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:59.353219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d945c388-928b-46b1-b799-6cc80adcf299 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.965261 Oct 04 21:33:59.354920 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2918/5737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:58 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:00.395697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:00.396300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:00.414424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:00.415194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:00.415478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:00.422469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:00.436223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:00.437006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:00.635573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1931669471", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1"}], "security_groups": [{"name": "tempest-securitygroup--1518093893"}], "key_name": "tempest-keypair-120643284", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:00.886022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:00.903393 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9005bbe4-8ce4-4f18-88b4-453a3502206d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.507659 Oct 04 21:34:00.903393 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2820/5738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:00 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:01.111822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] validate_networks() for [('b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:34:01.948132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:01.950349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:01.974399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.976873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.977681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:01.981654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:01.982167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:01.984331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.663102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:02.681366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:34:02.683184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:34:02.684419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:34:02.686273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:34:02.687443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:34:02.705051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48d3f266-f023-4dc6-87f6-434473c33f25 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.764621 Oct 04 21:34:02.706876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2821/5739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:01 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:02.714200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.720795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.726796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.727818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:02.729301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:02.734162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:02.813843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:02.834088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:02.875807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:34:02.898766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:34:03.189916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f19715e1-2ba8-4742-b454-c95c753bd1c8 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.559771 Oct 04 21:34:03.196281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2919/5740] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:34:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:34:03.229807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-656a47ac-f55f-400b-aac2-377709aaf95d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:03.230760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-656a47ac-f55f-400b-aac2-377709aaf95d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:03.513955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-656a47ac-f55f-400b-aac2-377709aaf95d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:03.546522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-656a47ac-f55f-400b-aac2-377709aaf95d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1241 microversion: 2.1 time: 0.335928 Oct 04 21:34:03.573817 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2822/5741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:03 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1241 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:03.774300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:03.777567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:03.817558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.824658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.825502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:03.826569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:03.830799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:03.833090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:04.440827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.491063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-674e6acd-f6e1-4444-9f0f-c4c843ae7ed7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.726060 Oct 04 21:34:04.497454 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2920/5742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:03 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:04.587700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b1e7d2eb-78fd-4ff4-b5b3-42ab26da5380 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:04.588880 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b1e7d2eb-78fd-4ff4-b5b3-42ab26da5380 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:04.727483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b1e7d2eb-78fd-4ff4-b5b3-42ab26da5380 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:04.743426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b1e7d2eb-78fd-4ff4-b5b3-42ab26da5380 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1241 microversion: 2.1 time: 0.167707 Oct 04 21:34:04.745111 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2823/5743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:04 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:05.545450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:05.548266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:05.586225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.587141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.588207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.589838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.590919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.591926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.781375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:05.782554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:05.821905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.824044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.826686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.828184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:05.829363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:05.830275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:05.926942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:05.965213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef2cd71a-5e13-462a-861d-c50833766e74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.418960 Oct 04 21:34:05.976384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2921/5744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:05 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:06.039614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:06.071141 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08bef532-a5c5-4e9a-b55e-56406b5e4a55 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1245 microversion: 2.1 time: 0.295683 Oct 04 21:34:06.072870 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2824/5745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:05 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1245 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:07.003892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:07.016134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.028773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.030251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.031399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.033252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.035029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.036142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.116485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:07.124300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.138545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:07.141571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.142803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.144339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.145897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.149261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.150459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.344632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.371642 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4263c8da-4268-4640-bc23-14480194d313 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1293 microversion: 2.1 time: 0.262624 Oct 04 21:34:07.382420 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2825/5746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:07 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1293 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:07.606987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.631752 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89cff137-4a67-4211-86b3-2a7d837679fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1697 microversion: 2.1 time: 0.628221 Oct 04 21:34:07.699848 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2922/5747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:06 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1697 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:08.429965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:08.442207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:08.463525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.468867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.470562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.475285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.475285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.475285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.703453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:08.705670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:08.731637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.732560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.733373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.744078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.746650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.748601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.924844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:08.949370 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-64493894-8ea1-47a3-bebc-566dfbbf6849 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1311 microversion: 2.1 time: 0.529258 Oct 04 21:34:08.950929 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2826/5748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:08 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1311 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:09.181852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:09.203574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b31a805-2214-40d0-aa9a-f8a272ea7a80 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1696 microversion: 2.1 time: 0.516749 Oct 04 21:34:09.205245 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2923/5749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:08 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1696 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:10.001915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:10.003556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:10.041008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:10.043352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.043352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.043352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:10.043891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.044549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.246360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:10.247579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:10.309424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:10.309993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:10.311189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.312019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.313407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:10.314302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.331381 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-261f1107-75c7-4e39-be76-b384ba1f21b5 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1299 microversion: 2.1 time: 0.335629 Oct 04 21:34:10.335950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.345130 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2827/5750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:09 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1299 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:10.405014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "name": "network-vif-unplugged", "status": "completed", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:10.448265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:10.449355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:10.450195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.531961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Creating event network-vif-unplugged:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h1-851029-13 Oct 04 21:34:10.601597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:10.646998 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-021f6e8e-6498-4e74-9929-501d0a480867 req-b9552bf9-5796-4b8c-8273-d932d26526fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.299130 Oct 04 21:34:10.650075 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2828/5751] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:11.397142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:11.404904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:11.438250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.439654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.440727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.443087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.446316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.452614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.751335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.767055 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32762366-aec7-42ab-bc60-32c411e27e5b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1299 microversion: 2.1 time: 0.380198 Oct 04 21:34:11.774971 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2829/5752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:11 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1299 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:11.957372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.983859 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59ba58ec-2e58-444e-8323-2d8b532b57a5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1696 microversion: 2.1 time: 1.744938 Oct 04 21:34:11.987693 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2924/5753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:10 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1696 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:12.816143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:12.817145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:12.844450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.845371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.860589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.860589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.860589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.860589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.937810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:12.948813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:12.950372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:12.970455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.973100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.975911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.986398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:13.056280 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Creating event network-changed:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h1-851029-13 Oct 04 21:34:13.099329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:13.162312 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-10a48ebf-13e3-4e5a-a29d-af72af211c0e req-67815f5d-86d3-4e31-ade9-6da6a8ca3ab7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228821 Oct 04 21:34:13.166224 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2925/5754] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:13.210755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:13.211640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:13.248254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.266975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.269587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:13.300768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.301980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.302843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:13.345418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:13.381683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f37f38b1-5e4e-4464-8613-e31bbcd71de1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1299 microversion: 2.1 time: 0.571987 Oct 04 21:34:13.392316 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2830/5755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:12 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1299 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:14.021326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:14.034949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f1ab588-62f7-4711-bc5d-80e6325f09fa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1696 microversion: 2.1 time: 0.862940 Oct 04 21:34:14.036033 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2926/5756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:13 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1696 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:14.443597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:14.444955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:14.494512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:14.495594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:14.496438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:14.497891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:14.511243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:14.520853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:14.736099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:15.102033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:15.108176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:15.137012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:15.145795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.163594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.164574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:15.166039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.167392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.175940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:15.221186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:15.261599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=77 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:15.278722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ecb9deb-060d-486f-8fa1-8dcb83f01f81 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 0.843931 Oct 04 21:34:15.299219 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2831/5757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:14 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:15.880952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:15.904834 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8e56a0c-e85b-4ef5-99ca-073ff4f3c1c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1696 microversion: 2.1 time: 0.810969 Oct 04 21:34:15.907880 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2927/5758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:15 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1696 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:16.339578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:16.344269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:16.373954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:16.374921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:16.375784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:16.387805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:16.389256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:16.391269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:16.959437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:16.959437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:16.968060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:16.988583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:16.988583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:16.988583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:16.994167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:16.998323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:18.005085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.029257 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-64d952ad-95d5-4135-9205-27488b97c7ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 1.703308 Oct 04 21:34:18.051740 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2832/5759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:16 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:18.591660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.625559 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-967f8607-3e47-48b5-b006-3e5390e1b392 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1694 microversion: 2.1 time: 1.690384 Oct 04 21:34:18.640635 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2928/5760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:16 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1694 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:19.108006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:19.113005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:19.143692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e7a309-6bb7-499f-b7a5-ebab8d7c4851", "tag": "1155a478-35be-4c9e-bb39-22258c4ddd88"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:19.163898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.189191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.189459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.189805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.192498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.194203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.196190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.198577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.203595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.229794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] Creating event network-changed:1155a478-35be-4c9e-bb39-22258c4ddd88 for instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 on n-h1-851029-13 Oct 04 21:34:19.250558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-981edd13-6fa7-4993-b695-1562de9cb3e0 req-90e5e707-2677-4047-84ef-b9b845d149ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113925 Oct 04 21:34:19.253344 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2929/5761] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:19.699228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:19.702887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:19.790877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.800577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.810565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.817807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.821459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.822814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.466036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:20.483245 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c04bbe18-35ec-4180-99a5-5dcaf56ccb70 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 1.396189 Oct 04 21:34:20.504610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2833/5762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:19 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:20.678575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:20.692279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e964813-2476-4f7c-a043-28336aeacbfb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1691 microversion: 2.1 time: 1.009651 Oct 04 21:34:20.693811 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2930/5763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:19 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1691 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:20.726228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:20.727255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:20.734817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.735083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.735882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.737712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.738270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.738840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.173349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed202d83-e526-412e-8fb6-e7a46e1ed016 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action" status: 204 len: 0 microversion: 2.1 time: 0.453215 Oct 04 21:34:21.175678 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2834/5764] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:34:20 2022] POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:34:21.187754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:21.190241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:21.203552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.206243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.208718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.209970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.211720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.217449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.535953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:21.589432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:21.604769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.606256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.607638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.609157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:21.610249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:21.611317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.879675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.892146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c7c6fd7-8975-4136-ab58-a44b470c7c50 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1691 microversion: 2.1 time: 0.711113 Oct 04 21:34:21.907754 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2931/5765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:21 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1691 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:22.210274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.245841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0bdc8188-28b0-4401-a2b3-3d0b394c3a4b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 0.719890 Oct 04 21:34:22.247649 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2835/5766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:21 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:22.927766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.928932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.958378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.964008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.965990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.967875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.972333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.973593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.279600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.287078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:23.309735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.311360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.313908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.316293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.317557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.318809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.009491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.030185 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a386847b-dc55-4b1c-a91a-2d434b86b0e5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1691 microversion: 2.1 time: 1.110161 Oct 04 21:34:24.030913 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2932/5767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:22 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1691 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:24.795263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.866823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61a6818f-910f-477b-b342-3993231d228a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 1.586190 Oct 04 21:34:24.886823 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2836/5768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:25.085527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.086698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.126333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.127659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.128745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.135849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.136795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.137501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.515890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "name": "network-vif-plugged", "status": "completed", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:25.547990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.549428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.550297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.652934 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Creating event network-vif-plugged:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h1-851029-13 Oct 04 21:34:25.696132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:25.728330 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e6a3475a-2813-4109-908e-d09531d8da53 req-e2b11f1c-b341-49f7-a285-be46a7aedb69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244474 Oct 04 21:34:25.730595 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2837/5769] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:25.933377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.942280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.985180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.987441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.987441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.991397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.996509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.997863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.579777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:26.616968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de3cbb16-8ecc-4b21-b976-467604ee2774 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1691 microversion: 2.1 time: 1.535526 Oct 04 21:34:26.628677 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2933/5770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1691 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:26.753303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:26.769803 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81193360-a385-427e-914d-8a9dbe9e0a09 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 0.852392 Oct 04 21:34:26.771776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2838/5771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:27.682060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:27.688683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:27.723960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.726248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.727241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.735626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.739394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.740179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.815816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:27.818425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:27.832937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.834053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.835209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.836639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.837823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.839244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.221721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.234016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.245233 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2dc6177e-b674-4f6c-88d0-dcefdfcf10af tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 0.439785 Oct 04 21:34:28.279097 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2839/5772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:27 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:28.279314 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44a5a180-0893-4403-8dcf-47a6ae2e03ba tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1683 microversion: 2.1 time: 0.602637 Oct 04 21:34:28.280321 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2934/5773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:27 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1683 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:28.676737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e7a309-6bb7-499f-b7a5-ebab8d7c4851", "name": "network-vif-plugged", "status": "completed", "tag": "1155a478-35be-4c9e-bb39-22258c4ddd88"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:28.693692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.694560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.695285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.752411 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] Creating event network-vif-plugged:1155a478-35be-4c9e-bb39-22258c4ddd88 for instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 on n-h1-851029-13 Oct 04 21:34:28.765660 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0a3df034-0070-402c-bf1f-831ab135f621 req-b5e0874b-6fc1-4ea3-bbde-0c61547da9ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093170 Oct 04 21:34:28.768066 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2840/5774] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:29.291717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.292609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.307646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.308469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.308696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.313689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.317441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.319916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.750868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.788568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b152241-f9f4-452f-b58e-d0784b25f045 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1367 microversion: 2.1 time: 1.501788 Oct 04 21:34:30.790092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2935/5775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1367 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:31.843238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:31.849398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:31.881562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.883933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.885195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.893497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.897709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.899182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:32.929874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.965845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1cc6a953-f524-460d-8185-1342def95934 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1557 microversion: 2.1 time: 1.130865 Oct 04 21:34:32.968531 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2841/5776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:31 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1557 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:33.015450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.017308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.042930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.349052 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-415b19d5-04c4-4ad4-91f2-76416e3f37fb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.343050 Oct 04 21:34:33.349787 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2936/5777] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/os-interface => generated 284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:37.876977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e7a309-6bb7-499f-b7a5-ebab8d7c4851", "tag": "1155a478-35be-4c9e-bb39-22258c4ddd88"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:37.906859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.907762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.908481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.954227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] Creating event network-changed:1155a478-35be-4c9e-bb39-22258c4ddd88 for instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 on n-h1-851029-13 Oct 04 21:34:37.967740 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-66053c63-7170-4ddf-bded-f9a3cb18fdbc req-9312de35-3e04-47b5-8522-f25cd900787a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097038 Oct 04 21:34:37.975717 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2842/5778] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:52.639332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=19 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:52.641193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=53 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:52.657299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:52.661878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:52.691727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:52.693856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:52.696686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:52.702052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:52.703421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:52.706787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:52.835566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1400113d-a6c2-4e96-8309-04a287d32102 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action" status: 200 len: 24575 microversion: 2.1 time: 0.200462 Oct 04 21:34:52.836740 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2937/5779] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:34:52 2022] POST /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3/action => generated 24575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:35:09.226384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:09.232243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:09.246839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=35 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:09.263379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:09.314409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.315405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.316327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.317935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:09.318841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:09.319664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:09.702272 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57851465-0d7a-4216-a0a7-513f131dbf17 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1836 microversion: 2.1 time: 0.483668 Oct 04 21:35:09.721936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2843/5780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:09 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1836 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:12.391668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:12.392538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:12.420655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:12.444016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:12.445755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:12.449746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:12.451634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:12.453400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:12.457599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:12.459657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:12.492098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:12.494968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:12.495648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:12.560528 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] Creating event network-changed:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h1-851029-13 Oct 04 21:35:12.580427 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-eb20414f-4f69-4ab0-8939-88ddeb5082a6 req-ffd53bcc-d4b6-4609-8c8c-fc699bc3b7c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137273 Oct 04 21:35:12.583966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2844/5781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:12.615368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:35:13.227312 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73ca9d51-9ae5-443a-a23f-238f676b2e90 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 204 len: 0 microversion: 2.1 time: 0.841503 Oct 04 21:35:13.230360 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2938/5782] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:35:12 2022] DELETE /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:13.244517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:13.245750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:13.288158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:13.289369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:13.290335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:13.291805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:13.294181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:13.294935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:14.530372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:14.591845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4b7f7f1c-c42e-47b0-a73d-880ae23857a0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1689 microversion: 2.1 time: 1.346972 Oct 04 21:35:14.602520 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2845/5783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:13 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1689 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:15.651827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:15.655096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:15.669552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.670701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.672127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:15.673858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:15.675152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:15.676457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:16.457543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:16.481959 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-158b41d1-2c3e-45ec-9730-52dc91824db7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1689 microversion: 2.1 time: 0.836857 Oct 04 21:35:16.491967 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2939/5784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:15 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1689 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:17.164397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437da726-6086-4b5b-9fe6-69eb840e6cb3", "name": "network-vif-deleted", "tag": "145e6540-c70e-43bd-9e33-ce1c6c603a17"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:17.189268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:17.190174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:17.191618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:17.227431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] Creating event network-vif-deleted:145e6540-c70e-43bd-9e33-ce1c6c603a17 for instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 on n-h1-851029-13 Oct 04 21:35:17.248064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9aafbb84-bd57-4a7f-9c71-c628d3465a1d req-27b99878-6db7-4389-a2c6-7d1a761a5d02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088870 Oct 04 21:35:17.254507 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2846/5785] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:17.545467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:17.549990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:17.566288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:17.567680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:17.568747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:17.570576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:17.571691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:17.572874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:17.915282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:17.938364 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19fc367b-9231-42fb-8f7f-64684552618e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1351 microversion: 2.1 time: 0.415211 Oct 04 21:35:17.955277 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2940/5786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:17 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1351 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:18.994380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:18.999048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:19.026209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.032992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.033837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.035342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.040513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.042586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.141851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.142838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.143739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.145000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lazy-loading 'fault' on Instance uuid 437da726-6086-4b5b-9fe6-69eb840e6cb3 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:35:19.300041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:19.336246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8cba3bdf-3471-4af8-9645-20c25cb2c796 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 200 len: 1356 microversion: 2.1 time: 0.366263 Oct 04 21:35:19.337380 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2847/5787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:18 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 1356 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:20.383434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:20.384493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 437da726-6086-4b5b-9fe6-69eb840e6cb3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:20.402882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:20.403775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:20.404576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:20.405873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:20.407148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:20.407968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:20.432301 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] HTTP exception thrown: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Request method failure captured: Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 HTTP/1.1 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZVmI3T1VLzezIEF0m3sB9oiI1o_7H1a4LshFaP1jfNA3ZHLH6lyZGcafDeNgvfCX3Y6AnTkPcTs5gu0cYs_YsoQWmvJyUMnqCrWl6u-r4x83dGHptuJFGPiWtL5dpIh5no4Tsr4z5X6Z7y6p82bFX0CviBJmjkiPQSQWCx3S40T6Q Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 0be5e41e86e74c2485502f4da34aa3b0 Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '437da726-6086-4b5b-9fe6-69eb840e6cb3'} Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:20.438108 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. Oct 04 21:35:20.445768 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:20.449757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Returning 404 to user: Instance 437da726-6086-4b5b-9fe6-69eb840e6cb3 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:20.451436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-794b9b97-7514-48ca-8ab9-f7ec8b38a722 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3" status: 404 len: 111 microversion: 2.1 time: 0.075501 Oct 04 21:35:20.453691 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2941/5788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:20 2022] GET /compute/v2.1/servers/437da726-6086-4b5b-9fe6-69eb840e6cb3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:35:34.019536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75c46a54-7782-4ab3-9e6b-bdafd115f51a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '.version_select at 0x7f54fa56b5e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:34.043282 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-75c46a54-7782-4ab3-9e6b-bdafd115f51a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:35:34.056861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:34.057945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=24 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:35.070616 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-75c46a54-7782-4ab3-9e6b-bdafd115f51a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58930. Oct 04 21:35:35.288252 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75c46a54-7782-4ab3-9e6b-bdafd115f51a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-944519102" status: 202 len: 0 microversion: 2.1 time: 1.278016 Oct 04 21:35:35.305421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2848/5789] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 4 21:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-944519102 => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:35.357214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea26e60a-03fa-43e3-a87f-8084d964cf38 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: .version_select at 0x7f54f4d7baf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1087242951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMOpN+H+8ZhC5bwQYwYLz5m16sw/5wLjDgkWu3md5XUDWzDztoPdcl61lZ/O9SO5XzCUO5ymjG4jEYo5snB2vjTQf/9lvhMtGeGUwVYhzz2MBTvheVeUPt6KJz4N+wixw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:35.376443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:35.378070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:35.408443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-ea26e60a-03fa-43e3-a87f-8084d964cf38 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:35.420347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-ea26e60a-03fa-43e3-a87f-8084d964cf38 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:35.653604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea26e60a-03fa-43e3-a87f-8084d964cf38 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.304273 Oct 04 21:35:35.669459 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2942/5790] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:35:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:37.427289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:37.429166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.444721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.445998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.447560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.449694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.450945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.454114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.524567 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98880b24-4a33-49e3-8691-8643ea7489f4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/ips" status: 200 len: 149 microversion: 2.1 time: 0.104568 Oct 04 21:35:37.541290 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2849/5791] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:35:37 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/ips => generated 149 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:37.549456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e467f6f4-5cad-47e1-81ef-94c180c8acf0"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:37.563569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.594801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.595569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.596236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.597375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.598143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.598831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.828999 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/os-volume_attachments HTTP/1.1 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 74 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: {"volumeAttachment": {"volumeId": "e467f6f4-5cad-47e1-81ef-94c180c8acf0"}} Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': 'c6e7a309-6bb7-499f-b7a5-ebab8d7c4851', 'body': {'volumeAttachment': {'volumeId': 'e467f6f4-5cad-47e1-81ef-94c180c8acf0'}}} Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:37.832969 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 400 to user: Invalid volume: volume e467f6f4-5cad-47e1-81ef-94c180c8acf0 is already attached to instances: 3885b224-a1d5-4fbb-b05b-f318b25bf34a {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:37.843394 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8d260ea-4e35-4674-9e40-93968006c42a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.292622 Oct 04 21:35:37.854754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:37.855569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.859219 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2943/5792] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:35:37 2022] POST /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851/os-volume_attachments => generated 174 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:35:37.873932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.875429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.883328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.883328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.883328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.883328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.952664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:35:38.783541 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0aa74e7-c825-45f6-be76-e2a8f669c051 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 204 len: 0 microversion: 2.1 time: 0.938207 Oct 04 21:35:38.787305 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2850/5793] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:35:37 2022] DELETE /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:38.804665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:38.805471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:38.822711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:38.823036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:38.824739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:38.826555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:38.828330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:38.828859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:39.890438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:39.929004 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c334f97-f64c-4137-bc1d-5ab09c63ab33 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1681 microversion: 2.1 time: 1.133411 Oct 04 21:35:39.933723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2944/5794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:38 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1681 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:40.975025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.976505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:40.991543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.995636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.995636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.995636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.995636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.997105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.557142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:42.585689 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a587ec0-c2ab-4c94-b317-c9a4b5eed439 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1681 microversion: 2.1 time: 1.617743 Oct 04 21:35:42.589754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2851/5795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1681 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:43.291701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e7a309-6bb7-499f-b7a5-ebab8d7c4851", "name": "network-vif-deleted", "tag": "1155a478-35be-4c9e-bb39-22258c4ddd88"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:43.353690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.363749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.365314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.446022 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] Creating event network-vif-deleted:1155a478-35be-4c9e-bb39-22258c4ddd88 for instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 on n-h1-851029-13 Oct 04 21:35:43.482878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c58d162c-000e-4be8-996a-2106beaf28c2 req-6be39d59-adb6-4282-84ca-ef4baa706444 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182438 Oct 04 21:35:43.491876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2945/5796] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:43.632128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:43.633249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:43.705215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.706125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.728541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.736813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.740447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.741436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.903138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.911764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.914251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.915461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'fault' on Instance uuid c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:35:44.149874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:44.198978 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e50cd6f7-4c40-4fea-9eab-5de68d4f0643 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 200 len: 1331 microversion: 2.1 time: 0.576200 Oct 04 21:35:44.216086 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2852/5797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:43 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 1331 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:45.267021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:45.268852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:45.294653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.313100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.313726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.317157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.329437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.330001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.369604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 HTTP/1.1 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c6e7a309-6bb7-499f-b7a5-ebab8d7c4851'} Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:45.371835 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7cbfff26-cd7a-49b2-8904-955726ec6fd7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 404 len: 111 microversion: 2.1 time: 0.131271 Oct 04 21:35:45.399141 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2946/5798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:45 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:35:45.404904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85f15f26-0bd9-4741-94b0-a4d7b710b1bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '.version_select at 0x7f54f626f670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:45.598270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85f15f26-0bd9-4741-94b0-a4d7b710b1bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120643284" status: 202 len: 0 microversion: 2.1 time: 0.216886 Oct 04 21:35:45.600668 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2853/5799] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 21:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120643284 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:35:49.506980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:49.507825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:49.518386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:49.547659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.553780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.554336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.555214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.555698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.556135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.771932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'services' on Instance uuid 3885b224-a1d5-4fbb-b05b-f318b25bf34a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:35:50.177992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3768f7b8-f828-4ce4-aca9-b90292f7dc8d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments/e467f6f4-5cad-47e1-81ef-94c180c8acf0" status: 202 len: 0 microversion: 2.1 time: 0.677772 Oct 04 21:35:50.197406 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2947/5800] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:35:49 2022] DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments/e467f6f4-5cad-47e1-81ef-94c180c8acf0 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:50.210152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:50.218350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:50.261920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.273820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.274851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.276563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.277765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.279222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.402791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6aea7826-a554-4641-9075-960e8f9123b0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199500 Oct 04 21:35:50.403577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2854/5801] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:50 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:51.424567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:51.431543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:51.447805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.449330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.457711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.471794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.473287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.474436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.605627 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22ae54a7-7797-4cb0-8a8f-518de294cb28 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191815 Oct 04 21:35:51.607869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2948/5802] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:51 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:52.630161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:52.639166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:52.680567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.686507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.687383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.698912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.698912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.709968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.921522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1100c6e7-53c9-4500-9ffd-140732a92e31 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233312 Oct 04 21:35:52.921522 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2855/5803] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:52 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:53.943328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:53.957943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:53.977786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.980026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.991582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.993201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.994210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.995173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.093783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6446dab4-a877-46fc-8b29-87b9b91e6f1c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167421 Oct 04 21:35:54.109961 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2949/5804] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:53 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:55.120805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:55.126830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:55.156139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.159084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.163630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.163630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:55.163630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:55.172713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.285961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2590ac80-5730-4e86-9258-5bd7d0e135d6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170818 Oct 04 21:35:55.287408 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2856/5805] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:55 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:56.308385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.314433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.353069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.398344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12d58a8d-9c68-4b17-ac83-ad6b2587cf1a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097948 Oct 04 21:35:56.400015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2950/5806] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:57.432545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:57.445874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:57.475379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.476539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.478631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.480435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.481772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.484009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.602063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08ca74c2-8274-461e-816f-1a8117dcb5e4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189784 Oct 04 21:35:57.603058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2857/5807] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:57 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:58.619372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:58.624466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:58.679980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.703098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.741027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.741027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:58.741027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:58.741027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:58.800529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75ce1761-d086-49fd-aea9-f175c2edc818 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186145 Oct 04 21:35:58.804449 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2951/5808] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:58 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:59.821256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:59.824115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:59.845750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.846634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:59.847439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:59.848789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:59.849580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:59.850239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:59.974011 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2616e2c-fea1-4cd8-bb72-fe05fccf5f12 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154929 Oct 04 21:36:00.006409 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2858/5809] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:35:59 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:01.021013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:01.033039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:01.053550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.054975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.056193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.057684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:01.058695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:01.059538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:01.147199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-851500b2-e968-492e-bfaa-05aba74a5e93 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144547 Oct 04 21:36:01.148507 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2952/5810] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:00 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:02.209523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:02.218240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:02.274437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:02.277712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:02.281009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:02.294635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:02.295271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:02.295853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:02.385607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8697a01b-0008-4c55-b757-98ab72aa05f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209784 Oct 04 21:36:02.387684 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2859/5811] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:02 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:03.132445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-580508640", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "433c632f-d8bb-4fb4-8ba9-c45a017e0475"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1087242951", "security_groups": [{"name": "tempest-secgroup-smoke-698309614"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:03.406231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:03.412826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:03.424284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] validate_networks() for [('433c632f-d8bb-4fb4-8ba9-c45a017e0475', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:36:03.463388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:03.464614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:03.465745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:03.468034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:03.471949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:03.473151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:03.603045 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5537ae74-0757-458e-9977-422f772e27ff tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205335 Oct 04 21:36:03.604829 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2860/5812] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:03 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:04.626143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:04.644190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:04.668022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:04.682633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:04.684598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:04.687102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:04.690080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:04.691597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:04.701625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:04.786935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:04.837280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2dcb77c6-6414-428b-862c-4ed616d47099 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220409 Oct 04 21:36:04.839376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2861/5813] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:04 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:05.119428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:36:05.120297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:36:05.120458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:36:05.121450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:36:05.123897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:36:05.156177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:05.157312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:05.158900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:05.160797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:05.162099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:05.163380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:05.259454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:36:05.279224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:36:05.329015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:36:05.337081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:36:05.631333 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f085f2fc-5b20-4541-892b-5256fca8d958 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.502857 Oct 04 21:36:05.633847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2953/5814] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:36:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:36:05.650964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-348f9d71-58a8-4e68-952f-0dd78cc6b5b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:05.654407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-348f9d71-58a8-4e68-952f-0dd78cc6b5b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:05.806097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-348f9d71-58a8-4e68-952f-0dd78cc6b5b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:05.816000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-348f9d71-58a8-4e68-952f-0dd78cc6b5b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1266 microversion: 2.1 time: 0.170501 Oct 04 21:36:05.817414 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2862/5815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:05 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:05.860550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:05.865523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:05.876224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:05.876703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:05.877296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:05.878392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:05.879133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:05.879926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:05.943076 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-259e588e-26e1-4299-9580-0f292a2946b6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091612 Oct 04 21:36:05.956247 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2954/5816] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:36:05 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:36:06.309713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:06.311471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:06.327306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:06.336008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:06.336008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:06.336008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:06.336008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:06.336008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:06.442226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:36:06.870348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a140832f-449b-4990-b401-c4c7c1bdef4c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:06.871773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a140832f-449b-4990-b401-c4c7c1bdef4c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:07.022754 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd2f5c63-ce07-4d8b-a063-9a0f81b02a6a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 204 len: 0 microversion: 2.1 time: 0.720136 Oct 04 21:36:07.024436 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2863/5817] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:36:06 2022] DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:36:07.041546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:07.044082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:07.070626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:07.073003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:07.074083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:07.078165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:07.080306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:07.087734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:07.133590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a140832f-449b-4990-b401-c4c7c1bdef4c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:07.167691 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a140832f-449b-4990-b401-c4c7c1bdef4c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1266 microversion: 2.1 time: 0.302953 Oct 04 21:36:07.172505 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2955/5818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:06 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:07.494482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:07.511561 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d4652e9-86a5-4521-85df-99241e19af5d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1680 microversion: 2.1 time: 0.480010 Oct 04 21:36:07.520847 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2864/5819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:07 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1680 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:08.249583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-248fc138-8efe-46d6-ba3e-5d3971652931 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:08.251315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-248fc138-8efe-46d6-ba3e-5d3971652931 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:08.257646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:08.465268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-248fc138-8efe-46d6-ba3e-5d3971652931 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:08.487550 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-248fc138-8efe-46d6-ba3e-5d3971652931 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1266 microversion: 2.1 time: 0.268776 Oct 04 21:36:08.502452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2956/5820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:08 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:08.595519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:08.597639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:08.635151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:08.644209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:08.644209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:08.644209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:08.644209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:08.644209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:09.271681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:09.294937 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f3519d3-4819-4925-896c-b68ad931fca9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1680 microversion: 2.1 time: 0.733437 Oct 04 21:36:09.306279 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2865/5821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:08 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1680 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:09.537764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:09.546869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:09.573114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:09.574471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:09.580277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:09.581871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:09.586726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:09.590306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:09.601912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:10.125698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:10.156125 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82ed6d5e-78cb-4b8e-9274-1f0e07d86dbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1262 microversion: 2.1 time: 0.623473 Oct 04 21:36:10.162395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2957/5822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:09 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1262 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:10.354350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:10.355820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:10.399851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:10.401182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:10.407126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:10.409192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:10.416523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:10.425311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:10.971907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:10.996953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aad5490c-202b-4f51-84fc-7e12802ea3b1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1680 microversion: 2.1 time: 0.647042 Oct 04 21:36:11.027320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2866/5823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:10 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1680 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:11.196233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:11.196874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:11.214594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:11.221048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:11.225698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:11.228563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:11.229545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:11.230686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:11.520815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:11.542373 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8122c12a-6691-4a64-b56e-5429f03be781 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1326 microversion: 2.1 time: 0.351280 Oct 04 21:36:11.552978 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2958/5824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:11 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1326 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:12.071234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:12.078799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.094824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.295902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:12.309693 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c08c8ff7-249d-49a7-bd46-f4db22009bda tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1613 microversion: 2.1 time: 0.249285 Oct 04 21:36:12.324678 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2867/5825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:12 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1613 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:12.484080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3885b224-a1d5-4fbb-b05b-f318b25bf34a", "name": "network-vif-deleted", "tag": "5eaa60c7-eb7f-405e-9454-e9491ca6fe93"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:12.561784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.563260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.585433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:12.586959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:12.588921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.605686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.606994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.607781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.611371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:12.613149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:12.613922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:12.638514 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] Creating event network-vif-deleted:5eaa60c7-eb7f-405e-9454-e9491ca6fe93 for instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a on n-h2-851029-13 Oct 04 21:36:12.655021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-03b72044-9199-4cd9-ae5f-96b8962b9099 req-94d149ae-3162-42d7-8bc5-b8b8a41dc6e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181735 Oct 04 21:36:12.656344 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2959/5826] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:12.804419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:12.847790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4192d46-b14a-4ddf-97a8-380f5ecd7c13 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1324 microversion: 2.1 time: 0.267876 Oct 04 21:36:12.866641 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2868/5827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:12 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:13.344817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:13.356495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:13.374944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:13.386251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:13.387597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:13.389834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:13.391066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:13.392265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:13.563270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:13.565211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:13.568474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:13.569630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'fault' on Instance uuid 3885b224-a1d5-4fbb-b05b-f318b25bf34a {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:36:13.829810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:13.875020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a845a83-a0a2-45e2-a3a8-3398b65086a9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 200 len: 1331 microversion: 2.1 time: 0.538130 Oct 04 21:36:13.876056 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2960/5828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:13 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 1331 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:13.904393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:13.905860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:13.927568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:13.928924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:13.930572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:13.933531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:13.935683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:13.936899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:14.308011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:14.334972 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f62b492-3099-4d24-ab27-cfcbfc432755 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.436730 Oct 04 21:36:14.338834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2869/5829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:13 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:14.930649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:14.931773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:14.977253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:14.980557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:14.980557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:14.989425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:14.996708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:14.998722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:15.097299 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a HTTP/1.1 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3885b224-a1d5-4fbb-b05b-f318b25bf34a'} Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:36:15.101675 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:36:15.112912 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:36:15.124565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:36:15.124565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bb66968-653c-4792-a1a3-d13b41740ba9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 404 len: 111 microversion: 2.1 time: 0.199049 Oct 04 21:36:15.159129 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2961/5830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:14 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:36:15.172958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66c17678-5f7a-4e99-93ce-04ccb606e05e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '.version_select at 0x7f54fa5a05e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:15.314194 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66c17678-5f7a-4e99-93ce-04ccb606e05e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106209014" status: 202 len: 0 microversion: 2.1 time: 0.149494 Oct 04 21:36:15.320975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2870/5831] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 21:36:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106209014 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:15.380288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:15.384204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:15.412239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:15.425562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:15.428883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:15.429797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:15.431154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:15.431986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:15.432736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:15.968244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:15.991719 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d91162d-7dcd-4693-8858-ac00956731a6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.621770 Oct 04 21:36:15.993671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2962/5832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:15 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:17.029493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:17.030692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:17.064933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:17.071547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:17.072533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:17.073267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:17.074247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:17.075014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:17.076295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:17.353928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:17.367875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:17.368427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:17.368909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:17.389525 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] Creating event network-changed:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:36:17.402870 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5150fe9f-182e-4d7f-b47c-197af101ffa0 req-2594d2c0-fe9f-45e7-b5b3-7e163c683ba3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047316 Oct 04 21:36:17.402870 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2963/5833] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:17.456952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:17.473569 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4548778-8ef4-4896-8be3-40edb396f4f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.452997 Oct 04 21:36:17.482408 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2871/5834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:17 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:17.635733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-195ab443-5868-4bf9-80c5-3063ba8b51be tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: .version_select at 0x7f54f5f064c0>, body: {"keypair": {"name": "tempest-keypair-543073866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDk895OJLYCmSbVU13/gbZqd4qLorTMg/TfsS81FbGJQbHn2EkIAEfHYBI4ciluLt81s1br98FdrFKQb5Un8nfleVy2UBZSCthHjlExgxdJXQcqa3A8Vmq0ZaIjGi7AKA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:17.660035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-195ab443-5868-4bf9-80c5-3063ba8b51be tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:36:17.678153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-195ab443-5868-4bf9-80c5-3063ba8b51be tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:36:17.916847 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-195ab443-5868-4bf9-80c5-3063ba8b51be tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.286341 Oct 04 21:36:17.918381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2964/5835] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:36:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:18.534527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:18.538055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:18.556950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:18.564426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:18.564426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:18.564426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:18.564426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:18.564426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:19.107426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:19.107426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16f25d27-5c58-4205-b9df-c4933b91c93a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.546023 Oct 04 21:36:19.107426 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2872/5836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:18 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:20.109041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:20.111067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:20.125066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:20.125927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:20.130028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:20.135015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:20.135015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:20.135015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:20.521458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:20.551992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1540638-3bc3-47ae-a4aa-a87b289c6699 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.447377 Oct 04 21:36:20.559949 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2965/5837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:20 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:21.620927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:21.621773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:21.631852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:21.632065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:21.632811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:21.633637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:21.634109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:21.634546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:21.993264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:22.008422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d463a2f-3774-421d-ac36-6dda7831bada tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.398470 Oct 04 21:36:22.009499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2873/5838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:21 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:23.052704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:23.053712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:23.062857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.063464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.063920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:23.064724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:23.065210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:23.065655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:23.426428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:23.446042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad683edb-f90b-45e2-9ffc-7aa52862474b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.397619 Oct 04 21:36:23.465539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2966/5839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:23 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:23.485598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1135786985", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1"}], "security_groups": [{"name": "tempest-securitygroup--1675883691"}], "key_name": "tempest-keypair-543073866", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:23.744486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] validate_networks() for [('b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:36:24.499818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:24.500743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:24.527193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:36:24.528594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:36:24.530145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:36:24.531126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:36:24.532751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:36:24.546195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.547009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.547985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.549070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.549882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.550687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.562098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.563068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.564083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.571983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:24.573356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:24.574355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:24.627224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:36:24.650873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:36:24.692027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:36:24.696917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:36:24.767209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:24.782866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86fd3f4b-d0ed-4a44-82d9-44a9fd0ab4bb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.289526 Oct 04 21:36:24.784384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2967/5840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:24 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:24.895099 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8ad10f9-89d5-4cbb-9901-d65e09caf876 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.446584 Oct 04 21:36:24.895715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2874/5841] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:36:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:36:24.911275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59c2ac6a-07b0-4ea3-82ec-4781738767bd tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:24.912270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59c2ac6a-07b0-4ea3-82ec-4781738767bd tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:25.005369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-59c2ac6a-07b0-4ea3-82ec-4781738767bd tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:25.019924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59c2ac6a-07b0-4ea3-82ec-4781738767bd tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1241 microversion: 2.1 time: 0.115220 Oct 04 21:36:25.021757 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2968/5842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:24 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:25.348560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-plugged", "status": "completed", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:25.380547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.383243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.384491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.412151 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] Creating event network-vif-plugged:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:36:25.425390 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-32789913-8f02-4a96-a284-2b7718130ee3 req-b3a91518-2c29-4c6a-b7b5-a8953c4d11d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346206 Oct 04 21:36:25.427775 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2875/5843] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:25.812843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:25.814394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:25.846219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.846584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.847363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:25.849908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:25.850503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:25.851048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:26.048020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2a5807d-c3e5-4a2e-9243-2281a1dc846f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:26.048819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2a5807d-c3e5-4a2e-9243-2281a1dc846f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:26.212327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:26.225311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdcfe944-dfc3-4659-942b-4b880f74c423 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.420098 Oct 04 21:36:26.231841 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2969/5844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:25 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:26.277193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2a5807d-c3e5-4a2e-9243-2281a1dc846f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:26.304212 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2a5807d-c3e5-4a2e-9243-2281a1dc846f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1241 microversion: 2.1 time: 0.253723 Oct 04 21:36:26.306022 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2876/5845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:26 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:27.257092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:27.257875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:27.269668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:27.270714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:27.271954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.273183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:27.274343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:27.275418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:27.336167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08cd9881-c057-4f72-8bd6-d2207f7857c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:27.339357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08cd9881-c057-4f72-8bd6-d2207f7857c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:27.459392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08cd9881-c057-4f72-8bd6-d2207f7857c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.514565 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08cd9881-c057-4f72-8bd6-d2207f7857c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1241 microversion: 2.1 time: 0.183357 Oct 04 21:36:27.516669 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2877/5846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:27 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:27.584185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:27.594381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b03a00d-f452-44e7-b819-a10dde28bb6a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1391 microversion: 2.1 time: 0.341855 Oct 04 21:36:27.595495 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2970/5847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:27 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:28.541487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.542260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.551418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.551962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.552418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.553240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.561620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.562079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.626631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:28.644547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:28.682555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.683317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.684913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.686138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:28.686745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:28.687266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:28.744226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:28.762988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c2ede48-34bb-4171-a4d8-aa189a9d854b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1245 microversion: 2.1 time: 0.223802 Oct 04 21:36:28.779648 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2878/5848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:28 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1245 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:28.978925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:28.989391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47d64970-cbad-4c92-8506-d09ebc101cec tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1562 microversion: 2.1 time: 0.369735 Oct 04 21:36:28.991866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2971/5849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:28 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1562 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:29.023238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:29.024547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:29.040447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.041570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.042411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.055688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.055688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.055688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.435694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:29.458358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-44e1b02a-dca4-4d3f-bf7d-1fe696a237f4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1562 microversion: 2.1 time: 0.443318 Oct 04 21:36:29.462720 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2879/5850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:29 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1562 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:29.802843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:29.804065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:29.817640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.818316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.818939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.820270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:29.820854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:29.821564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:29.935009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:29.964445 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2e0706b-16e1-45a3-963f-da1e5367625b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1237 microversion: 2.1 time: 0.168727 Oct 04 21:36:29.965230 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2972/5851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:29 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:31.016849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:31.017712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:31.063256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.064321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.064901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.065873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:31.066587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:31.067200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:31.204909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:31.230930 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f462327-e000-4fad-ac8c-d020585ad5a4 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1293 microversion: 2.1 time: 0.222216 Oct 04 21:36:31.232069 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2880/5852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:31 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:32.261564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:32.264182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:32.279910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.281090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.282145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.283774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.284948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.286054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.566359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.589779 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc208096-40b6-4724-9568-b7007ef0924c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1311 microversion: 2.1 time: 0.335514 Oct 04 21:36:32.591848 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2973/5853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:32 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:33.657003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:33.660026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:33.674766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.676040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.677111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:33.678765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.680162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.681299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:33.718708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:34.421854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:34.435802 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6bb06473-21b5-4d01-ac68-777b415268c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.815157 Oct 04 21:36:34.476411 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2881/5854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:33 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:35.214960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:35.232873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:35.234200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:35.235383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:35.266834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.267630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.269740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.270702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.274117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.274876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.749621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:35.769672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.770266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.770756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.775633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.786781 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] Creating event network-changed:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:36:35.794218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-097603ef-fbac-4dea-9b07-c3a659da1f7d req-a90591f8-3799-4f99-af5e-1b0032ee9f8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.567980 Oct 04 21:36:35.804012 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2882/5855] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:35.818715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:35.821289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:35.835383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3202e37-4fd0-4b87-9142-3aec54179328 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1562 microversion: 2.1 time: 0.614836 Oct 04 21:36:35.841879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.842470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2974/5856] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:35 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1562 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:35.843756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.844734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.846246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.847447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.848372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.357191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:36.407863 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f38027d0-7cfc-447b-b5c2-1b8fbeec5c61 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.601063 Oct 04 21:36:36.414903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2883/5857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:35 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:36.836757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d8ccd8-a11b-4861-bac1-df719210648f", "tag": "25830a68-d430-4d52-8e58-93d4946e9ff4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:36.898879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.909725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.912559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.952244 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] Creating event network-changed:25830a68-d430-4d52-8e58-93d4946e9ff4 for instance 17d8ccd8-a11b-4861-bac1-df719210648f on n-h2-851029-13 Oct 04 21:36:37.001813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-71823cd2-aee0-40eb-bf41-c354b18594e2 req-aeabfb2e-a7fa-4a7a-a484-42201a05b9f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164835 Oct 04 21:36:37.003625 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2975/5858] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:37.628591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:37.630073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:37.635526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:37.638411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:37.664207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.666439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.671929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.674729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.675953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.677907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.039817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:38.084717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05a3bf10-6054-4a3b-aac1-3ca1346cc3f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.460387 Oct 04 21:36:38.125333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2884/5859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:37 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:39.141879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.159325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.186813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.187663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.188921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.191580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.193466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.194292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.632784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.650986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-585625fb-dc07-407e-a8cf-999878f16899 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.521340 Oct 04 21:36:39.652194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2976/5860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:39 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:40.703841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:40.705491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:40.714949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.715945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.716666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.717585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:40.718212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:40.718822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:40.952416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:40.966314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-190f1b46-10bb-40dd-bc8a-9b36f82046ad tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.267218 Oct 04 21:36:40.967413 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2885/5861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:40 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:41.993773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:41.994424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:41.998248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:42.004011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.009732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.009732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.009732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.009732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.009732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.019301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=94 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:42.373199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.395593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2697f65-5449-430e-aad9-4fb17ea2aa9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.406951 Oct 04 21:36:42.396798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2977/5862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:41 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:43.435463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:43.436190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:43.452694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.453184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.453634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.454447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.455870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.456397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.837610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.853563 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-882e21f0-9fbf-4b11-8859-dfd1bb57c665 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.423393 Oct 04 21:36:43.854647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2886/5863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:43 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:44.305217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d8ccd8-a11b-4861-bac1-df719210648f", "name": "network-vif-plugged", "status": "completed", "tag": "25830a68-d430-4d52-8e58-93d4946e9ff4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:44.346298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.352378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.353664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.428263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] Creating event network-vif-plugged:25830a68-d430-4d52-8e58-93d4946e9ff4 for instance 17d8ccd8-a11b-4861-bac1-df719210648f on n-h2-851029-13 Oct 04 21:36:44.441258 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ff198c82-cfdc-450b-a631-77cca414a0b1 req-39228bc8-8f1b-48f9-aa85-cb5de28dfc7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146508 Oct 04 21:36:44.443543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2978/5864] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:36:44.889655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:44.903124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:44.912816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.913407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.913927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.914965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.915578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.916223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.128179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.160490 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15d2ce1a-9280-48e8-b6fe-b5a1c221fb36 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1367 microversion: 2.1 time: 0.270135 Oct 04 21:36:45.161249 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2887/5865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:44 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:46.194249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.196861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.209515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.211027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.212294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.214032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.215779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.225205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.503419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:46.522016 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-322bdba0-4a83-43d0-a59c-d7124c0b9f19 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1557 microversion: 2.1 time: 0.332863 Oct 04 21:36:46.522016 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2979/5866] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1557 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:46.561132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.568493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.591173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.591830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.592375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.593336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.593862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.594487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.760635 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18ed6dd7-8ca5-4cdd-bf33-d43e18973c57 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217168 Oct 04 21:36:46.761316 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2888/5867] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:48.955615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d8ccd8-a11b-4861-bac1-df719210648f", "tag": "25830a68-d430-4d52-8e58-93d4946e9ff4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:48.979988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:48.981983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:48.983155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.010017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] Creating event network-changed:25830a68-d430-4d52-8e58-93d4946e9ff4 for instance 17d8ccd8-a11b-4861-bac1-df719210648f on n-h2-851029-13 Oct 04 21:36:49.041107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-63920fdd-f3b6-4e49-8b50-5ae0107c0e03 req-c5b509db-6828-4f0a-912a-6e4fc1358c64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092475 Oct 04 21:36:49.045753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2980/5868] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:01.470651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=9 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:01.472378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=39 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:01.479312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-831964328", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "62a9e7a4-4d33-4126-9af0-e334240bb5ad"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:01.618310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] validate_networks() for [('62a9e7a4-4d33-4126-9af0-e334240bb5ad', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:37:01.764577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:01.768013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:01.774406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=7 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:01.778574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:01.799531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.800443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.800911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.801802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.802286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.802787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.889597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44586c07-ec36-4442-bfe4-a3129ece42cb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action" status: 200 len: 24564 microversion: 2.1 time: 0.130271 Oct 04 21:37:01.897890 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2981/5869] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:37:01 2022] POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action => generated 24564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:37:02.334894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:37:02.335489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:37:02.336091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:37:02.336737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:37:02.337259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:37:02.349486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.349986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.350709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.351666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.352133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.352567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.374149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Getting quotas for project 8c685594ac0d4a8ebeea7eca8a2f44d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:02.381433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Getting quotas for user 2c70b49f7b2f4cc99c48bcd8df2edf69 and project 8c685594ac0d4a8ebeea7eca8a2f44d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:02.398398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:37:02.400998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:37:02.583684 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f5b223b-ff34-4654-a7fe-340b7f56fec5 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115932 Oct 04 21:37:02.593362 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2889/5870] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:37:02.617052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c766ceb6-492f-4e24-920e-5d6f7b318088 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.620734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c766ceb6-492f-4e24-920e-5d6f7b318088 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.701572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c766ceb6-492f-4e24-920e-5d6f7b318088 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:02.710354 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c766ceb6-492f-4e24-920e-5d6f7b318088 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1213 microversion: 2.1 time: 0.111221 Oct 04 21:37:02.710993 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2982/5871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:03.744353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b3277b4-c1b8-4a94-997b-975e1b935eaa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:03.747772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b3277b4-c1b8-4a94-997b-975e1b935eaa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:03.855649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b3277b4-c1b8-4a94-997b-975e1b935eaa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.863148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b3277b4-c1b8-4a94-997b-975e1b935eaa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1213 microversion: 2.1 time: 0.129768 Oct 04 21:37:03.864183 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2890/5872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:03 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:04.908783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:04.910281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:04.924903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.925639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.926212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.927221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.927814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.928354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:05.005428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:05.017435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b77e942d-e5f5-46f1-b952-fda6ed40473f tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1217 microversion: 2.1 time: 0.116779 Oct 04 21:37:05.018273 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2983/5873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:04 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:06.044895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:06.045731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:06.055144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.055795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.056555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.058883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.059713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.060218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.144322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:06.155778 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51530829-4b6e-4921-a273-22f6d6977623 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1265 microversion: 2.1 time: 0.115385 Oct 04 21:37:06.156776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2891/5874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:06 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:07.191522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:07.192765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:07.205848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:07.206796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:07.207589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:07.208926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:07.209774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:07.210630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:07.343519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:07.359150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18c4debf-f6aa-4072-a637-747e2d99c0c0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1271 microversion: 2.1 time: 0.176124 Oct 04 21:37:07.374417 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2984/5875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:07 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:08.393496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:08.397152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:08.409432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:08.414105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:08.415578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.423193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:08.424567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:08.428548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.699276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:08.711788 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4bf94f11-417c-49cc-9852-f29bde7014e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.327155 Oct 04 21:37:08.713072 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2892/5876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:08 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:09.036054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc02e5b-3460-4b26-921f-d875a3e7f738", "tag": "42a144d5-1f92-4f40-8223-81664d89a6b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:09.048771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.049275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.049703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.069169 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] Creating event network-changed:42a144d5-1f92-4f40-8223-81664d89a6b5 for instance fbc02e5b-3460-4b26-921f-d875a3e7f738 on n-h2-851029-13 Oct 04 21:37:09.071676 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e728227a-76a6-4d55-a8b5-3199963496e5 req-10d2c889-0de0-4264-b35f-d57997a02a89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038776 Oct 04 21:37:09.072851 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2985/5877] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:09.755616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:09.756780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:09.771376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.772508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.773333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.774860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.775765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.777107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:10.075744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:10.092552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c508438-fbfb-4691-af27-5b97ff6375e3 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.345090 Oct 04 21:37:10.093987 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2893/5878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:09 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:11.128790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:11.130000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:11.141887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:11.142458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:11.143201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:11.144136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:11.144903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:11.145131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:11.364838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:11.374908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c9fd18d9-48e2-4e05-b13e-64d93819e882 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.254087 Oct 04 21:37:11.375833 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2986/5879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:11 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:12.405111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:12.406189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:12.411563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:12.421836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.430102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.430102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:12.430102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.430102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.430102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:12.605521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:12.619868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3e0b9d60-58e6-4d6e-b6af-9e6395b30e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.223222 Oct 04 21:37:12.620678 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2894/5880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:12 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:13.645637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:13.646468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:13.649348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:13.655640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.656114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.656589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.657429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:13.657926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:13.658362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.930932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:13.947968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c5f3e89-6857-4e7a-aefc-ec24769ec44b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.306221 Oct 04 21:37:13.961128 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2987/5881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:13 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:14.993474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:14.994380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:14.999694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:15.007253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:15.008027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:15.008864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:15.009936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:15.010690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:15.011389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:15.257472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:15.271325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a0680f7-c5fb-45d1-b910-ae523e6edaba tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.282111 Oct 04 21:37:15.272417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2895/5882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:14 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:16.278257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc02e5b-3460-4b26-921f-d875a3e7f738", "name": "network-vif-plugged", "status": "completed", "tag": "42a144d5-1f92-4f40-8223-81664d89a6b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:16.297142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.298058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.298727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.299477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:16.300371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:16.308732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.309586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.310227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.311039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.311811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.312327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.316999 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] Creating event network-vif-plugged:42a144d5-1f92-4f40-8223-81664d89a6b5 for instance fbc02e5b-3460-4b26-921f-d875a3e7f738 on n-h2-851029-13 Oct 04 21:37:16.323630 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fe3143b8-ee2d-4642-9cd7-4d112b25c790 req-10faa7a2-9484-4623-8bae-5d5d3fd10a52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054217 Oct 04 21:37:16.324282 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2988/5883] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:16.576931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:16.576931 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ac61cfd-7359-4a94-b15b-cd99886a9df9 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.230334 Oct 04 21:37:16.576931 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2896/5884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:16 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:17.595934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:17.597843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:17.611562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:17.612444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:17.613369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:17.614542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:17.625052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:17.630568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:17.976278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:17.996167 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d223cbe3-d053-4fdc-b087-b374f4dbb8fc tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1313 microversion: 2.1 time: 0.405890 Oct 04 21:37:18.014866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2989/5885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:17 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:19.042571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:19.048444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:19.055585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:19.056086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:19.056791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:19.057624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:19.058143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:19.058581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:19.269922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:19.280156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22cb31e5-7145-4ce1-aa77-39fb444c7e45 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1496 microversion: 2.1 time: 0.243559 Oct 04 21:37:19.280950 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2897/5886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:19 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1496 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:20.505032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:20.505998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:20.520327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.521252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.522074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:20.523376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:20.524553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:20.525312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:20.574778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:37:21.092909 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f833676-1d1f-4be6-bb61-80ee433124b8 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 204 len: 0 microversion: 2.1 time: 0.595016 Oct 04 21:37:21.094070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2990/5887] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:20 2022] DELETE /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:37:21.108969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:21.110219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:21.123638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:21.124528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:21.125284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:21.126602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:21.127462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:21.128221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:21.328766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:21.343676 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc0ae65a-5246-47b9-adcf-1ffe54a97f8d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1502 microversion: 2.1 time: 0.241939 Oct 04 21:37:21.344626 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2898/5888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:21 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:22.371013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:22.372896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:22.382438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.382977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.383487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.384227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.384689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.385148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.704263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:22.720514 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72d097d4-d2a9-425b-b13b-c8bcd1834f21 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1502 microversion: 2.1 time: 0.354379 Oct 04 21:37:22.721572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2991/5889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:22 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1502 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:22.941427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:22.942620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:22.954865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.956841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.957540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:22.958475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:22.959377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:22.961755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:23.009247 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88b01e02-21ce-4879-ad02-30beb15959c2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/ips" status: 200 len: 150 microversion: 2.1 time: 0.614230 Oct 04 21:37:23.010022 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2899/5890] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:37:22 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/ips => generated 150 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:23.472303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc02e5b-3460-4b26-921f-d875a3e7f738", "name": "network-vif-deleted", "tag": "42a144d5-1f92-4f40-8223-81664d89a6b5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:23.490816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:23.491712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:23.492564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:23.533031 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] Creating event network-vif-deleted:42a144d5-1f92-4f40-8223-81664d89a6b5 for instance fbc02e5b-3460-4b26-921f-d875a3e7f738 on n-h2-851029-13 Oct 04 21:37:23.533031 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b2c55ec6-7711-4591-a8f1-c6070d795e7b req-9360b564-d779-4c26-b660-4633b0c78eec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066751 Oct 04 21:37:23.534737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2992/5891] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:23.750447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:23.750711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:23.761138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:23.761921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:23.762653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:23.763459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:23.780371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:23.781128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:23.910259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:23.927650 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfc00c29-e43b-4eb3-ad6b-48f714c75627 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1298 microversion: 2.1 time: 0.181169 Oct 04 21:37:23.928795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2900/5892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:23 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1298 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:24.971332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:24.982686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:24.990812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.996367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.996367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:24.996367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:24.996367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:24.996367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.086152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:25.086636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:25.087380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:25.088002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lazy-loading 'fault' on Instance uuid fbc02e5b-3460-4b26-921f-d875a3e7f738 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:25.147407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:25.172827 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e88fe74-2a26-47e4-9314-f026e3bdf4a1 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 200 len: 1303 microversion: 2.1 time: 0.207570 Oct 04 21:37:25.174853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2993/5893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:24 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:26.156681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c79e45a-5c32-4384-a2ce-5331a61f90e6"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:26.160014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:26.169841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:26.170454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:26.171066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:26.171882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:26.172644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:26.173371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:26.206456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:26.207554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: fbc02e5b-3460-4b26-921f-d875a3e7f738] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:26.216953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:26.217826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:26.218516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:26.219765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:26.220750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:26.221481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:26.239677 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] HTTP exception thrown: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Request method failure captured: Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 HTTP/1.1 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKd5bA2P_C5HPFPCdl0M_toHFYWfW4QPo6URSgwzG-1UXl1IRzky3-Ugfth10yTgPEFmhG1Pxor723IhY6i3RiiRHfWy5VH_U_sgOTQvIZZ7XsjKEwdahW8WyGSyymWDkgQrxITuQ5b4AmuIQO5NcpX07_96Pu5uxEU1lKHpW-QgcWs Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8c685594ac0d4a8ebeea7eca8a2f44d1 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesActionsTest-468528840 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesActionsTest-468528840 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8c685594ac0d4a8ebeea7eca8a2f44d1 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesActionsTest-468528840 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesActionsTest-468528840-project Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 2c70b49f7b2f4cc99c48bcd8df2edf69 Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesActionsTest-468528840-project Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fbc02e5b-3460-4b26-921f-d875a3e7f738'} Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:26.241630 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Returning 404 to user: Instance fbc02e5b-3460-4b26-921f-d875a3e7f738 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ccc25394-2618-45a3-aeb7-4eed66320e5d tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738" status: 404 len: 111 microversion: 2.1 time: 0.041764 Oct 04 21:37:26.258142 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2994/5894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:26 2022] GET /compute/v2.1/servers/fbc02e5b-3460-4b26-921f-d875a3e7f738 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:37:26.431027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-126008981", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "62a9e7a4-4d33-4126-9af0-e334240bb5ad"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:26.554557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] validate_networks() for [('62a9e7a4-4d33-4126-9af0-e334240bb5ad', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:37:27.302570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:37:27.303361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:37:27.304709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:37:27.305727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:37:27.307653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:37:27.329751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.330792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.331036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.332300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:27.338796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:27.338796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:27.364642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Getting quotas for project 8c685594ac0d4a8ebeea7eca8a2f44d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:27.374031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Getting quotas for user 2c70b49f7b2f4cc99c48bcd8df2edf69 and project 8c685594ac0d4a8ebeea7eca8a2f44d1. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:27.392841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:37:27.395454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:37:27.414434 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81bf735a-eafc-44d3-b866-0be913c1b2f7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.261415 Oct 04 21:37:27.415706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2901/5895] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:37:26 2022] POST /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 194 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:27.669250 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3be70518-c587-42a7-8def-c76454f70c31 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242927 Oct 04 21:37:27.670245 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2995/5896] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:37:27.693595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e92d702-dfd1-4fd4-adb0-9924222074fe tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:27.694501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e92d702-dfd1-4fd4-adb0-9924222074fe tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:27.909982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e92d702-dfd1-4fd4-adb0-9924222074fe tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:27.940207 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e92d702-dfd1-4fd4-adb0-9924222074fe tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1213 microversion: 2.1 time: 0.259057 Oct 04 21:37:27.945368 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2902/5897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:27 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:28.987383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53db552d-ef54-42d7-816d-7a4f875b69a0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:28.990915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53db552d-ef54-42d7-816d-7a4f875b69a0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:29.102705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-53db552d-ef54-42d7-816d-7a4f875b69a0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:29.119553 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53db552d-ef54-42d7-816d-7a4f875b69a0 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1213 microversion: 2.1 time: 0.139718 Oct 04 21:37:29.136133 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2996/5898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:28 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:30.160030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:30.163869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:30.196010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:30.199220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:30.200814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:30.202781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:30.204774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:30.206324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:30.423700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:30.440675 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3eab5589-11aa-44f8-8167-0ed12ae2bfac tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1217 microversion: 2.1 time: 0.290205 Oct 04 21:37:30.451739 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2903/5899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:30 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:31.485579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:31.486328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:31.495892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.496506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.497029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.501686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:31.503086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:31.505286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:31.709374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:31.722444 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4625860f-281c-4302-be87-329d9bcc3cbd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1273 microversion: 2.1 time: 0.241082 Oct 04 21:37:31.742805 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2997/5900] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:31 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:32.645015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:32.645747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:32.648106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:32.678725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:32.704615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:32.766878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:32.768215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:32.771878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:32.808920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:32.812446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:32.813283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:32.814314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:32.817195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:32.818400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:32.827413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:32.970826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:32.983563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a3c46bb0-8a7a-4865-83d6-065af0a00e24 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1271 microversion: 2.1 time: 0.220906 Oct 04 21:37:32.990508 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2998/5901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:32 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:33.054765 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e1a4497-96aa-44f1-b05e-a612e01f4a26 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1834 microversion: 2.1 time: 0.714061 Oct 04 21:37:33.058550 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2904/5902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:32 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1834 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:33.517022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:33.523831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:33.571234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.573760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.576870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:33.584642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:33.585746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:33.590168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.040456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:34.058178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:34.120635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.122875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.123958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.125638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.126978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.136276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.199738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.252236 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd1be5ee-899b-4672-aaf6-63a9f839a51d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1681 microversion: 2.1 time: 1.172623 Oct 04 21:37:34.253235 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2999/5903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:33 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1681 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:34.566169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:34.569078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:34.589477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.590170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.590450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.591352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.597964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.598516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.608390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.620764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c57db210-7374-4695-a82f-9902eaaed32b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.604249 Oct 04 21:37:34.623054 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2905/5904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:34 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:34.686810 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4cf2919-7ed9-48a3-a5b2-89511375ab9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action" status: 200 len: 32635 microversion: 2.1 time: 0.130539 Oct 04 21:37:34.687700 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3000/5905] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:37:34 2022] POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action => generated 32635 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (3 switches on core 0) Oct 04 21:37:34.852102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:34.852829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:34.861368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.862029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.862483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.863293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:34.863773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:34.864204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:34.898218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5a709fb0f8c64a50a1e05cc26fc3bbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6df54e3af2472c9892daeb07385c49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:34.898865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] flavor_id is None. Assuming migration. {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:37:34.899315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:37:35.637699 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ef1282c-ff52-4926-bdc3-2ef064a19960 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action" status: 202 len: 0 microversion: 2.1 time: 0.787019 Oct 04 21:37:35.641067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2906/5906] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:37:34 2022] POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:37:35.649617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:35.650343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:35.666633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.667509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.668193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.669230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.669923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.670557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.677198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:35.679478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:35.699849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.701177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.702192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.703643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:35.704592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:35.705461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:35.986094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:35.998780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:36.009184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0cd8254d-2dee-4e96-b182-1bc872c5f545 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.346959 Oct 04 21:37:36.009566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-412d68c2-cb66-4d44-80b5-bf394f38b8cd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1690 microversion: 2.1 time: 0.362288 Oct 04 21:37:36.011699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3001/5907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:35 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1690 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:36.015477 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2907/5908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:35 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:36.041988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b91036-d873-48b7-8ed3-94a88e52e1fd", "tag": "f63c512f-896a-49e6-8587-fc68754134ea"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:36.055165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:36.055919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:36.056547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:36.068935 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] Creating event network-changed:f63c512f-896a-49e6-8587-fc68754134ea for instance d8b91036-d873-48b7-8ed3-94a88e52e1fd on n-h2-851029-13 Oct 04 21:37:36.075564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f56b227f-63ea-4059-b7b7-278e7592b454 req-1da7a0d6-82a5-4f75-b67c-e50dc9d3a9f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061654 Oct 04 21:37:36.076488 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3002/5909] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:37.036551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:37.037692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:37.054708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:37.058039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:37.068601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.069561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.073209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.073209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.073937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.074887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.079855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.080807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.082309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.083777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:37.084637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:37.088619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:37.345460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:37.518120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.528908 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55bac89d-72f9-493e-89e5-cf1bd8a89a06 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.499414 Oct 04 21:37:37.530154 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2908/5910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:37 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:37.536465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:37.564439 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b32cfae0-1b97-452e-a235-95bae91b0463 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1690 microversion: 2.1 time: 0.519103 Oct 04 21:37:37.569118 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3003/5911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:37 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1690 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:38.582494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:38.585102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:38.603222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:38.603222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:38.610351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:38.614036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.614826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.615276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.616190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.616903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.617617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.621235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.622299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.623179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.624491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:38.625320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:38.626143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:38.926234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:38.935194 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a83441eb-7b50-4ba3-ae2e-10d3fbc3dd18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1690 microversion: 2.1 time: 0.339109 Oct 04 21:37:38.935823 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3004/5912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:38 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1690 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:38.943667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:38.955811 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54c5b824-1824-4b82-980c-cb44f46cf3e6 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.395748 Oct 04 21:37:38.956632 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2909/5913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:38 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:39.967276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:39.967276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:39.968957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:39.985422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:39.986539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:39.990624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:39.998207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:39.999111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:40.007138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:40.008005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:40.008748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:40.017086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:40.018024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:40.024476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:40.026107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:40.035276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:40.036446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:40.926791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:40.944305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-855fafa4-ba22-4d8f-9fc8-8df5fb8827cf tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.966480 Oct 04 21:37:40.945202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2910/5914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:39 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:41.116898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:41.147109 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43494177-bdc8-43dd-b3a4-bb22f82b62e1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1690 microversion: 2.1 time: 1.189240 Oct 04 21:37:41.148722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3005/5915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:39 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1690 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:41.969247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:41.971386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:41.983632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:41.984183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:41.984930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:41.986013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:41.986489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:41.986947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:42.177449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:42.179288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:42.191873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:42.192702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:42.193186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:42.194271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:42.195052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:42.196152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:42.240481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:42.258076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c635221-926c-47fc-9967-d7a04e4c06ad tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.293400 Oct 04 21:37:42.280160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2911/5916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:41 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:42.486337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:42.495948 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50e31882-415f-4ed0-84ea-c6c1bdbd358c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.323920 Oct 04 21:37:42.511100 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3006/5917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:42 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:42.540429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b91036-d873-48b7-8ed3-94a88e52e1fd", "name": "network-vif-plugged", "status": "completed", "tag": "f63c512f-896a-49e6-8587-fc68754134ea"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:42.553597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:42.554369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:42.555108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:42.569280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] Creating event network-vif-plugged:f63c512f-896a-49e6-8587-fc68754134ea for instance d8b91036-d873-48b7-8ed3-94a88e52e1fd on n-h2-851029-13 Oct 04 21:37:42.575565 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4b3b22e7-07d3-43ae-aee7-91e2a71c0e0b req-65ac921e-d9da-4953-ac04-7ffdc14b4399 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038966 Oct 04 21:37:42.576522 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2912/5918] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:43.288709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:43.289812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:43.301493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.302010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.302455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.303284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.303853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.304278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.530773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:43.533624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:43.549617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.550964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.552074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.554056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.555651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.557395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.576840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:43.607911 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db1dd0c7-c2a6-4ea0-957b-1c9859e116f2 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1313 microversion: 2.1 time: 0.321254 Oct 04 21:37:43.609004 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3007/5919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:43 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:43.656501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c79e45a-5c32-4384-a2ce-5331a61f90e6"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:43.659515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:43.668044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.668557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.669010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.669792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.670314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.670884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.811749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:43.823165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02f20d24-b1e9-4351-8857-b2e2692730f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.304488 Oct 04 21:37:43.824170 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2913/5920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:43 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:43.825365 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments HTTP/1.1 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 74 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: {"volumeAttachment": {"volumeId": "6c79e45a-5c32-4384-a2ce-5331a61f90e6"}} Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': '17d8ccd8-a11b-4861-bac1-df719210648f', 'body': {'volumeAttachment': {'volumeId': '6c79e45a-5c32-4384-a2ce-5331a61f90e6'}}} Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:37:43.827658 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 400 to user: Invalid volume: volume 6c79e45a-5c32-4384-a2ce-5331a61f90e6 is already attached to instances: 17d8ccd8-a11b-4861-bac1-df719210648f {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd4f53d7-91aa-4458-bed9-31e228fbf3d9 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177178 Oct 04 21:37:43.836431 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3008/5921] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:37:43 2022] POST /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 174 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:37:43.944370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:43.945227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:43.953496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.954117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.956195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:43.956195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:43.956195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:43.956705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.068261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'services' on Instance uuid 17d8ccd8-a11b-4861-bac1-df719210648f {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:44.393347 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e79e2c8-f28e-4982-b740-af7cb21f66d1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments/6c79e45a-5c32-4384-a2ce-5331a61f90e6" status: 202 len: 0 microversion: 2.1 time: 0.453038 Oct 04 21:37:44.395455 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2914/5922] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:37:43 2022] DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments/6c79e45a-5c32-4384-a2ce-5331a61f90e6 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:37:44.407961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:44.413086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:44.425498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.426481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.427088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.428140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.429068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.429967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.475830 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c06afc76-bb10-49e2-ab53-59bb2095f714 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074094 Oct 04 21:37:44.476792 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3009/5923] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:44 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:44.651380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:44.653616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:44.668090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.668847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.669494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.670921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.671632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.672505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.857282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:44.858088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:44.865626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.866556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.867254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.868061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:44.870015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:44.870705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:44.952312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:44.964460 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc676521-3be4-460d-87c5-5335f8810468 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1496 microversion: 2.1 time: 0.323054 Oct 04 21:37:44.973055 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2915/5924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:44 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1496 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:45.168250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:45.185547 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51e9cdcf-a700-48d7-ad8d-a0056b3932af tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.333497 Oct 04 21:37:45.187466 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3010/5925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:44 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:45.496242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:45.499611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:45.512301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:45.565762 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e107068-39b5-4236-95e7-ad5bc9e4a685 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075111 Oct 04 21:37:45.568398 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2916/5926] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:45 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:46.213290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:46.214958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:46.224066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.224737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.225589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.226378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.227175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.227694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.430061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:46.453573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06d7a536-9c73-4c04-bf7b-d7fb798f1aaa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.243440 Oct 04 21:37:46.456138 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3011/5927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:46 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:46.590864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:46.596225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:46.616762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.617269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.617717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.618447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.619049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.619786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.644713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:46.645233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:46.658924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.660425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.661829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.663216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:46.664538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:46.666310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:46.680995 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d43d24d3-48ec-40db-8191-a3775f16ce07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101833 Oct 04 21:37:46.687641 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2917/5928] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:46 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:46.720905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:37:47.263726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16ee7862-c21e-44a0-8dc3-76d3db872e4a tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 204 len: 0 microversion: 2.1 time: 0.622607 Oct 04 21:37:47.265075 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3012/5929] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:46 2022] DELETE /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:37:47.277701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:47.278828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:47.296555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.297559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.298522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.299946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.300561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.301213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.492192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:47.494788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:47.512266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.513513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.514508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.516400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.517177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.518024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.614029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:47.649614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a0dbf01-fd2c-4ad0-a8df-d58ede085e40 tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1502 microversion: 2.1 time: 0.377263 Oct 04 21:37:47.652592 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2918/5930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:47 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:47.709189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:47.714439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:47.736742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.737971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.738799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.740064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:47.741562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:47.742935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:47.786314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:47.790492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:47.803382 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-408d0bc3-194f-41c9-937b-c223f27e95ce tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.323136 Oct 04 21:37:47.816677 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3013/5931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:47 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:47.819062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-17a393bf-ae4d-47fd-a902-08d96f757b5c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118486 Oct 04 21:37:47.820150 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2919/5932] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:47 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:48.704124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:48.704969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:48.718002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:48.722076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:48.722930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:48.723907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:48.725525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:48.726965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:48.771434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:48.833677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:48.834476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:48.856871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:48.857794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:48.860930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:48.862911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:48.864516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:48.865272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:48.975150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:48.999908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b0589b8-aa01-4b04-81a8-02b90cfa650b tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1502 microversion: 2.1 time: 0.300256 Oct 04 21:37:49.012013 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3014/5933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:48 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:49.070629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:49.078449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:49.126578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:49.130282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:49.130282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:49.130282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:49.130795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:49.131469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:49.195522 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0cc8bc7-3c62-4c09-a74a-c6275124fc5e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170528 Oct 04 21:37:49.196179 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3015/5934] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:49 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:49.316205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:49.332176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f1824a3-f23d-44a0-a22f-4b835d4c16c0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.504010 Oct 04 21:37:49.333367 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2920/5935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:48 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:49.576501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b91036-d873-48b7-8ed3-94a88e52e1fd", "name": "network-vif-deleted", "tag": "f63c512f-896a-49e6-8587-fc68754134ea"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:49.595780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:49.596700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:49.597422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:49.626806 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] Creating event network-vif-deleted:f63c512f-896a-49e6-8587-fc68754134ea for instance d8b91036-d873-48b7-8ed3-94a88e52e1fd on n-h2-851029-13 Oct 04 21:37:49.636473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d7ff24f3-bd30-42f1-b4c4-128cdb1c6a2c req-6f47af0a-1491-447f-901c-a6aac8bce05a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068240 Oct 04 21:37:49.643383 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3016/5936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:50.064229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:50.066558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:50.083706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.085078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.086215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.087464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.088619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.089363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.155783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.156752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.157602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.158550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lazy-loading 'fault' on Instance uuid d8b91036-d873-48b7-8ed3-94a88e52e1fd {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:50.223217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:50.229347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:50.254086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.254086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.254086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.254086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.261426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c70b49f7b2f4cc99c48bcd8df2edf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c685594ac0d4a8ebeea7eca8a2f44d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:50.266971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.271235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.288980 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-809e17b1-a2ae-49d8-bd4f-d629e0a5e8fd tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 200 len: 1303 microversion: 2.1 time: 0.229819 Oct 04 21:37:50.306747 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2921/5937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:50 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:50.360708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:50.362499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:50.391887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.392633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.394853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.395149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-117f881c-d33b-463b-8576-87bf00ab4d8b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184852 Oct 04 21:37:50.397640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:50.399040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:50.400270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:50.406369 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3017/5938] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:50 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:50.669063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:50.688076 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93790c8c-b828-46fc-ba48-d4bbbf20217f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.332863 Oct 04 21:37:50.697144 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2922/5939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:50 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:51.346388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:51.348031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] [instance: d8b91036-d873-48b7-8ed3-94a88e52e1fd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:51.362495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.363343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.363973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.365004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.366378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.367840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.426205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] HTTP exception thrown: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Request method failure captured: Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd HTTP/1.1 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKd5bA2P_C5HPFPCdl0M_toHFYWfW4QPo6URSgwzG-1UXl1IRzky3-Ugfth10yTgPEFmhG1Pxor723IhY6i3RiiRHfWy5VH_U_sgOTQvIZZ7XsjKEwdahW8WyGSyymWDkgQrxITuQ5b4AmuIQO5NcpX07_96Pu5uxEU1lKHpW-QgcWs Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 8c685594ac0d4a8ebeea7eca8a2f44d1 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesActionsTest-468528840 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c685594ac0d4a8ebeea7eca8a2f44d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesActionsTest-468528840 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 8c685594ac0d4a8ebeea7eca8a2f44d1 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesActionsTest-468528840 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesActionsTest-468528840-project Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 2c70b49f7b2f4cc99c48bcd8df2edf69 Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesActionsTest-468528840-project Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'd8b91036-d873-48b7-8ed3-94a88e52e1fd'} Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:51.430436 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:37:51.444404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] Returning 404 to user: Instance d8b91036-d873-48b7-8ed3-94a88e52e1fd could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:51.448437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:51.453399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:51.455174 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41efbade-3d57-4da1-a524-207a2f25a1aa tempest-VolumesActionsTest-468528840 tempest-VolumesActionsTest-468528840-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd" status: 404 len: 111 microversion: 2.1 time: 0.127391 Oct 04 21:37:51.457164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3018/5940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:51 2022] GET /compute/v2.1/servers/d8b91036-d873-48b7-8ed3-94a88e52e1fd => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:51.469538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.470438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.471099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.472011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.472809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.473546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.548645 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55f9c998-eedc-4830-9e33-51435d8a5343 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137247 Oct 04 21:37:51.552612 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2923/5941] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:51 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:51.728084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:51.729848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:51.750155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.751546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.752720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:51.754318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:51.759153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:51.760532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.111293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:52.126546 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9fd49d33-05f3-40cb-b156-60278ad6dd5e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.409990 Oct 04 21:37:52.129531 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3019/5942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:51 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:52.579583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:52.582539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:52.594586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.595513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.596467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.597816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.598975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.600126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.671118 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3dfbd82b-1307-4f54-82b1-d59d7c7df2f3 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104119 Oct 04 21:37:52.671118 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2924/5943] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:37:52 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:37:52.806612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:52.809338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:52.833295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.838813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.840827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.842539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:52.846128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:52.848151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:52.894047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:37:53.169258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:53.175175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:53.178692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:53.179340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:53.180097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:53.181173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:53.181955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:53.182790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:53.417702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:53.431691 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3208c1ec-52f5-4e78-9401-7c4683a2186c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.266524 Oct 04 21:37:53.458371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2925/5944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:53 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:53.628335 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-024d106e-16f1-4637-8f66-3acf5b2c713a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 204 len: 0 microversion: 2.1 time: 0.828437 Oct 04 21:37:53.629439 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3020/5945] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:52 2022] DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:37:53.640224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:53.641696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:53.653166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:53.654162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:53.654850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:53.656288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:53.657134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:53.657877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:53.882932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:53.893599 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c482438-5721-4eea-8307-c0258393f8fa tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1682 microversion: 2.1 time: 0.258259 Oct 04 21:37:53.894251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2926/5946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:53 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1682 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:54.460732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:54.462484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:54.471235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.471771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.472216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.472972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.473483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.474196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.678849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:54.695231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6ddcd161-5348-4518-8895-95992e923d91 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1695 microversion: 2.1 time: 0.241946 Oct 04 21:37:54.711984 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3021/5947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:54 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1695 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:54.924630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:54.931405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:54.957308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.960096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.964088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.967378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.969544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.971552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:55.427695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:55.448662 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e6e3660-4b0d-4c29-9788-6ecb9b190f46 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1682 microversion: 2.1 time: 0.530163 Oct 04 21:37:55.451131 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2927/5948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:54 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1682 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:55.732454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:55.735373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:55.759866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:55.762773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:55.762773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:55.764670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:55.765812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:55.767086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:56.108022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:56.138162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8761a38-6beb-4d35-a4e1-4f9420d11fbd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1694 microversion: 2.1 time: 0.419863 Oct 04 21:37:56.153287 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3022/5949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:55 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1694 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:56.475324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:56.476351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:56.490168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:56.491532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:56.492301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:56.493920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:56.494968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:56.496176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:56.660884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:56.680238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-584713c8-af9b-49b9-b502-02ef3b275bab tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1614 microversion: 2.1 time: 0.208539 Oct 04 21:37:56.681642 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2928/5950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:56 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1614 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:56.723908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:56.745017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:56.745905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:56.747289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:56.777930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Creating event network-vif-unplugged:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h2-851029-13 Oct 04 21:37:56.788792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:37:56.825952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9dc97784-76ad-4a4d-b296-5882482490d8 req-a53d5e87-c612-45da-92e8-4d27593629a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107310 Oct 04 21:37:56.829183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3023/5951] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:57.184639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:57.185675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:57.194926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.195768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.196577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.198103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.198855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.199723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.565521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d8ccd8-a11b-4861-bac1-df719210648f", "name": "network-vif-deleted", "tag": "25830a68-d430-4d52-8e58-93d4946e9ff4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:57.600646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.631639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.631982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.679694 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] Creating event network-vif-deleted:25830a68-d430-4d52-8e58-93d4946e9ff4 for instance 17d8ccd8-a11b-4861-bac1-df719210648f on n-h2-851029-13 Oct 04 21:37:57.709473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d0a2f87f-3b8b-4781-9075-a7cc464feee2 req-4c00d01e-b8e8-4671-84ed-e6f6b3e3e2c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382343 Oct 04 21:37:57.712695 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3024/5952] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:57.729523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:57.738862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:57.751308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.752098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.752441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.753976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:57.755328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:57.756831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:57.891396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:57.926545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04eb1a20-3324-4c76-a6d3-a700e9e2e6a4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1694 microversion: 2.1 time: 0.743030 Oct 04 21:37:57.928889 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2929/5953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:57 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1694 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:57.935106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:57.974578 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd2955b2-3214-49fc-90ad-4859ce724bf6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1326 microversion: 2.1 time: 0.250782 Oct 04 21:37:57.978004 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3025/5954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:57 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1326 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:58.861328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:58.889176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:58.889561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:58.890827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:58.924530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Creating event network-changed:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h2-851029-13 Oct 04 21:37:58.941724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:37:58.971225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:58.973315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:59.008713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.013029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.016391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.019309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.025412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.026508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.088904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5093df74-71aa-4b99-b3a9-808bdf209235 req-8d8dd51f-68d2-4ec9-88aa-f3fb93e570ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232239 Oct 04 21:37:59.104039 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2930/5955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:37:59.142851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:59.148832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:59.192526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.194570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.199603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.201255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.207811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.208935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.384597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:59.388574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:59.391008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:59.400626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'fault' on Instance uuid 17d8ccd8-a11b-4861-bac1-df719210648f {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:59.599903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:59.632195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7046e176-b262-42ab-9469-51f46ed4c851 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 200 len: 1331 microversion: 2.1 time: 0.522753 Oct 04 21:37:59.634032 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2931/5956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:59 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 1331 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:00.033474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:00.070172 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-666e0e59-5d67-46cf-8899-ab650c0abac4 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1694 microversion: 2.1 time: 1.111612 Oct 04 21:38:00.072792 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3026/5957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:58 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1694 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:00.680790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:00.682929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:00.696789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:00.697989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:00.699134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:00.701280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:00.702467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:00.703573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:00.738572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f HTTP/1.1 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '17d8ccd8-a11b-4861-bac1-df719210648f'} Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:38:00.743729 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:38:00.752798 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:38:00.755335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:38:00.757406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21dbb840-164f-442d-962d-f564b748044b tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 404 len: 111 microversion: 2.1 time: 0.093146 Oct 04 21:38:00.764635 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2932/5958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:00 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:38:00.774366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1076787c-0186-4639-ac27-bb3e11c53ae2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '.version_select at 0x7f54f5f4c700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:01.044529 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1076787c-0186-4639-ac27-bb3e11c53ae2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543073866" status: 202 len: 0 microversion: 2.1 time: 0.276129 Oct 04 21:38:01.063242 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3027/5959] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 21:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543073866 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:38:01.132454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:01.135661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:01.156450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:01.157596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:01.158381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:01.159666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:01.160582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:01.169197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:01.730414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:01.741240 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-263a0d3f-4e31-4ef6-82ec-fb1cc22356d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1694 microversion: 2.1 time: 0.627605 Oct 04 21:38:01.742985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2933/5960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:01 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1694 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:02.779616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:02.780773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:02.820734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:02.825783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:02.826929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:02.828002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:02.828859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:02.829686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:03.432785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:03.453105 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1472e0f7-17b1-4f79-b79a-87bc0b6c0e78 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1692 microversion: 2.1 time: 0.680438 Oct 04 21:38:03.453105 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3028/5961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:02 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1692 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:03.537061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a1048dd-8210-422e-a4e6-0d56ac786da0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: .version_select at 0x7f54f55e5dc0>, body: {"keypair": {"name": "tempest-keypair-2040454787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4hBAEnhvTq+g+bJbDbfVkcGypAOhwKDfHXc05Q2n1PR1LfB/zrq8Az14nDyeRTUSNhlBepDLTZnDlYK/f1EWDYpUCPYgDTWPdodg3NEvv+v8IZCzdk/CWb6n8HDxdCyQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:03.589332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=66 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:03.631635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0a1048dd-8210-422e-a4e6-0d56ac786da0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:03.655063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0a1048dd-8210-422e-a4e6-0d56ac786da0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:03.829378 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a1048dd-8210-422e-a4e6-0d56ac786da0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.305189 Oct 04 21:38:03.839158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2934/5962] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:38:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:04.500626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:04.506313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:04.527412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:04.532538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:04.533597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:04.534254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:04.535777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:04.536685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:04.537515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:04.855524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:04.868690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc644553-5cbe-44a3-996c-e5213f0d19d5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1689 microversion: 2.1 time: 0.378729 Oct 04 21:38:04.869929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3029/5963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:04 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1689 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:04.898107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:04.898793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:04.910976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:04.911583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:04.912103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:04.913868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:04.914426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:04.915597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.251981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:05.645010 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ed0fa96-bde6-46e1-a745-48c2b4e003dd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action" status: 202 len: 0 microversion: 2.1 time: 0.751435 Oct 04 21:38:05.649944 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2935/5964] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:38:04 2022] POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:38:05.657118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:05.658450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:05.672118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.679093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.679898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.681116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.682264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.683238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.501932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:06.538593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a450a33f-1482-430a-92d9-04babcfd69f6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.866261 Oct 04 21:38:06.562901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3030/5965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:05 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:06.683420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-plugged", "status": "completed", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:06.705764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.706279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.706783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.729432 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Creating event network-vif-plugged:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h2-851029-13 Oct 04 21:38:06.738786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:06.755265 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-92fc02aa-dfff-4bfc-a9f6-7fb48db04e7d req-ab960a69-44a6-49bc-bc90-4213963cc740 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076800 Oct 04 21:38:06.761875 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2936/5966] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:07.603383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:07.610406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:07.629988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:07.631401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:07.632158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:07.633927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:07.635958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:07.637095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:08.183215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:08.203039 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49412470-f58d-4c9b-9d16-ea74453d10db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.610479 Oct 04 21:38:08.207333 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3031/5967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:07 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:09.237234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.240952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.266057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.270132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.271351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.276315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.277481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.280927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.476096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-523075669", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3692c330-581b-4ef5-9ab1-9d8bb86909a1"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:09.598976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] validate_networks() for [('3692c330-581b-4ef5-9ab1-9d8bb86909a1', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:38:09.611828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:09.625243 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-baf73e32-50d7-497f-ac2f-51cefa05a1d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.395337 Oct 04 21:38:09.625850 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2937/5968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:09 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:10.261271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:10.261707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:10.262213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:10.262783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:10.263238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:10.282631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.283527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.284330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.285862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.286693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.287463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.342874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Getting quotas for project 0c57efa4358f4402a793bc5d1587fd72. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:10.379883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Getting quotas for user 12f8d3765d91445886264c636a923fc8 and project 0c57efa4358f4402a793bc5d1587fd72. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:10.418168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:38:10.426072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:38:10.589028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1226028450", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1"}], "security_groups": [{"name": "tempest-securitygroup--1606525177"}], "key_name": "tempest-keypair-2040454787", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:10.663978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62416e3d-9b92-41fa-bb9f-eb00395ef762 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193304 Oct 04 21:38:10.666629 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3032/5969] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:38:10.685572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.690757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.714301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.715885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.716929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.718497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.719602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.720655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.735259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:10.860050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] validate_networks() for [('b770b3f7-3f8d-4c6b-b531-a110e7e6b9b1', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:38:11.240054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.275907 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5baa505-d631-4af1-bec5-b3d05ebf7342 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.604762 Oct 04 21:38:11.277992 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3033/5970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:11.283758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cbfcdf93-1022-40ca-81fc-b05c99660c82 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:11.284560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cbfcdf93-1022-40ca-81fc-b05c99660c82 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:11.481479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cbfcdf93-1022-40ca-81fc-b05c99660c82 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.498788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cbfcdf93-1022-40ca-81fc-b05c99660c82 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1218 microversion: 2.1 time: 0.219686 Oct 04 21:38:11.523384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3034/5971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:11 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:12.192619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:12.193832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:12.194914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:12.195633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:12.196855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:12.213129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.213129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.213129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.213129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.214555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.215514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.252826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:12.278285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Getting quotas for user 4e30a29012994c49bdd5ae23055d79c6 and project 7981af02d1644461ba7113a903b34b85. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:12.309253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.322741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.334576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:38:12.337731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:38:12.380791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.384439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.385739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.395644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.396968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.398644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e297831d-5aef-44f2-a107-b02eb5805526 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.383142 Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3035/5972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.719191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.851783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:12.866807 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64bf6fda-2b09-4220-b742-131056abdade tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1222 microversion: 2.1 time: 0.179738 Oct 04 21:38:12.869051 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3036/5973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:12.876748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6628830-d7a1-414b-b7e9-8e06b06dd3c0 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.297512 Oct 04 21:38:12.878571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2938/5974] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:38:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:38:12.895868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f00493d-d169-4911-8168-22380a399bd6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.897281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f00493d-d169-4911-8168-22380a399bd6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.969544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:13.003231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.013023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.013422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.054322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f00493d-d169-4911-8168-22380a399bd6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:13.054777 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Creating event network-vif-unplugged:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:38:13.082783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f00493d-d169-4911-8168-22380a399bd6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1242 microversion: 2.1 time: 0.188554 Oct 04 21:38:13.085745 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3037/5975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:13.088678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:13.113508 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-30f03ed4-c8e2-41e2-876a-12b71825181e req-89c72a5a-2401-4e70-a29b-baa668f7f1fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150622 Oct 04 21:38:13.115789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2939/5976] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:13.760035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:13.760688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:13.795293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.795706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.807256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.809985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.816564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.817119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.897101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:13.900351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:13.908596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.909672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.910317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.911729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.912397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.913988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.102477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:14.129108 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0fc0a6d7-db87-4f05-977b-4f51cde12302 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1270 microversion: 2.1 time: 0.237396 Oct 04 21:38:14.135845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2940/5977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:13 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:14.200718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdfef45b-c869-4ce4-bbd9-876f7f00c51d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:14.214773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fdfef45b-c869-4ce4-bbd9-876f7f00c51d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:14.257558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:14.277603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f65ddcf-7dbe-40b3-9b54-ca58fe6aa780 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.526255 Oct 04 21:38:14.291557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3038/5978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:13 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:14.435640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fdfef45b-c869-4ce4-bbd9-876f7f00c51d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:14.449779 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdfef45b-c869-4ce4-bbd9-876f7f00c51d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1242 microversion: 2.1 time: 0.312043 Oct 04 21:38:14.450394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2941/5979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:14 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1242 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:15.168740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:15.169950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.197190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.210282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.211945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.213679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.215836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.217138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.223620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:15.293166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.296278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.297120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.362636 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Creating event network-changed:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:38:15.389387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:15.440994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ba057a55-db42-4792-9e62-abe096d1f0e6 req-e7091586-661f-4243-8b6c-b7633a50489b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225813 Oct 04 21:38:15.442723 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2942/5980] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:15.465823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:15.470813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.498822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.504669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.504669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.504669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.504669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.511879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.798975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.833919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44bf16b9-4135-46a9-8bd9-0faa3de9285c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1278 microversion: 2.1 time: 0.677718 Oct 04 21:38:15.837771 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3039/5981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:15 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1278 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:15.863254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:15.866979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.893736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.898085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.898938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.903801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.907789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.908969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.326179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:16.530493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-169aa969-4ba4-4107-9a98-20b1762f5f53 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1238 microversion: 2.1 time: 0.627967 Oct 04 21:38:16.530493 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3040/5982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:15 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1238 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:16.531091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:16.532092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9945ac71-db12-4397-b831-17a2fa133e7f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 1.087331 Oct 04 21:38:16.533258 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2943/5983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:15 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:16.891701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.891701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:16.922623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.928306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.928921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.941832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.942503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.943005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.096612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:17.112650 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7254108f-b887-4cfb-a2e6-4316c02558ff tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1276 microversion: 2.1 time: 0.228156 Oct 04 21:38:17.112650 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3041/5984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:16 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:17.510428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:17.511601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:17.548132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.550171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.551743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.554734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.559537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.561028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.582539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:17.584744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:17.604134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.605467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.606520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.608160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.609677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.610927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.712470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:17.731859 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f5ccf00-47c7-4a84-9b54-70865e2a5aa1 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1294 microversion: 2.1 time: 0.227283 Oct 04 21:38:17.732818 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2944/5985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:17 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1294 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:17.901698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:17.921591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c6e61cf-6300-47ff-8e12-2d2fc41c199b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.345091 Oct 04 21:38:17.922436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3042/5986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:17 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:18.157330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:18.158312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:18.176861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.178259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.178746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.180229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.187659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.189048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.432889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:18.451443 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58122a43-a19c-41dc-b7e8-ba4fa89dd2cb tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.300977 Oct 04 21:38:18.453625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2945/5987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:18 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:18.782640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:18.783586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:18.792581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.795535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.795535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.795535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.795535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.796137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.938079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:18.952679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:18.954000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:18.974404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.974713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.975793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.978197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.978940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1e039f8-eae9-4a4e-bd45-8c139185e62c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1312 microversion: 2.1 time: 0.203383 Oct 04 21:38:18.979657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3043/5988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:18 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:18.987658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.989788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:19.324785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:19.338289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58514577-ac11-446a-a59f-09a5d864ec9e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1688 microversion: 2.1 time: 0.394289 Oct 04 21:38:19.340179 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2946/5989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:18 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1688 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:19.493070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:19.493711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:19.509775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.511521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.518752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:19.518752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.518752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.518752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.019322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:20.020670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:20.055047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.058184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.063976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:20.066278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.073149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.079952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.082449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb36fb4f-26f8-446c-a954-f61434439661 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.594745 Oct 04 21:38:20.084108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.085978 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3044/5990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:19 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:20.383070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:20.383819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:20.387599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:20.391221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:20.406240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.409993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.409993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.410455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:20.411933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:20.414496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.418296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c742803-707b-420a-91ec-004ff996d78a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1300 microversion: 2.1 time: 0.404029 Oct 04 21:38:20.420366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2947/5991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:20 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1300 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:21.045443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:21.074112 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21e80ce8-45e7-4ef2-b8bb-267bd3a47002 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1681 microversion: 2.1 time: 0.694984 Oct 04 21:38:21.106737 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3045/5992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:20 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1681 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:21.153171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:21.160400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e024f0b-09c9-4cb1-aeea-51edae13776e", "tag": "050b35d4-a529-4046-872b-e5970da0efa8"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:21.176094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:21.230878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.242337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.246887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.250780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.266208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.269325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.270168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.271048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.276123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.303969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] Creating event network-changed:050b35d4-a529-4046-872b-e5970da0efa8 for instance 0e024f0b-09c9-4cb1-aeea-51edae13776e on n-h2-851029-13 Oct 04 21:38:21.312915 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0ea55d44-bae1-481e-96f4-d565a856fb56 req-6fbdf28d-56c7-4615-8557-50899f118c2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191595 Oct 04 21:38:21.314285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2948/5993] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:21.463246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:21.465357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:21.506447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.507285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.508647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.510060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.525295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.526284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.235387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:22.279749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:22.345505 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8b81b41-a70c-431c-945b-1643047d007e tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 1.213471 Oct 04 21:38:22.347328 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3046/5994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:21 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:22.487184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:22.530845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5ea3aa2-a413-4245-a4d1-dfc89ad20117 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 1.073767 Oct 04 21:38:22.535415 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2949/5995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:21 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:23.389352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:23.389990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:23.405778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=10 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:23.408041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.408762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.409720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.411456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.413627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.415111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.584337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:23.585262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:23.625975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.630072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.630606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.631447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.631919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.635420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.788457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:23.857669 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da2d2a0f-f037-40c6-80f4-d21d42924933 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.456211 Oct 04 21:38:23.857669 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3047/5996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:23 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:24.441806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:24.542078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:24.595748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7b14234b-8e33-46c2-b6e0-16165cf5c44a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 1.015672 Oct 04 21:38:24.611053 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2950/5997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:23 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:24.720938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb548e7d-d127-4330-8910-120d545d7433", "tag": "55964248-edbc-48fd-893c-03f3071859e1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:24.797132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.797948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.805758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:24.870710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:24.871895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:24.890945 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] Creating event network-changed:55964248-edbc-48fd-893c-03f3071859e1 for instance fb548e7d-d127-4330-8910-120d545d7433 on n-h2-851029-13 Oct 04 21:38:24.899397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b834657f-e8c6-43b2-8c2d-5c0d90d52d04 req-55010079-48bd-4503-bce6-1be6b65a4000 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186060 Oct 04 21:38:24.905371 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3048/5998] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:24.908222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.932600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.934205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:24.941684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.944071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.946568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.563296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:25.580000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d94f69e-61f5-4eff-91c5-723023eb6ad7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.711828 Oct 04 21:38:25.581574 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2951/5999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:24 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:25.638035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:25.643271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:25.661509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.680660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.680660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.680660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.680660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.680660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.823817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-plugged", "status": "completed", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:25.895499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.902617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.919070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.946726 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] Creating event network-vif-plugged:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:38:25.964783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:25.984869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-947040c4-b4ad-4a21-acec-4d1b9b5bec09 req-fb9a489b-58fe-4ebf-b1ae-c1b9d4f4bfdd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157784 Oct 04 21:38:25.984869 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2952/6000] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:25.985428 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-781518d5-a1d7-4300-9dff-30e70c643512 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 0.355865 Oct 04 21:38:25.985428 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3049/6001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:25 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:26.624127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:26.627284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:26.654175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.656772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.657598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.658932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:26.668214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:26.668986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.158961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.160482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:27.160482 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-453efc6c-91d4-4cb6-946b-ff5a5aec1935 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.493198 Oct 04 21:38:27.160482 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2953/6002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:26 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:27.364240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:27.376726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e3317ad-5e62-4221-8895-6e72414fa5eb tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 0.366598 Oct 04 21:38:27.377694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3050/6003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:27 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:28.043388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e024f0b-09c9-4cb1-aeea-51edae13776e", "name": "network-vif-plugged", "status": "completed", "tag": "050b35d4-a529-4046-872b-e5970da0efa8"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:28.080123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.081041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.081837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.120798 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] Creating event network-vif-plugged:050b35d4-a529-4046-872b-e5970da0efa8 for instance 0e024f0b-09c9-4cb1-aeea-51edae13776e on n-h2-851029-13 Oct 04 21:38:28.131704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d7bb0083-a18f-442e-8095-9541ef7af011 req-d7e1b213-0cdb-428f-a277-2e6aa8963b98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095975 Oct 04 21:38:28.140538 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2954/6004] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:28.157957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:28.158927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:28.175875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.179490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.180229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.182953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.183788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.188059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.427125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:28.456426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:28.490369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.491703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.495930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.498049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.500971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.504533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.817445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:28.831930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9f22e1b-f4a8-433b-92b3-e4f298f3f1e7 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.681397 Oct 04 21:38:28.835483 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3051/6005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:28 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:28.937795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:28.951384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16fbd2ea-7602-404d-a2fc-dfe5534fae2d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 0.531309 Oct 04 21:38:28.967790 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2955/6006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:28 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:29.888294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:29.899800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:29.921011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.923734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.926024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.930376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.931935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.934403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.967535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:29.978264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:29.978983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:29.993186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.993686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.994166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.994916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.995383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.995813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:30.034187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:30.349161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:30.370301 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e83e338-68fd-4547-855c-727b65ebd1dc tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1318 microversion: 2.1 time: 0.491775 Oct 04 21:38:30.376873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3052/6007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:29 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:30.405075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:30.418353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aefac857-c156-4b3b-85c8-b4fa00cdad07 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 0.444739 Oct 04 21:38:30.419107 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2956/6008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:29 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:30.691936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb548e7d-d127-4330-8910-120d545d7433", "name": "network-vif-plugged", "status": "completed", "tag": "55964248-edbc-48fd-893c-03f3071859e1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:30.708291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:30.709949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:30.711117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:30.757845 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] Creating event network-vif-plugged:55964248-edbc-48fd-893c-03f3071859e1 for instance fb548e7d-d127-4330-8910-120d545d7433 on n-h2-851029-13 Oct 04 21:38:30.772603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5ca4ad20-6c97-4fd4-b3f8-bb085854620c req-abe10026-6331-4a6c-bacb-c939d31f915a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086331 Oct 04 21:38:30.774079 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3053/6009] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:31.408332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:31.410035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:31.428256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.428769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.430382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.431222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.431711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.432152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.447237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:31.448998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:31.498306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.498972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.499619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.503560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.504209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.508312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.825794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:31.839572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ba54a85-44e0-4a75-8c4d-88ce6399a3de tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1506 microversion: 2.1 time: 0.435343 Oct 04 21:38:31.846514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:31.859393 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2957/6010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:31 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:31.864178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1890cb73-1e2d-4194-b9f1-38ab96a68312 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1368 microversion: 2.1 time: 0.423099 Oct 04 21:38:31.865374 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3054/6011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:31 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1368 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:32.955574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.150702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:33.165962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86a75313-de06-4499-ac5e-b1362fcd5d65 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1558 microversion: 2.1 time: 0.273932 Oct 04 21:38:33.167637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2958/6012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:32 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1558 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:33.206807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:33.208634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:33.222120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.223447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.224232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.225596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.227031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.227812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.388773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-482fa964-a13c-45ea-aa3a-2a0ef2d77b69 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189604 Oct 04 21:38:33.402604 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3055/6013] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 21:38:33 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:35.492340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb548e7d-d127-4330-8910-120d545d7433", "tag": "55964248-edbc-48fd-893c-03f3071859e1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:35.500121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:35.508356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.509033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.509627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.527058 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] Creating event network-changed:55964248-edbc-48fd-893c-03f3071859e1 for instance fb548e7d-d127-4330-8910-120d545d7433 on n-h2-851029-13 Oct 04 21:38:35.533918 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5dc305d5-b701-414c-a5bb-93d83a8881ce req-4947b586-5c70-46d1-ac54-48a3f1fd6658 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047076 Oct 04 21:38:35.534894 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2959/6014] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:49.892751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:49.894445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=15 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:49.903120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:49.908886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:49.922229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.924288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.925846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.927181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.932178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.933523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.036153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-52768013-4acb-4f27-880c-e423493de78b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action" status: 200 len: 63178 microversion: 2.1 time: 0.147615 Oct 04 21:38:50.037760 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3056/6015] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:38:49 2022] POST /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb/action => generated 63178 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:39:06.300100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:06.312117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:06.313451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:06.327353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:06.328234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:06.329032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:06.330313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:06.331160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:06.331935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:06.802812 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-416fd6a4-5ba1-4e82-9468-da30747c31dd tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1834 microversion: 2.1 time: 0.507227 Oct 04 21:39:06.803922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2960/6016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:06 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1834 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:08.300156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:08.301525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:08.303886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:08.322298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.323241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.324053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.337204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.345785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.345785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.353701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.354892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.355882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.368176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] Creating event network-changed:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:39:08.384867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-914bcd22-87f8-4005-9441-f71800110179 req-2407488f-0e39-4524-862e-88919df6d252 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091881 Oct 04 21:39:08.391301 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2961/6017] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:08.544360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:39:09.214875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:09.218611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:09.237364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.238099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.255853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.255853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.255853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.255853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.312178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5c3b9c0-9f8f-4c3b-9db2-6f8d3e3dd809 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/ips" status: 200 len: 150 microversion: 2.1 time: 0.104220 Oct 04 21:39:09.332374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2962/6018] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:39:09 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/ips => generated 150 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:09.436032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a6fdb45-a134-4d80-b961-3cd73223e9a8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 204 len: 0 microversion: 2.1 time: 1.147741 Oct 04 21:39:09.440444 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3057/6019] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:08 2022] DELETE /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:39:09.451975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:09.453833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:09.470901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.473126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.474574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.477923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.479124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.480169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.875204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:09.891098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ea6f5f9-a1d6-40fe-86fe-5115f129a6d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1687 microversion: 2.1 time: 0.448390 Oct 04 21:39:09.896809 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2963/6020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:09 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1687 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:10.926737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:10.930230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:10.948910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:10.949758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:10.952082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:10.953286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:10.954523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:10.958733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:11.465275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:11.513983 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35704180-95e6-483e-a5a5-cebf3cafef18 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1568 microversion: 2.1 time: 0.592421 Oct 04 21:39:11.514704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3058/6021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:10 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1568 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:12.199823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf9bd5-9beb-498c-8a71-ae8fc058a1cb", "name": "network-vif-deleted", "tag": "a2ea6f21-1219-4a13-9366-9857461ad592"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:12.221713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:12.221713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:12.223511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:12.238073 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] Creating event network-vif-deleted:a2ea6f21-1219-4a13-9366-9857461ad592 for instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb on n-h1-851029-13 Oct 04 21:39:12.245990 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c499c2e3-127e-484c-984a-be3fc4a6d3cb req-c9043a69-05c8-49e7-9727-a896e3d23a8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049804 Oct 04 21:39:12.247466 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2964/6022] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:12.549728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:12.555600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:12.582790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:12.583692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:12.584999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:12.586358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:12.587157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:12.588013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:12.778816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:12.790581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-664e4aa2-daeb-4947-a7ed-abd976fad4fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 200 len: 1351 microversion: 2.1 time: 0.249056 Oct 04 21:39:12.792041 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3059/6023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:12 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 1351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:13.832003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.832818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: accf9bd5-9beb-498c-8a71-ae8fc058a1cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.842463 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.843083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.843759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.844794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.845416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.846041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.865314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] HTTP exception thrown: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Request method failure captured: Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb HTTP/1.1 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZVmI3T1VLzezIEF0m3sB9oiI1o_7H1a4LshFaP1jfNA3ZHLH6lyZGcafDeNgvfCX3Y6AnTkPcTs5gu0cYs_YsoQWmvJyUMnqCrWl6u-r4x83dGHptuJFGPiWtL5dpIh5no4Tsr4z5X6Z7y6p82bFX0CviBJmjkiPQSQWCx3S40T6Q Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0be5e41e86e74c2485502f4da34aa3b0 Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'accf9bd5-9beb-498c-8a71-ae8fc058a1cb'} Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.867116 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Returning 404 to user: Instance accf9bd5-9beb-498c-8a71-ae8fc058a1cb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bad984be-8240-4b2f-a4a4-f21869c644fd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb" status: 404 len: 111 microversion: 2.1 time: 0.042679 Oct 04 21:39:13.889302 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2965/6024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:13 2022] GET /compute/v2.1/servers/accf9bd5-9beb-498c-8a71-ae8fc058a1cb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:39:14.082770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc96976b-b68b-4c58-9cff-1d68592ef05e"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:14.096279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:14.105073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:14.105800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:14.106479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:14.107299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:14.107942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:14.108559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:14.164264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823b3ac6-a5b7-4d71-99f3-b2ed9b4e23ed", "device": "/dev/sdb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:14.167730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:14.182157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:14.182698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:14.183124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:14.183964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:14.184429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:14.184864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:15.706021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3369c92-7ca2-41b3-a9ba-da5609438f5f tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "POST /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.545879 Oct 04 21:39:15.707153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2966/6025] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:39:14 2022] POST /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e/os-volume_attachments => generated 194 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:15.790200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b79d10f9-538e-4a61-8bf2-7a9fe68f773f tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "POST /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.724340 Oct 04 21:39:15.791081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3060/6026] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:39:14 2022] POST /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 194 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:23.301124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-36eb4a82-d99d-4c5f-8018-4460f49138d9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '.version_select at 0x7f54f55e29d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:23.462767 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-36eb4a82-d99d-4c5f-8018-4460f49138d9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1087242951" status: 202 len: 0 microversion: 2.1 time: 0.172799 Oct 04 21:39:23.463682 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2967/6027] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 4 21:39:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1087242951 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:39:23.530508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85167e04-e3b3-4777-8d93-98ee7a94e0d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: .version_select at 0x7f54f5fbdf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1551304050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYYfEnyPxhfSkwM05ausFhGPMn7OCjiTYSlLiqvzm+lZ3KhEWt8t2J8KT/Ys3z+FaMf1ahykHqOdSnbLm+JeCMJ1aapmH9dY1kfEjX6qF+tKVma59ikY4TUOfvCfVqzHw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:23.559523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-85167e04-e3b3-4777-8d93-98ee7a94e0d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:39:23.570814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-85167e04-e3b3-4777-8d93-98ee7a94e0d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:39:23.704958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85167e04-e3b3-4777-8d93-98ee7a94e0d8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.183783 Oct 04 21:39:23.707189 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3061/6028] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:39:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:36.037266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:36.040260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:36.075861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:36.086170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:36.136084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.137059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.137823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.145015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.149119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.153838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.370251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'services' on Instance uuid fb548e7d-d127-4330-8910-120d545d7433 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:39:36.870850 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d363e363-9c43-4f6d-b8c9-4fcf4f9e0c4d tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments/dc96976b-b68b-4c58-9cff-1d68592ef05e" status: 202 len: 0 microversion: 2.1 time: 0.849318 Oct 04 21:39:36.876538 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2968/6029] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:39:36 2022] DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments/dc96976b-b68b-4c58-9cff-1d68592ef05e => generated 0 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:39:36.893494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:36.899471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:36.916316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:36.919482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:36.921885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:36.952522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.954103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.954985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.956131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.956961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.959760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:37.204887 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-750f5576-030e-4431-85dc-c8975d8b0504 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.326515 Oct 04 21:39:37.206832 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3062/6030] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:36 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:38.224616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:38.233945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:38.264637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:38.265041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:38.265672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:38.266925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:38.267955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:38.269009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:38.367862 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e6a4cf5-fe72-456d-aa17-560bd71105ea tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151568 Oct 04 21:39:38.376500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2969/6031] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:38 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:39.386198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:39.397420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:39.432943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.437349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.442110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.444453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.451326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.452278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.576107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-889ce0e2-df67-44fb-8498-6f64df22a906 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198759 Oct 04 21:39:39.577555 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3063/6032] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:39 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:40.243533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-170477748", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "e216ef94-7703-40d6-aa13-6689d42fbdc0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1551304050", "security_groups": [{"name": "tempest-secgroup-smoke-406083727"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:40.455024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] validate_networks() for [('e216ef94-7703-40d6-aa13-6689d42fbdc0', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:39:40.593131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:40.600226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:40.624561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:40.626078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:40.632163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:40.633398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:40.634294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:40.635245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:40.727388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c7def14-f0fd-4175-b591-a862f39eff84 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139573 Oct 04 21:39:40.738232 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3064/6033] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:40 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:41.753674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:41.756922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:41.783337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:41.784240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:41.784899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:41.786148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:41.803603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:41.805956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:41.942627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:39:41.956378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:39:41.957580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:39:41.958854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:39:41.959833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:39:41.992330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d6a74fb-4fd1-427b-935d-28dcc914c2d7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235744 Oct 04 21:39:41.994464 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3065/6034] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:41 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:42.006929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:42.007701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:42.015873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:42.017550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:42.018592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:42.019994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:42.101598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:39:42.124840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:39:42.177841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:39:42.193804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:39:42.466962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af06f42d-b485-4b67-9322-394e32afe06e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.233782 Oct 04 21:39:42.473293 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2970/6035] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:39:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:39:42.489956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e516c4b-9cfe-473b-bc49-4027bc13ba86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:42.507213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e516c4b-9cfe-473b-bc49-4027bc13ba86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:42.821752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e516c4b-9cfe-473b-bc49-4027bc13ba86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:42.878040 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e516c4b-9cfe-473b-bc49-4027bc13ba86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1266 microversion: 2.1 time: 0.395851 Oct 04 21:39:42.891291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3066/6036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:42 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:43.014713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:43.018948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:43.061501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.062390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.076344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.077895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.082197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.083535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.221531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27138b81-a94e-4a81-90c8-050776e83410 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216967 Oct 04 21:39:43.223046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2971/6037] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:43 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:43.921419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8198ea85-f896-41f2-b7b3-f2ba9b5c1fd8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:43.923320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8198ea85-f896-41f2-b7b3-f2ba9b5c1fd8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:44.088115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8198ea85-f896-41f2-b7b3-f2ba9b5c1fd8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:44.135684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8198ea85-f896-41f2-b7b3-f2ba9b5c1fd8 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1266 microversion: 2.1 time: 0.226410 Oct 04 21:39:44.175239 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3067/6038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:43 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:44.243611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:44.257429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:44.292655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.293555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.294374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:44.295842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.296716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.297504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:44.438420 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d06c3bc-bba1-4763-8ced-70022f183183 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202302 Oct 04 21:39:44.445179 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2972/6039] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:44 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:45.220370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:45.224702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:45.256614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.261330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.261330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.261330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.269273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.270286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.453089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:45.455649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:45.479144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.480173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.480820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.481748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.483109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.483866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.540467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:45.562218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02e2b0be-a8a5-4d68-9228-344c17c34b71 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113504 Oct 04 21:39:45.568879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2973/6040] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:45 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:45.577305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c507fcc-efaa-44f4-8320-fa937c4ae426 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1270 microversion: 2.1 time: 0.375379 Oct 04 21:39:45.604723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3068/6041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:45 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1270 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:46.584845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:46.608120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:46.638085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:46.642850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.643354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.647531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.649565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.654254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:46.654425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.654604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.684971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.685871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.686723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.688063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.688936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.689754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.784262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c99f883c-2908-4f66-8e6b-d4f1a0767386 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209122 Oct 04 21:39:46.797143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2974/6042] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:46 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:47.023467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:47.068939 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d207e0f3-e0f5-416e-a0d6-0c296b1318f2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1326 microversion: 2.1 time: 0.444413 Oct 04 21:39:47.084840 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3069/6043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:46 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1326 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:47.811863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:47.822248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:47.866130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:47.870372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:47.871261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.880361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:47.881354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:47.882113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.005678 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d7d0524-9cf9-4ff1-bdb5-ab33309917de tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205056 Oct 04 21:39:48.011924 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2975/6044] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:47 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:48.117146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:48.117869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:48.146049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.146710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.152330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.152993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.159389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.160448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.470415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:48.501241 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61539aa7-9c06-42f7-b28b-cbc98b9f9ec2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1324 microversion: 2.1 time: 0.391013 Oct 04 21:39:48.505674 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3070/6045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:48 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:49.026345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.040986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.062567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.071741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.072626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.074007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.075982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.076651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.173290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e25aaf1f-03ec-4d3d-9d02-7064365468ba tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156319 Oct 04 21:39:49.184363 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2976/6046] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:49.538300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.542419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.597850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.597850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.597850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.617485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.618177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.618850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.072344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.084405 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81fa2639-e6b7-4f60-a64a-4661197e9acd tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.553880 Oct 04 21:39:50.104310 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3071/6047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:50.201469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.205467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.224052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.224992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.225792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.227082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.227954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.228725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.306000 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1fcee3a7-54a1-40e4-aa85-1387e254f45c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118389 Oct 04 21:39:50.312081 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2977/6048] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:39:50.436435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.437204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.445623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.446492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.447171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.448113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.449576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.450951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.485654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:39:51.038625 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dfc4ed7e-d6b1-431c-ba63-60f34369a61c tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 204 len: 0 microversion: 2.1 time: 0.605389 Oct 04 21:39:51.048094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3072/6049] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:50 2022] DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:39:51.052452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:51.053273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:51.065171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.066527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.067649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.069241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.070292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.071286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.128302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:51.134046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:51.143252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.143872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.144335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.145168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.145709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.146153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.516094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:51.541516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11ccb613-7e5d-46f8-ae26-0a07b087c8bf tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1683 microversion: 2.1 time: 0.493752 Oct 04 21:39:51.543830 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2978/6050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:51 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1683 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:51.598930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:51.608903 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32ec7082-6f57-4008-a400-cb68685f44ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.498573 Oct 04 21:39:51.610065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3073/6051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:51 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:51.858290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:51.884304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.885617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.886791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.916619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] Creating event network-changed:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h1-851029-13 Oct 04 21:39:51.930951 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-81d6ecad-5866-41ee-b8b1-5b2431303df1 req-b9bec3c0-25bf-4c2a-853f-69f6a0cc1c65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080639 Oct 04 21:39:51.932152 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2979/6052] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:52.581560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:52.582005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:52.596672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:52.597312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:52.597867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.600384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:52.601336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:52.609755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.647514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:52.648289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:52.653619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:52.654322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:52.662710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:52.663461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:52.664102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.665021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:52.665837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:52.667568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.158708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:53.183576 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-575193fa-00ae-4d40-ace7-3a3ad2f74726 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1683 microversion: 2.1 time: 0.607025 Oct 04 21:39:53.185313 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3074/6053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:52 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1683 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:53.277887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:53.313947 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-151ed9e1-6435-45d6-8a3a-5400b8b2a9b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.666828 Oct 04 21:39:53.332374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2980/6054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:52 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:54.212385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:54.213538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:54.217178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:54.242688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.252091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.252964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.254275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.255861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.256590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.359473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:54.360606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:54.387442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.387949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.388538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.389311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.389839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.390287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.492296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:54.505607 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68d2fde9-a3ef-461d-b43a-6aaa067e2383 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1615 microversion: 2.1 time: 0.297843 Oct 04 21:39:54.508612 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3075/6055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:54 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1615 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:54.897974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:54.922143 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-baca478f-d2f6-43a6-9e40-e784e8f0a2ca tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.571108 Oct 04 21:39:54.923786 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2981/6056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:54 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:55.166171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb548e7d-d127-4330-8910-120d545d7433", "name": "network-vif-deleted", "tag": "55964248-edbc-48fd-893c-03f3071859e1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:55.178588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:55.183592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:55.184347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:55.207820 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] Creating event network-vif-deleted:55964248-edbc-48fd-893c-03f3071859e1 for instance fb548e7d-d127-4330-8910-120d545d7433 on n-h2-851029-13 Oct 04 21:39:55.224126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-222826d9-a834-4955-9662-9c04738cf1cc req-1b63ecff-6e6a-4ef0-82ea-354b9c7c5458 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062095 Oct 04 21:39:55.231160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3076/6057] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:55.551152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:55.552573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:55.563097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:55.563958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:55.565502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:55.566524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:55.568040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:55.568757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:55.737614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:55.773952 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e7404a0-4192-48b1-b1aa-48663fb987f6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1327 microversion: 2.1 time: 0.227451 Oct 04 21:39:55.778608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2982/6058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:55 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:55.978013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:55.980872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:56.000694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.001235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.001721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.017347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.018002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.018606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.310805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:56.329803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20bbf99e-8e30-4b46-a2d4-2457fa769174 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.370781 Oct 04 21:39:56.332675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3077/6059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:55 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:56.808927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:56.810409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:56.819120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.819926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.820726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.821867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.822358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.822826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.887585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:56.888694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:56.889150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:56.889889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lazy-loading 'fault' on Instance uuid fb548e7d-d127-4330-8910-120d545d7433 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:39:56.988027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e30a29012994c49bdd5ae23055d79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981af02d1644461ba7113a903b34b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:57.012548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60922198-ce65-492b-8051-bc6f8f91f5b2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 200 len: 1332 microversion: 2.1 time: 0.211485 Oct 04 21:39:57.014711 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2983/6060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:56 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:57.361972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:57.364314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:57.377749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:57.379011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:57.380690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:57.382314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:57.383521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:57.384554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:57.653752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:57.667843 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c996270-5619-4648-a9c5-191a92c5fb34 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.313328 Oct 04 21:39:57.669689 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3078/6061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:57 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:58.075176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:58.075176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:58.091400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:58.092424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:58.094358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.095710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:58.096323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:58.099916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.132439 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 HTTP/1.1 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fb548e7d-d127-4330-8910-120d545d7433'} Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:58.135784 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59a2ac50-3a8a-40e2-b658-ab6e935d951a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 404 len: 111 microversion: 2.1 time: 0.081420 Oct 04 21:39:58.146371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2984/6062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:58 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:58.152805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7090cc9-5487-4298-9168-7c275763c437 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '.version_select at 0x7f54f5f4cf70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:58.337925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7090cc9-5487-4298-9168-7c275763c437 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040454787" status: 202 len: 0 microversion: 2.1 time: 0.189864 Oct 04 21:39:58.339497 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3079/6063] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 21:39:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040454787 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:39:58.552719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "name": "network-vif-plugged", "status": "completed", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:58.590626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:58.591622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:58.592403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.624310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] Creating event network-vif-plugged:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h1-851029-13 Oct 04 21:39:58.634489 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-52eb4b71-9d05-4413-a1bb-ce2d2cce7a17 req-cc71c90a-e36a-4526-a8f2-0da300150fa5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088928 Oct 04 21:39:58.635604 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2985/6064] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:58.727114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:58.727820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:58.771283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:58.772288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:58.772937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.782103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:58.810772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:58.814779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:58.955914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:59.268320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:59.286111 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd055004-a5dc-4d37-ba73-5a9056543574 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.583818 Oct 04 21:39:59.300420 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3080/6065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:58 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:00.334256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:00.336486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:00.346494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:00.347183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:00.349887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:00.351812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:00.354197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:00.355100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:00.365508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:00.655549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:00.670413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5d1b6a4-a067-49a4-9ec6-b1778ee33f86 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.348954 Oct 04 21:40:00.671160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2986/6066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:00 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:01.705540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:01.706752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:01.729479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:01.730321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:01.731252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:01.732923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:01.733437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:01.734135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:02.018558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:02.048200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5f0ab9d-c2e6-4b8e-a7db-7bb1e75de06f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1391 microversion: 2.1 time: 0.350928 Oct 04 21:40:02.050296 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3081/6067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:01 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:03.090535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:03.091414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:03.113307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.114779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.115621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.117019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.117909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.121511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.383187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:03.397794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ff3bce0-077c-4144-93a8-3a24d2e1dd14 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1564 microversion: 2.1 time: 0.313934 Oct 04 21:40:03.398979 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2987/6068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:03 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1564 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:03.431006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:03.431894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:03.439902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.440390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.440832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.441557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:03.442118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:03.442555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:03.663737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:03.682956 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8b107d7-08f8-43d2-adb0-2317051ad99f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1564 microversion: 2.1 time: 0.256328 Oct 04 21:40:03.699103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3082/6069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:03 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:06.190398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:06.193179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:06.205964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.207403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.208509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.210103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.211287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.212525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.246088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 HTTP/1.1 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'fb548e7d-d127-4330-8910-120d545d7433'} Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:06.250112 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.260120 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.271438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:06.276863 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5a80d54-e1c1-47e0-bc2a-1db7d1781a17 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 404 len: 111 microversion: 2.1 time: 0.091627 Oct 04 21:40:06.283760 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2988/6070] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:06 2022] DELETE /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:06.300865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:06.302613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: fb548e7d-d127-4330-8910-120d545d7433] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:06.321934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.322866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.323672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.324502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:06.327139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:06.328457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:06.371027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 HTTP/1.1 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'fb548e7d-d127-4330-8910-120d545d7433'} Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:06.372993 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance fb548e7d-d127-4330-8910-120d545d7433 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35c7a6a5-b68f-4851-9b8d-52ed5814c241 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433" status: 404 len: 111 microversion: 2.1 time: 0.088737 Oct 04 21:40:06.389773 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3083/6071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:06 2022] GET /compute/v2.1/servers/fb548e7d-d127-4330-8910-120d545d7433 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:08.046149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.049321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.070397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:08.084243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.087529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.089759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.092875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.095622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.098446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.115027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:08.126554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:08.131508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.133488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.147829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.162903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.162903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.162903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.329860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lazy-loading 'services' on Instance uuid 0e024f0b-09c9-4cb1-aeea-51edae13776e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:40:08.486772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:08.500921 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10d868b4-282d-437f-8c36-3a3c1c03c074 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1564 microversion: 2.1 time: 0.389186 Oct 04 21:40:08.504487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3084/6072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:08 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1564 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:08.509968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:08.530144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:08.533486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:08.533486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:08.550886 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] Creating event network-changed:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h1-851029-13 Oct 04 21:40:08.559669 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b24c8ac2-2ecc-4981-aa80-3058fd06be9c req-26b85703-1e10-436e-89dc-0d13b178bd23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054450 Oct 04 21:40:08.560723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3085/6073] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:08.679293 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6a22e1aa-57fa-4542-9e31-5afcb7d72f11 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e/os-volume_attachments/823b3ac6-a5b7-4d71-99f3-b2ed9b4e23ed" status: 202 len: 0 microversion: 2.1 time: 0.644350 Oct 04 21:40:08.686749 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2989/6074] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:40:08 2022] DELETE /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e/os-volume_attachments/823b3ac6-a5b7-4d71-99f3-b2ed9b4e23ed => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:40:12.624229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:12.625592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:12.643175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:12.647168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.647925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.648560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.649638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.652531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.655460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.694103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f HTTP/1.1 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '17d8ccd8-a11b-4861-bac1-df719210648f'} Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:12.700084 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:12.710690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0dae46c1-7bdf-4979-acfc-7537a032f9b7 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 404 len: 111 microversion: 2.1 time: 0.087211 Oct 04 21:40:12.717349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3086/6075] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:12 2022] DELETE /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:12.725347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:12.726626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 17d8ccd8-a11b-4861-bac1-df719210648f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:12.758765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.772607 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.773616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.775256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.781947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.782883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.838757 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f HTTP/1.1 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '17d8ccd8-a11b-4861-bac1-df719210648f'} Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:12.852989 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 17d8ccd8-a11b-4861-bac1-df719210648f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32387bcc-a526-4fa6-b89e-de26d6b1215e tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f" status: 404 len: 111 microversion: 2.1 time: 0.143708 Oct 04 21:40:12.867954 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2990/6076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:12 2022] GET /compute/v2.1/servers/17d8ccd8-a11b-4861-bac1-df719210648f => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:12.869680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:12.877131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:12.910143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.911881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.912894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.914990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:12.916080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:12.930914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:12.990369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 HTTP/1.1 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c6e7a309-6bb7-499f-b7a5-ebab8d7c4851'} Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:13.000730 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d96ccb1-201c-4f67-bf81-c6c46027fcb2 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 404 len: 111 microversion: 2.1 time: 0.142272 Oct 04 21:40:13.010609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3087/6077] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:12 2022] DELETE /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:13.017994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:13.019196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: c6e7a309-6bb7-499f-b7a5-ebab8d7c4851] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:13.054061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:13.055007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:13.055796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:13.057097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:13.057879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:13.058645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:13.109774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 HTTP/1.1 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c6e7a309-6bb7-499f-b7a5-ebab8d7c4851'} Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:13.125390 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d36ac3d9-757a-449c-a7fe-d74c7db1e074 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851" status: 404 len: 111 microversion: 2.1 time: 0.117817 Oct 04 21:40:13.142713 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2991/6078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:13 2022] GET /compute/v2.1/servers/c6e7a309-6bb7-499f-b7a5-ebab8d7c4851 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:17.311831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:17.312720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:17.326483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.327761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.328765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.330373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.332426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.333441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.413788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:40:17.907072 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9b1c627-c85e-4759-9e8e-ac0441109ded tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 204 len: 0 microversion: 2.1 time: 0.601600 Oct 04 21:40:17.915189 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3088/6079] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:17 2022] DELETE /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:40:17.923947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:17.930765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:17.944074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.944983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.945735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:17.947517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:17.948469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:17.949357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:18.270292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:18.287125 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7295df9-6cc2-45e5-a716-abd79e518f26 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1512 microversion: 2.1 time: 0.369828 Oct 04 21:40:18.305706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2992/6080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:17 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:19.339851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:19.341373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:19.368843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.370551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.371779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:19.373982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:19.377017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:19.378438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:20.109775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:20.120381 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78116131-1e4f-4fe9-b6e2-b7e805875316 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1512 microversion: 2.1 time: 0.793844 Oct 04 21:40:20.137322 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3089/6081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:19 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1512 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:20.805034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e024f0b-09c9-4cb1-aeea-51edae13776e", "name": "network-vif-deleted", "tag": "050b35d4-a529-4046-872b-e5970da0efa8"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:20.854918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:20.857061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:20.857883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:20.895792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] Creating event network-vif-deleted:050b35d4-a529-4046-872b-e5970da0efa8 for instance 0e024f0b-09c9-4cb1-aeea-51edae13776e on n-h2-851029-13 Oct 04 21:40:20.910753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3dd6813d-e4b8-4e9d-a8d5-737c0c10f9e4 req-8527da60-1d3f-4e72-83b7-f26970819694 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115669 Oct 04 21:40:20.935067 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2993/6082] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:21.151625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:21.152733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:21.160422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.160958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.161639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.162689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:21.163602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:21.164348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:21.323142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:21.345135 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96f2071f-6a93-41a5-bb15-90b5e7134b71 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 200 len: 1303 microversion: 2.1 time: 0.199799 Oct 04 21:40:21.345828 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3090/6083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:21 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:21.984573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:21.985626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:21.998589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.000160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.000397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.001662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.002531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.003361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.031551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a HTTP/1.1 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '3885b224-a1d5-4fbb-b05b-f318b25bf34a'} Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:22.035232 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e56011e8-7ca6-4914-877c-a31e0fa2f1a6 tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 404 len: 111 microversion: 2.1 time: 0.061367 Oct 04 21:40:22.041817 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2994/6084] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:40:21 2022] DELETE /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:22.053598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:22.058184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] [instance: 3885b224-a1d5-4fbb-b05b-f318b25bf34a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:22.066899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.067842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.068655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.069936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.070812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.071596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.100700 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] HTTP exception thrown: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Request method failure captured: Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a HTTP/1.1 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZTl5rpKYTUhLYiSL22SWdrBmHeZNiVWGn4n59mUfoyRgIWA54MUP7UgXon31P5MfUmCnAXfQzUoN9x5kHe0cEPd2HGrwj0ZlRTDaKuZMqDLGX-glep2v1fnY1qgORXD0tZsaQcHbFX3xAh0ABugdZeCy09AQW5Tg3jHSUJZITSWdQ Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7981af02d1644461ba7113a903b34b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7981af02d1644461ba7113a903b34b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7981af02d1644461ba7113a903b34b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 7981af02d1644461ba7113a903b34b85 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-551345601 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4e30a29012994c49bdd5ae23055d79c6 Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-AttachVolumeNegativeTest-551345601-project Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3885b224-a1d5-4fbb-b05b-f318b25bf34a'} Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.104491 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] Returning 404 to user: Instance 3885b224-a1d5-4fbb-b05b-f318b25bf34a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:22.113568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80777f65-6d81-492c-b0a5-51e4c59b4c9a tempest-AttachVolumeNegativeTest-551345601 tempest-AttachVolumeNegativeTest-551345601-project] 10.222.0.36 "GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a" status: 404 len: 111 microversion: 2.1 time: 0.065140 Oct 04 21:40:22.120660 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3091/6085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:22 2022] GET /compute/v2.1/servers/3885b224-a1d5-4fbb-b05b-f318b25bf34a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:22.384643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:22.385233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: 0e024f0b-09c9-4cb1-aeea-51edae13776e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:22.411048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:22.439339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] HTTP exception thrown: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Request method failure captured: Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e HTTP/1.1 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKcgNucIufJAsv3kWHTxnHj3aOcTledisTONBisnVMnJGIiJIVGk65fGmNwXp6eCjzI6R4m19CmDR3VPA_V7CDjmCDPDQbHtbIc3TOmtNpfVwWTYC7V3RzAjP72vXdtEZEq1yQJzLVEWOx_0j4paKnHNpWDdbu-yfN6qom3lgzDD9Yc Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 0c57efa4358f4402a793bc5d1587fd72 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 0c57efa4358f4402a793bc5d1587fd72 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesSnapshotTestJSON-179693554-project Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 12f8d3765d91445886264c636a923fc8 Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesSnapshotTestJSON-179693554-project Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '0e024f0b-09c9-4cb1-aeea-51edae13776e'} Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:22.450338 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Returning 404 to user: Instance 0e024f0b-09c9-4cb1-aeea-51edae13776e could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:22.467623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71ea314e-3101-422f-8ee9-17c85a6d6106 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e" status: 404 len: 111 microversion: 2.1 time: 0.074188 Oct 04 21:40:22.474486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2995/6086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:22 2022] GET /compute/v2.1/servers/0e024f0b-09c9-4cb1-aeea-51edae13776e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:40:32.890390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:32.892830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:33.211535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f679f521-7963-4aca-9054-95cdc41e1f9c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Action: 'create', calling method: .version_select at 0x7f54f5871430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1981344923"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:34.272110 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f679f521-7963-4aca-9054-95cdc41e1f9c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.387243 Oct 04 21:40:34.278785 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3092/6087] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Oct 4 21:40:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 21:40:34.298185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb6ec8be-38f6-4ec4-8a31-d62522021109 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54fa640d30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:34.310572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=13 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:34.314509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:34.363160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb6ec8be-38f6-4ec4-8a31-d62522021109 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 345 microversion: 2.1 time: 0.071481 Oct 04 21:40:34.364436 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2996/6088] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:34 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:35.391138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf3d0258-8825-490d-a46c-0bf29f78881d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5832d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:35.475640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf3d0258-8825-490d-a46c-0bf29f78881d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 345 microversion: 2.1 time: 0.093175 Oct 04 21:40:35.476388 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3093/6089] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:35 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:35.618641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2137533274", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "3692c330-581b-4ef5-9ab1-9d8bb86909a1"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:35.704224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] validate_networks() for [('3692c330-581b-4ef5-9ab1-9d8bb86909a1', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:40:36.240708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:40:36.241260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:40:36.241889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:40:36.242596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:40:36.243489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:40:36.260253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:36.261408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:36.262048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:36.263581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:36.264678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:36.265688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:36.302118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Getting quotas for project 0c57efa4358f4402a793bc5d1587fd72. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:40:36.311577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Getting quotas for user 12f8d3765d91445886264c636a923fc8 and project 0c57efa4358f4402a793bc5d1587fd72. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:40:36.334448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:40:36.337316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:40:36.499185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-304a6fa0-2e62-465f-ab8e-205ed7b88d1a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5871d30>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:36.557954 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-304a6fa0-2e62-465f-ab8e-205ed7b88d1a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 346 microversion: 2.1 time: 0.064035 Oct 04 21:40:36.558555 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3094/6090] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:36 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:36.582927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d5a98bfa-131d-44b8-96b4-efa167771e76 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Action: 'create', calling method: .version_select at 0x7f54f5483af0>, body: {"snapshot": {"volume_id": "93e33bf2-1096-4df3-a291-9953960fa320", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2046231018"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:36.603903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-14d06ed4-d970-45ee-9dd1-ce3428eaf6dd tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993012 Oct 04 21:40:36.610535 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2997/6091] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:40:36.627160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-882aa85c-0163-41df-8add-5ed0e2eb4088 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:36.628255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-882aa85c-0163-41df-8add-5ed0e2eb4088 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:36.695319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-882aa85c-0163-41df-8add-5ed0e2eb4088 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:36.705841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-882aa85c-0163-41df-8add-5ed0e2eb4088 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1219 microversion: 2.1 time: 0.084546 Oct 04 21:40:36.706621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2998/6092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:36 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:37.417103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d5a98bfa-131d-44b8-96b4-efa167771e76 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.841725 Oct 04 21:40:37.421115 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3095/6093] 10.222.0.36 () {60 vars in 1162 bytes} [Tue Oct 4 21:40:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:37.438821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c337f562-84d3-473b-967b-5a9f02df4c1a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54fa4d4700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:37.480073 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c337f562-84d3-473b-967b-5a9f02df4c1a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.049252 Oct 04 21:40:37.481937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2999/6094] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:37 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:37.498214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f0e085a-9939-4cb5-8841-38f30cef4324 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5688f70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:37.562573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f0e085a-9939-4cb5-8841-38f30cef4324 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.063205 Oct 04 21:40:37.562573 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3096/6095] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 4 21:40:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:37.574505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8230444d-d386-4081-8bfb-d6692688caff tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f61c68b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:37.622503 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8230444d-d386-4081-8bfb-d6692688caff tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.057149 Oct 04 21:40:37.626365 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3000/6096] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:37 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:37.730296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b54ba709-a094-468e-8322-733c5d0e1814 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:37.731104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b54ba709-a094-468e-8322-733c5d0e1814 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:37.842835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b54ba709-a094-468e-8322-733c5d0e1814 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:37.854459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b54ba709-a094-468e-8322-733c5d0e1814 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1219 microversion: 2.1 time: 0.128539 Oct 04 21:40:37.857414 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3097/6097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:37 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:38.649899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb6f8983-9369-4edc-93d6-ca114a372b5d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f62633a0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:38.717609 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb6f8983-9369-4edc-93d6-ca114a372b5d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.079290 Oct 04 21:40:38.722627 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3001/6098] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:38 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:38.891437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7a99c4b-b973-4fb7-8b1e-177892dac61b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:38.894217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7a99c4b-b973-4fb7-8b1e-177892dac61b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:39.006017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7a99c4b-b973-4fb7-8b1e-177892dac61b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:39.027705 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7a99c4b-b973-4fb7-8b1e-177892dac61b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1219 microversion: 2.1 time: 0.145620 Oct 04 21:40:39.029724 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3098/6099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:38 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:39.120171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:39.124212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:39.136395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.137190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.138147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:39.139478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:39.140329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:39.141070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:39.225845 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecf5c13d-d99e-481f-a8f1-9fc46c4f996f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action" status: 200 len: 24561 microversion: 2.1 time: 0.113415 Oct 04 21:40:39.226935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3002/6100] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:40:39 2022] POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action => generated 24561 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:40:39.741018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-567b9265-7689-44ea-bc5b-0b6c6cf1a67a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f6135940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:39.824893 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-567b9265-7689-44ea-bc5b-0b6c6cf1a67a tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.091333 Oct 04 21:40:39.830256 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3099/6101] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:39 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:40.055095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9eb77d1-a8bb-4b03-acf8-9716135b7f9b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.055928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9eb77d1-a8bb-4b03-acf8-9716135b7f9b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.127008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9eb77d1-a8bb-4b03-acf8-9716135b7f9b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:40.136632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9eb77d1-a8bb-4b03-acf8-9716135b7f9b tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1219 microversion: 2.1 time: 0.086866 Oct 04 21:40:40.137267 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3003/6102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:40 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:40.838444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0531a9c-00c4-486e-aade-f9543da73230 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f61c2940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:40.880181 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0531a9c-00c4-486e-aade-f9543da73230 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 288 microversion: 2.1 time: 0.046877 Oct 04 21:40:40.881373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3100/6103] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:40 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:40.898704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5085c0df-9d99-4ec4-8167-4c200f7eae3e tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5732040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:41.117099 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5085c0df-9d99-4ec4-8167-4c200f7eae3e tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 202 len: 0 microversion: 2.1 time: 0.224752 Oct 04 21:40:41.118161 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3004/6104] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 21:40:40 2022] DELETE /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:40:41.131340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18ae944c-d734-4815-85a4-e1c7e3b8b3f2 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5f4c3a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:41.180282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:41.181721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:41.187668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18ae944c-d734-4815-85a4-e1c7e3b8b3f2 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.062094 Oct 04 21:40:41.196069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:41.196745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:41.210006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3101/6105] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:41 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:41.210248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:41.210248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:41.210248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:41.210248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:41.321248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:41.340051 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76eab069-3ada-4a0c-bbff-1c62d4399ff8 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1223 microversion: 2.1 time: 0.165095 Oct 04 21:40:41.340051 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3005/6106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:41 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:42.211756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19b1f7f2-799e-412d-92ad-7366e5427b45 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f61c29d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:42.274406 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19b1f7f2-799e-412d-92ad-7366e5427b45 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.072389 Oct 04 21:40:42.279202 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3102/6107] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:42 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:42.364910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:42.366144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:42.375749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:42.377417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:42.382434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:42.383492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:42.384053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:42.384533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:42.477593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:42.496992 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e815aa2-8767-4e0b-a4a8-277a58a89aa9 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1223 microversion: 2.1 time: 0.135604 Oct 04 21:40:42.509364 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3006/6108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:42 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:43.301884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3e026d1-1093-49c8-9b9f-fd25b2ed47ed tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5f4c700>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:43.340949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3e026d1-1093-49c8-9b9f-fd25b2ed47ed tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 200 len: 287 microversion: 2.1 time: 0.046202 Oct 04 21:40:43.341714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3103/6109] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:43 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:43.540235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:43.541084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:43.553967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:43.554627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:43.555388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:43.556640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:43.557169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:43.557605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:43.647237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:43.659268 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56560f96-a5a0-48cf-8e5c-06c54d208b50 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1271 microversion: 2.1 time: 0.123519 Oct 04 21:40:43.660688 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3007/6110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:43 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:44.360883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c37e6c2-b2f0-41df-b690-2550b0c36e67 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f52ab820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.433828 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8c37e6c2-b2f0-41df-b690-2550b0c36e67 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] HTTP exception thrown: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c37e6c2-b2f0-41df-b690-2550b0c36e67 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Request method failure captured: Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 HTTP/1.1 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKhQZ1vqmH1_MRJfLQrP7imJQDUjR96iF8OXnYyBvOQfXQ8PC8jVcRoZo-U_Jy7HaJ2NLwBhe1FZtJgFnqDkpx5gCiT5sm6oXEjkE93EfqS198npkXSKKwsWghLPj0s3a7dgldeWk5AZTLiCodzQQ7VtY4e3HLW7vW3gzujNAdnLato Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4263ad278a214b87ba7fe55328556440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4263ad278a214b87ba7fe55328556440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 0e7038ff809e45a0821ac9ba643518e5 Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: exception: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1'} Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. (HTTP 404) (Request-ID: req-fe1f9d36-0a9a-404b-9525-6041b77f2db2) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:40:44.456400 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c37e6c2-b2f0-41df-b690-2550b0c36e67 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Returning 404 to user: Snapshot e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c37e6c2-b2f0-41df-b690-2550b0c36e67 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1" status: 404 len: 111 microversion: 2.1 time: 0.107759 Oct 04 21:40:44.466225 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3104/6111] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 4 21:40:44 2022] GET /compute/v2.1/os-snapshots/e8d8f4e2-6aa4-43ad-b98f-3a00bb11cea1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:40:44.473380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d0f9d0b-45b8-4998-ae52-b79affc066f7 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5732700>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.695793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.696655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:44.705741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:44.706128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:44.706833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:44.708122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:44.708719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:44.709350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:44.804648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:44.821337 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e45d6af3-5302-4b6c-bf91-f537881a4780 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1277 microversion: 2.1 time: 0.130183 Oct 04 21:40:44.827581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3105/6112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:44 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:44.854149 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d0f9d0b-45b8-4998-ae52-b79affc066f7 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 202 len: 0 microversion: 2.1 time: 0.386290 Oct 04 21:40:44.857406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3008/6113] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:40:44 2022] DELETE /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:40:44.869928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9cf428c-bddb-4d0a-acba-ed3dbe6bcfdb tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f639e0d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:44.931864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9cf428c-bddb-4d0a-acba-ed3dbe6bcfdb tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 345 microversion: 2.1 time: 0.067624 Oct 04 21:40:44.932546 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3106/6114] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:44 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:45.861108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:45.862955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:45.875676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.876805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.878442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.880071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:45.881081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:45.881989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:45.954268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bded7d04-78d2-4d1f-b009-707880f53dfd tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5fc01f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:46.084227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bded7d04-78d2-4d1f-b009-707880f53dfd tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 345 microversion: 2.1 time: 0.136610 Oct 04 21:40:46.093685 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3107/6115] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:45 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:46.275672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:46.302404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:46.317271 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1c968ff-75dc-4d34-9f8b-d8726841ee06 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.461610 Oct 04 21:40:46.320876 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3009/6116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:45 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:47.107961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a29f3671-8a40-413e-bcf1-248f0af32663 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f52aba60>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:47.171626 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a29f3671-8a40-413e-bcf1-248f0af32663 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 200 len: 345 microversion: 2.1 time: 0.071018 Oct 04 21:40:47.172813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3108/6117] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:47 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:47.356787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:47.360224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:47.367297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f32645-6ffb-41da-a6a2-91f4cee8a7d2", "tag": "d187dd53-ca2a-4b29-8e03-585e08dc4ab7"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:47.372831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:47.374100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:47.375277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:47.376986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:47.378129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:47.380091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:47.390841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:47.392798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:47.394327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:47.413593 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] Creating event network-changed:d187dd53-ca2a-4b29-8e03-585e08dc4ab7 for instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 on n-h2-851029-13 Oct 04 21:40:47.420592 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-de23a9cf-df9b-4491-9115-2a30a6cc381e req-58ff81ef-2cdc-4824-85d2-f6026db6c4f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075026 Oct 04 21:40:47.422755 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3010/6118] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:47.759810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:47.771047 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-714dd7cb-0bf9-41c2-a8fd-66d80c327cd6 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.423941 Oct 04 21:40:47.771974 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3109/6119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:47 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:48.191247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-400ce2b4-28f1-418d-b78f-7bff9b15eb6c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5f44550>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:48.230054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-400ce2b4-28f1-418d-b78f-7bff9b15eb6c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] HTTP exception thrown: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-400ce2b4-28f1-418d-b78f-7bff9b15eb6c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Request method failure captured: Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 HTTP/1.1 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKhQZ1vqmH1_MRJfLQrP7imJQDUjR96iF8OXnYyBvOQfXQ8PC8jVcRoZo-U_Jy7HaJ2NLwBhe1FZtJgFnqDkpx5gCiT5sm6oXEjkE93EfqS198npkXSKKwsWghLPj0s3a7dgldeWk5AZTLiCodzQQ7VtY4e3HLW7vW3gzujNAdnLato Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4263ad278a214b87ba7fe55328556440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4263ad278a214b87ba7fe55328556440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0e7038ff809e45a0821ac9ba643518e5 Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '93e33bf2-1096-4df3-a291-9953960fa320'} Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. (HTTP 404) (Request-ID: req-1c9bcbfa-8b83-41f4-98b6-d07d13580e82) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:40:48.232570 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-400ce2b4-28f1-418d-b78f-7bff9b15eb6c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Returning 404 to user: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-400ce2b4-28f1-418d-b78f-7bff9b15eb6c tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 404 len: 109 microversion: 2.1 time: 0.049695 Oct 04 21:40:48.258536 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3011/6120] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:48 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:48.264703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19486566-995a-4110-9595-b464aa08d79d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5fc0af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:48.295303 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-19486566-995a-4110-9595-b464aa08d79d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] HTTP exception thrown: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19486566-995a-4110-9595-b464aa08d79d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Request method failure captured: Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 HTTP/1.1 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKhQZ1vqmH1_MRJfLQrP7imJQDUjR96iF8OXnYyBvOQfXQ8PC8jVcRoZo-U_Jy7HaJ2NLwBhe1FZtJgFnqDkpx5gCiT5sm6oXEjkE93EfqS198npkXSKKwsWghLPj0s3a7dgldeWk5AZTLiCodzQQ7VtY4e3HLW7vW3gzujNAdnLato Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4263ad278a214b87ba7fe55328556440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4263ad278a214b87ba7fe55328556440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 0e7038ff809e45a0821ac9ba643518e5 Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: method: Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: exception: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '93e33bf2-1096-4df3-a291-9953960fa320'} Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. (HTTP 404) (Request-ID: req-ea60bf9e-9c39-4048-91e3-aaf5b09f2848) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:40:48.300699 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19486566-995a-4110-9595-b464aa08d79d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Returning 404 to user: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19486566-995a-4110-9595-b464aa08d79d tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 404 len: 109 microversion: 2.1 time: 0.061360 Oct 04 21:40:48.306997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3110/6121] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 4 21:40:48 2022] DELETE /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:48.314723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-392e7036-94ad-44d0-9a53-06463d51f011 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Calling method '.version_select at 0x7f54f5002ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:48.354480 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-392e7036-94ad-44d0-9a53-06463d51f011 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] HTTP exception thrown: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-392e7036-94ad-44d0-9a53-06463d51f011 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Request method failure captured: Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 HTTP/1.1 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKhQZ1vqmH1_MRJfLQrP7imJQDUjR96iF8OXnYyBvOQfXQ8PC8jVcRoZo-U_Jy7HaJ2NLwBhe1FZtJgFnqDkpx5gCiT5sm6oXEjkE93EfqS198npkXSKKwsWghLPj0s3a7dgldeWk5AZTLiCodzQQ7VtY4e3HLW7vW3gzujNAdnLato Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4263ad278a214b87ba7fe55328556440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4263ad278a214b87ba7fe55328556440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4263ad278a214b87ba7fe55328556440"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 4263ad278a214b87ba7fe55328556440 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-263633189 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0e7038ff809e45a0821ac9ba643518e5 Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-263633189-project Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: method: Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: exception: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '93e33bf2-1096-4df3-a291-9953960fa320'} Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. (HTTP 404) (Request-ID: req-ec4de2b5-fa74-4083-bed0-5a1e1a78bf78) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:40:48.356719 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. Oct 04 21:40:48.362444 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:40:48.370608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-392e7036-94ad-44d0-9a53-06463d51f011 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] Returning 404 to user: Volume 93e33bf2-1096-4df3-a291-9953960fa320 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:48.372462 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-392e7036-94ad-44d0-9a53-06463d51f011 tempest-VolumesSnapshotsTestJSON-263633189 tempest-VolumesSnapshotsTestJSON-263633189-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320" status: 404 len: 109 microversion: 2.1 time: 0.062072 Oct 04 21:40:48.373406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3012/6122] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 4 21:40:48 2022] GET /compute/v2.1/os-volumes/93e33bf2-1096-4df3-a291-9953960fa320 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:40:48.800405 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:40:48.800669 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:40:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 (ip 10.222.0.36) !!! Oct 04 21:40:48.822700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:48.824923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:48.836595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:48.837498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:48.838308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:48.839952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:48.840780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:48.841569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:49.016309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:49.063652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:49.073716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a79ee57-cdb6-4a62-a32b-646fd3fb7454 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.274451 Oct 04 21:40:49.082142 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3111/6123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:48 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:50.101800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:50.103401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:50.115708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:50.117008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:50.117692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:50.119083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:50.119932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:50.120578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:50.141988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:50.334257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:50.343200 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c867dfb1-825d-46e6-ba12-d94ab559f04c tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.248434 Oct 04 21:40:50.343732 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3013/6124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:50 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:51.373547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:51.375414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:51.389803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.392577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.395148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.396922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.398028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.399114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.693116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:51.714566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25011ebf-d4fd-4bfe-88fe-90ed9f9d56b2 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.347563 Oct 04 21:40:51.727128 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3112/6125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:51 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:52.742565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:52.743323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:52.751995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:52.753046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:52.753869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:52.754474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:52.754962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:52.755481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.000568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:53.021369 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be2145c4-d2c6-4413-aa16-a1efd9c19ed1 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.282503 Oct 04 21:40:53.022839 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3014/6126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:52 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:53.336267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f32645-6ffb-41da-a6a2-91f4cee8a7d2", "name": "network-vif-plugged", "status": "completed", "tag": "d187dd53-ca2a-4b29-8e03-585e08dc4ab7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:53.359439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:53.360236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:53.361199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.378865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] Creating event network-vif-plugged:d187dd53-ca2a-4b29-8e03-585e08dc4ab7 for instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 on n-h2-851029-13 Oct 04 21:40:53.390022 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-af674385-3bcc-4741-b784-10b86fc31ef7 req-dce7daad-0930-4daa-9d54-55c8fe3ee8c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058053 Oct 04 21:40:53.390695 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3113/6127] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:40:54.058557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:54.059715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:54.069226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.069812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.070512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:54.071515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.071984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.072919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:54.279193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:54.293498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3b1a8f3-608b-4737-89ee-848a087189f5 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1319 microversion: 2.1 time: 0.239799 Oct 04 21:40:54.294778 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3015/6128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:54 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:55.337251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:55.338865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:55.364638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.365612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.366432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.367960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.368784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.371280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.583064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:55.592432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f167af02-3640-4590-9a07-c3935adc2406 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1506 microversion: 2.1 time: 0.265615 Oct 04 21:40:55.593115 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3114/6129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:55 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:55.617718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3adab83a-3eda-4a0b-bea0-bb4bfd076175", "device": "/dev/sdb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:55.620277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:55.629304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.630495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.630753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.632883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.632883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.633552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.829521 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30cbfe85-4e90-46cb-baa8-c15d246fd02a tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "POST /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215353 Oct 04 21:40:56.830705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3016/6130] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 21:40:55 2022] POST /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:02.302201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1657871576", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:02.393562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:41:03.042078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:41:03.042864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:41:03.043772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:41:03.044780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:41:03.045541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:41:03.052413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=24 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:03.066544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.067387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.068549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:03.070091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.071293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.072434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:03.109467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Getting quotas for project 682369808e9f4a9fb7c1b5f211de066f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:03.124396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Getting quotas for user 96d37c3f69384c659a03936dac7fef65 and project 682369808e9f4a9fb7c1b5f211de066f. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:03.165616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:41:03.168463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:41:03.430311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ca0c37c-1df6-4ed0-8b5d-44ede02b4e20 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132133 Oct 04 21:41:03.433028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3115/6131] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:41:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:41:03.447012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6e45047-8a3a-471f-b9f6-42e0911cc557 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:03.448619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6e45047-8a3a-471f-b9f6-42e0911cc557 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:03.549828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6e45047-8a3a-471f-b9f6-42e0911cc557 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:03.563153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6e45047-8a3a-471f-b9f6-42e0911cc557 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1215 microversion: 2.1 time: 0.121198 Oct 04 21:41:03.564904 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3017/6132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:03 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:04.594595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8e517fbb-cff9-43d8-af7a-ba552a4319c9 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:04.595369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8e517fbb-cff9-43d8-af7a-ba552a4319c9 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:04.656315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8e517fbb-cff9-43d8-af7a-ba552a4319c9 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:04.664418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8e517fbb-cff9-43d8-af7a-ba552a4319c9 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1215 microversion: 2.1 time: 0.075055 Oct 04 21:41:04.665193 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3116/6133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:04 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:05.695762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:05.698819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:05.721421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:05.729449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.735998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.740208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.742714 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.745344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.760182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.787752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:05.886353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:05.921231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2d002ba-c3a7-4ce3-9875-f69763d83bdc tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1219 microversion: 2.1 time: 0.231305 Oct 04 21:41:05.926044 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3018/6134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:05 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:06.954340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:06.956313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:06.971242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.972605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.973424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:06.974610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.975272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.975947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.086718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:07.115751 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c473fefc-19a7-4086-a8be-70f545fcc22a tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1267 microversion: 2.1 time: 0.168458 Oct 04 21:41:07.116861 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3117/6135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:06 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:08.167834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:08.168495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:08.178893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.179428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.179875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.180651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:08.181792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:08.182222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.268644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:08.280020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8dab0bd0-e13f-47f3-ac46-5f3e7f49a7b3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1273 microversion: 2.1 time: 0.118294 Oct 04 21:41:08.280651 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3019/6136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:08 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:09.324774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:09.326825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:09.344211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:09.346253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:09.347422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:09.348727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:09.349747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:09.350799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:09.582260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:09.602037 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1313fbed-4af8-43e9-9cab-0bf6fdab3a1d tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.284359 Oct 04 21:41:09.605451 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3118/6137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:09 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:10.643892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:10.646373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:10.661854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.662829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.663943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.665548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.666482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.667364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.780047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4950bf9f-f163-4b5d-9e49-9fb974cb3cc9", "tag": "96395182-c0d5-4140-95e5-205d7910a850"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:10.813211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.817058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.817828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.868899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] Creating event network-changed:96395182-c0d5-4140-95e5-205d7910a850 for instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 on n-h1-851029-13 Oct 04 21:41:10.902461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-003c1d16-fb40-491d-b165-020b20fdc2a2 req-f1b7df49-b406-44a4-834a-1199ed9385b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126595 Oct 04 21:41:10.915103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3119/6138] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:11.066246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:11.083595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dbfa65a6-ade8-44ec-b201-a76b091219a3 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.451756 Oct 04 21:41:11.091966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3020/6139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:10 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:12.113325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:12.114429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:12.126366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.127794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.128581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:12.130018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.131489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.132334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:12.395339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:12.421380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-001b2447-6846-4d29-a94f-823c12fffc21 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.306412 Oct 04 21:41:12.426274 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3120/6140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:12 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:13.449978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:13.465344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:13.475743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:13.477543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:13.479179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:13.483033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:13.484134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:13.485496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:13.559645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:13.762897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:13.781337 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0f2ff8a-691c-47c8-a51f-b5ce3686199c tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.341900 Oct 04 21:41:13.782825 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3021/6141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:13 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:14.830715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:14.833465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:14.839014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:14.842341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:14.855747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.856808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.858060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.860248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.862267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.863284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.868771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=55 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:15.195169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:15.208202 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d26f185-29bd-4e52-998c-912e4359a812 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.387760 Oct 04 21:41:15.213078 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3121/6142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:14 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:16.251566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:16.255694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:16.271038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.272583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.273377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:16.274945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.276056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.277096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:16.585899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:16.585899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8567ab1-3ea7-4747-b904-df54d934210e tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.326816 Oct 04 21:41:16.585899 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3022/6143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:16 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:17.606943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:17.609519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:17.634236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:17.635333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:17.636251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:17.637226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:17.637885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:17.638927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:17.930027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:17.940556 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-949304fd-9dba-4fa1-8670-d056b78b02e5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.343021 Oct 04 21:41:17.951719 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3122/6144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:17 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:18.400991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:18.410040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:18.434176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:18.436022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:18.436022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:18.436693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:18.437281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:18.437892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:18.774364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:18.797125 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1204d7f4-55b7-43c2-8a7a-74dc9f69cc8a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1683 microversion: 2.1 time: 0.406078 Oct 04 21:41:18.799363 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3023/6145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:18 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1683 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:18.816746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4950bf9f-f163-4b5d-9e49-9fb974cb3cc9", "name": "network-vif-plugged", "status": "completed", "tag": "96395182-c0d5-4140-95e5-205d7910a850"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:18.838108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:18.843555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:18.848497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:18.879270 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] Creating event network-vif-plugged:96395182-c0d5-4140-95e5-205d7910a850 for instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 on n-h1-851029-13 Oct 04 21:41:18.891725 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4265b2a4-bc2b-4855-946f-96943ea7d05a req-f5a139b4-22de-4482-aba9-2fe3d4d37bf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078915 Oct 04 21:41:18.897006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3123/6146] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:18.994913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:18.998504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:19.018288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:19.035249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:19.039560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.040055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.040490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.041264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.041890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.042158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.046320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.049250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.050081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.051302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.051692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.055657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.168631 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5ca6aa4-8732-4088-925e-8fab29ea3380 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action" status: 200 len: 32636 microversion: 2.1 time: 0.161538 Oct 04 21:41:19.169853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3124/6147] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:41:19 2022] POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action => generated 32636 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:41:19.338520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:19.340244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:19.350814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.351767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.353496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.354397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.355191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.355794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.459168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:19.487454 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eed0500e-0252-49da-b986-b13af2315908 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.510450 Oct 04 21:41:19.488135 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3024/6148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:18 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:19.842599 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f65382e1-49af-4ce8-a6ed-425996d57b6e tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1836 microversion: 2.1 time: 0.509858 Oct 04 21:41:19.846132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3125/6149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:19 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1836 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:19.901222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:19.908667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:19.923299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.923299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.923299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.923299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:19.928123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:19.929008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:19.982620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lazy-loading 'flavor' on Instance uuid 5224132b-0ebf-4489-95cf-e1cc1a98dccf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:20.018848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Going to try to live migrate instance to another host {{(pid=123542) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:41:20.530431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:20.539594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:20.584457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:20.585285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:20.586069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:20.589339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:20.591314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:20.593180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:21.392067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:21.413991 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07567e45-b2f5-44f5-82e6-68fc60a01f54 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1315 microversion: 2.1 time: 0.889251 Oct 04 21:41:21.421758 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3126/6150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:20 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:22.446979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:22.448467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:22.496524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:22.496524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:22.496524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:22.496524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:22.496524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:22.497416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:22.773144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:22.789011 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7128e98-08dc-4a4b-9bfe-20c4cab0e1f0 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1464 microversion: 2.1 time: 0.351406 Oct 04 21:41:22.799230 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3127/6151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:22 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:22.875204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:22.875831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:22.886509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:22.886509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:22.886509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:22.888614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:22.888782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:22.889101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:22.940240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:23.567455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9aca390d-924d-41b9-adb1-073234751f05 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 204 len: 0 microversion: 2.1 time: 0.693777 Oct 04 21:41:23.571781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3128/6152] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:22 2022] DELETE /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:41:23.590620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:23.593567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:23.610744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:23.612431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:23.613368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:23.615009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:23.615837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:23.616629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:23.871116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:23.882258 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef01e139-fdcd-4621-8e3d-8f80fca0b704 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1470 microversion: 2.1 time: 0.302909 Oct 04 21:41:23.883175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3129/6153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:23 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:24.919346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:24.921739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:24.936059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:24.937401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:24.938615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:24.940053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:24.940951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:24.941708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:25.238856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:25.248990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02d8826b-f0f3-45cd-9010-21d2a68329f5 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1470 microversion: 2.1 time: 0.337154 Oct 04 21:41:25.250918 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3130/6154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:24 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:26.292011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:26.293395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:26.311755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:26.314595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:26.316062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:26.318117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:26.319513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:26.321054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:26.618126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:26.662559 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4da9e040-840a-4d31-8519-3d4fd498a7a2 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1470 microversion: 2.1 time: 0.376416 Oct 04 21:41:26.682879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3131/6155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:26 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1470 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:26.835581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4950bf9f-f163-4b5d-9e49-9fb974cb3cc9", "name": "network-vif-deleted", "tag": "96395182-c0d5-4140-95e5-205d7910a850"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:26.857862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:26.866338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:26.868189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:26.894587 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] Creating event network-vif-deleted:96395182-c0d5-4140-95e5-205d7910a850 for instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 on n-h1-851029-13 Oct 04 21:41:26.903177 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e19971a8-b9be-4a99-9e7c-f85dcac32c05 req-627a4fe4-e274-4ce4-a8d4-f69d392b6896 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078783 Oct 04 21:41:26.904512 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3132/6156] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:26.907214 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-792983fa-1941-47f7-8b1d-9cf813de754a tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action" status: 202 len: 0 microversion: 2.1 time: 7.007537 Oct 04 21:41:26.912805 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3025/6157] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:41:19 2022] POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action => generated 0 bytes in 7019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:41:26.932988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:26.934397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:26.942801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:26.945660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:26.946756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:26.947736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:26.948587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:26.949241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.218234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:27.233578 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64849c2f-acca-480e-a4ca-48958300bfd6 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.308000 Oct 04 21:41:27.234618 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3133/6158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:26 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:27.707825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:27.708171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:27.727585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.728131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.734175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.736993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.737536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.737985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.833649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.834581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.836667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.845679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lazy-loading 'fault' on Instance uuid 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:28.103712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d37c3f69384c659a03936dac7fef65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '682369808e9f4a9fb7c1b5f211de066f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:28.125679 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76bc955c-f44e-4dc7-93d9-b0cead19b943 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 200 len: 1305 microversion: 2.1 time: 0.422406 Oct 04 21:41:28.126918 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3026/6159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:27 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 1305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:28.271082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:28.274981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:28.297298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:28.301829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:28.302903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:28.304382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:28.318107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:28.323947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:28.809750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:28.830021 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1f7e6ef-0ab9-48cb-a4d3-525a23de1004 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.569933 Oct 04 21:41:28.831549 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3134/6160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:28 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:29.187915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:29.190700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] [instance: 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:29.211648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.214415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.215928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.220404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.222218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.223547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.263004 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] HTTP exception thrown: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Request method failure captured: Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 HTTP/1.1 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKhpl1oGLB3sb82TWNlXQHNA86nENvSm-rt8vqh6bNm7dhQlorHnzUjpYJoBpmAmmZH_rVK9l7T3_hISpuXvcU7PBr86BouDxZ1JI_0VHDrPsqEqhNZLk0Ul95jFusHMTBHggNKjvvUx6jzV2-gpSDktlkuTBDICBTijvqd89Y8O4QA Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 682369808e9f4a9fb7c1b5f211de066f Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-VolumesNegativeTest-186853067 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/682369808e9f4a9fb7c1b5f211de066f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/682369808e9f4a9fb7c1b5f211de066f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/682369808e9f4a9fb7c1b5f211de066f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_682369808e9f4a9fb7c1b5f211de066f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-VolumesNegativeTest-186853067 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 682369808e9f4a9fb7c1b5f211de066f Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-VolumesNegativeTest-186853067 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-VolumesNegativeTest-186853067-project Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 96d37c3f69384c659a03936dac7fef65 Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-VolumesNegativeTest-186853067-project Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '4950bf9f-f163-4b5d-9e49-9fb974cb3cc9'} Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:29.265294 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] Returning 404 to user: Instance 4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:29.279530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-860b9aa8-9340-4c0d-8666-9d73b43b0131 tempest-VolumesNegativeTest-186853067 tempest-VolumesNegativeTest-186853067-project] 10.222.0.36 "GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9" status: 404 len: 111 microversion: 2.1 time: 0.106771 Oct 04 21:41:29.290363 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3027/6161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:29 2022] GET /compute/v2.1/servers/4950bf9f-f163-4b5d-9e49-9fb974cb3cc9 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:29.812719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "name": "network-vif-unplugged", "status": "completed", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:29.827204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.827667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.828104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.842701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] Creating event network-vif-unplugged:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h1-851029-13 Oct 04 21:41:29.849140 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d2a9e84b-ad97-4430-84f3-33318ae1ebae req-bb9e14a6-75c0-4bf0-8ed1-c5501ede096d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042168 Oct 04 21:41:29.849783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3135/6162] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:29.872805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:29.873793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:29.884081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.884852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.885490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.886548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.887466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.888067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:30.085510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:30.100819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-504d8e60-25b3-4a44-9cc1-2b49d008c8d2 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.233878 Oct 04 21:41:30.101721 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3028/6163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:29 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:30.810075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:30.810075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:30.818339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:30.819112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:30.819933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:30.821236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:30.822087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:30.822755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:30.973589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lazy-loading 'services' on Instance uuid e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:31.147202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:31.148036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:31.165455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:31.167227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:31.167780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:31.171830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:31.172404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:31.172976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:31.428910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:31.449198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-271e7837-d8f5-401f-9502-f0467dc9706c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.311813 Oct 04 21:41:31.461451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3029/6164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:31 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:31.550518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a45b6d7-ce75-4da4-ba1c-38fc87e65d83 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2/os-volume_attachments/3adab83a-3eda-4a0b-bea0-bb4bfd076175" status: 202 len: 0 microversion: 2.1 time: 0.758328 Oct 04 21:41:31.562341 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3136/6165] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 21:41:30 2022] DELETE /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2/os-volume_attachments/3adab83a-3eda-4a0b-bea0-bb4bfd076175 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:41:31.877856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:31.902863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:31.903751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:31.904806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:31.928869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] Creating event network-changed:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h1-851029-13 Oct 04 21:41:31.941138 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4d6bc687-7c75-40bd-8fc3-360e192f8f24 req-4dc74a18-f297-4888-b03b-ea783c8c307e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073044 Oct 04 21:41:31.942792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3030/6166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:32.486895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:32.491066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:32.505064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.506391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.507588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.509321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.511760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.513531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.983844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:32.988692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:32.997977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1260770c-a514-4fc3-a7e3-aa4bf081ba65 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.523863 Oct 04 21:41:33.014523 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3137/6167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:32 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:34.036596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:34.038064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:34.069275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:34.070178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:34.083359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:34.084918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:34.093422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:34.095534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:34.507073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:34.524315 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb9ef1be-ce45-409f-ba22-1f80d275cf74 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.501101 Oct 04 21:41:34.526524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3031/6168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:34 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:35.573012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:35.574001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:35.578403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:35.590339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:35.590597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:35.591397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:35.592330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:35.592985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:35.593527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:36.025200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:36.043227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d6cc805-4059-40e5-9066-8d8f31964d9c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.476750 Oct 04 21:41:36.046620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3138/6169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:35 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:37.086473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:37.087346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:37.105998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:37.108116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:37.111086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:37.126516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:37.128084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:37.128667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:37.433582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:37.458487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e28c619e-383c-4959-bfa6-ad59688bd475 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.375137 Oct 04 21:41:37.459632 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3032/6170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:37 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:38.532581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:38.547804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:38.558343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.561498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.562044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.563144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.563642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.564085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.954256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:38.965565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13210130-20e6-4c0e-bd9d-a3009e534c03 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.453118 Oct 04 21:41:38.969889 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3139/6171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:38 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:40.006974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.007919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:40.013005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=34 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:40.022903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.023766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.024877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.026173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.027033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.027829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.276567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.279982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:40.303931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.304434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.305501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.306268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.307386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.307864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.344380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:40.361452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-703272a0-a1a3-4dc9-83be-a9eea884e29a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1693 microversion: 2.1 time: 0.360848 Oct 04 21:41:40.363678 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3033/6172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:39 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1693 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:40.369087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:40.895668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3db2add7-d2da-4541-a646-f25b2a2e9821 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 204 len: 0 microversion: 2.1 time: 0.631103 Oct 04 21:41:40.903049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3140/6173] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:40 2022] DELETE /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:41:40.925586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.932592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:40.946275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.948475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.948475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.948475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.948823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.949704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.960744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:41.289547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:41.299302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0bacd3a-4d84-4cd8-b7e9-89f0b5a97f29 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1512 microversion: 2.1 time: 0.384873 Oct 04 21:41:41.300038 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3034/6174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:40 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:41.389910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:41.391777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:41.401555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.402168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.402614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.403421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.404097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.404656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.631929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:41.648475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1129ab21-13d0-4fa5-9533-c98405937879 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1683 microversion: 2.1 time: 0.263099 Oct 04 21:41:41.651669 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3141/6175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:41 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:41.681818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:41.682839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:41.692059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.692973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.693686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.694993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.695768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.696787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.912891 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec3c7a83-9cd7-4373-bc70-ae5accc36f59 tempest-TestNetworkAdvancedServerOps-1388941279 tempest-TestNetworkAdvancedServerOps-1388941279-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1836 microversion: 2.1 time: 0.235774 Oct 04 21:41:41.914158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3035/6176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:41 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1836 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:41.945182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:41.945808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:41.953850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.954629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.955464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.956398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.957255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.957913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.225750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:42.242271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-767373b3-3d81-4986-a55e-e80b729a1ad9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1683 microversion: 2.1 time: 0.301079 Oct 04 21:41:42.244472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3142/6177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:41 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1683 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:42.324248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:42.324909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:42.343502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.345270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.345270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.346101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.346571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.347131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.454516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:42.457843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:42.480116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.482118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.482909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.484013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.484941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.485620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.566088 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efa2021c-8eeb-4b53-b83e-7bea25db82b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action" status: 200 len: 38341 microversion: 2.1 time: 0.123601 Oct 04 21:41:42.566871 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3143/6178] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:41:42 2022] POST /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf/action => generated 38341 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:41:42.709826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:42.736220 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06f6c5f7-6b15-48f1-98c0-d5efaf772c3d tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1512 microversion: 2.1 time: 0.404604 Oct 04 21:41:42.736220 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3036/6179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:42 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:43.756774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:43.760432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:43.793820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:43.797032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:43.800664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:43.802580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:43.804382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:43.804846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:43.951064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:43.985870 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4cb55a16-a635-420e-ae43-c827c60e6679 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1470 microversion: 2.1 time: 0.236965 Oct 04 21:41:43.989369 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3144/6180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:43 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:44.275872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f32645-6ffb-41da-a6a2-91f4cee8a7d2", "name": "network-vif-deleted", "tag": "d187dd53-ca2a-4b29-8e03-585e08dc4ab7"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:44.291875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:44.292831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:44.293604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:44.314309 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] Creating event network-vif-deleted:d187dd53-ca2a-4b29-8e03-585e08dc4ab7 for instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 on n-h2-851029-13 Oct 04 21:41:44.323550 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ef846737-e3ce-4425-a44f-208912412c79 req-dc54f328-58c5-4ff9-aa8d-3448bee50703 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282630 Oct 04 21:41:44.326206 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3037/6181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:45.022866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:45.023759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:45.025619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:45.034718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.036461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.036938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.042179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.043187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.043961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.045402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.046262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.047040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.054499 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] Creating event network-changed:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h2-851029-13 Oct 04 21:41:45.064590 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-56dfd426-6a2a-4b0b-a9be-e0fdeace1fd3 req-de56ce67-6bce-431e-a083-a4f940a03203 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046882 Oct 04 21:41:45.067495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3038/6182] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:45.103999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:45.108836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:45.119532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:45.130218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.131330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.132430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.155353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.156485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.157417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.316386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.319967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.321176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.322305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lazy-loading 'fault' on Instance uuid e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:45.467087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f8d3765d91445886264c636a923fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c57efa4358f4402a793bc5d1587fd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:45.488208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-967652bd-7ebf-4b70-96b9-8f8a30d9e864 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 200 len: 1309 microversion: 2.1 time: 0.417719 Oct 04 21:41:45.489577 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3039/6183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:45 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:45.876811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7202acc9-066b-4af8-a2ab-c275982a7dc3 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 204 len: 0 microversion: 2.1 time: 0.864453 Oct 04 21:41:45.878576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3145/6184] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:45 2022] DELETE /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 0 bytes in 867 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:41:45.892927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:45.900849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:45.909557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.910624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.911430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.912700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.914578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.915566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:46.392591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:46.420559 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cbe8e289-8227-4b13-9cb1-7910f540c5fb tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1689 microversion: 2.1 time: 0.532223 Oct 04 21:41:46.421738 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3040/6185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:45 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1689 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:46.530748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:46.532498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] [instance: e2f32645-6ffb-41da-a6a2-91f4cee8a7d2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:46.541543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:46.542239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:46.542999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:46.544131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:46.545465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:46.546201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:46.562721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] HTTP exception thrown: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Request method failure captured: Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 HTTP/1.1 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKcgNucIufJAsv3kWHTxnHj3aOcTledisTONBisnVMnJGIiJIVGk65fGmNwXp6eCjzI6R4m19CmDR3VPA_V7CDjmCDPDQbHtbIc3TOmtNpfVwWTYC7V3RzAjP72vXdtEZEq1yQJzLVEWOx_0j4paKnHNpWDdbu-yfN6qom3lgzDD9Yc Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 0c57efa4358f4402a793bc5d1587fd72 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c57efa4358f4402a793bc5d1587fd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 0c57efa4358f4402a793bc5d1587fd72 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-179693554 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-VolumesSnapshotTestJSON-179693554-project Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 12f8d3765d91445886264c636a923fc8 Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-VolumesSnapshotTestJSON-179693554-project Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e2f32645-6ffb-41da-a6a2-91f4cee8a7d2'} Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:46.587254 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] Returning 404 to user: Instance e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f7f1974-e2a0-4075-bf69-a5fcbb52f713 tempest-VolumesSnapshotTestJSON-179693554 tempest-VolumesSnapshotTestJSON-179693554-project] 10.222.0.36 "GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2" status: 404 len: 111 microversion: 2.1 time: 0.052634 Oct 04 21:41:46.603140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3146/6186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:46 2022] GET /compute/v2.1/servers/e2f32645-6ffb-41da-a6a2-91f4cee8a7d2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:47.461211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:47.462848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:47.475611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:47.477290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:47.477975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:47.479136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:47.481119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:47.481920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:47.785065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:47.831790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1aad2007-2e02-4e86-a575-6eb611fa51b1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1503 microversion: 2.1 time: 0.378234 Oct 04 21:41:47.838021 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3041/6187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:47 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:47.868675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5224132b-0ebf-4489-95cf-e1cc1a98dccf", "name": "network-vif-deleted", "tag": "4a215670-8a8e-4736-a3b5-13e7b907e3d0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:47.928537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:47.930034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:47.931393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:47.975895 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] Creating event network-vif-deleted:4a215670-8a8e-4736-a3b5-13e7b907e3d0 for instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf on n-h2-851029-13 Oct 04 21:41:47.987042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4c9bded9-d284-425c-8391-dee588e4daf5 req-c5cf6f68-62a2-4297-8891-8abc5c667691 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124690 Oct 04 21:41:47.989028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3147/6188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:48.867434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:48.871626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:48.893229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:48.894454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:48.895530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:48.897105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:48.898319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:48.899626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:49.083878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:49.087894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:49.089162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:49.091597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lazy-loading 'fault' on Instance uuid 5224132b-0ebf-4489-95cf-e1cc1a98dccf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:49.743564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:49.752577 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4323429e-aa84-45e8-a35c-9e9b61911350 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 200 len: 1356 microversion: 2.1 time: 0.894793 Oct 04 21:41:49.753176 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3042/6189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:48 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 1356 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:50.780411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:50.782207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 5224132b-0ebf-4489-95cf-e1cc1a98dccf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:50.791274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:50.795464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:50.795464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.795464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:50.795464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:50.795464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.813221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] HTTP exception thrown: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Request method failure captured: Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf HTTP/1.1 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKZVmI3T1VLzezIEF0m3sB9oiI1o_7H1a4LshFaP1jfNA3ZHLH6lyZGcafDeNgvfCX3Y6AnTkPcTs5gu0cYs_YsoQWmvJyUMnqCrWl6u-r4x83dGHptuJFGPiWtL5dpIh5no4Tsr4z5X6Z7y6p82bFX0CviBJmjkiPQSQWCx3S40T6Q Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 0be5e41e86e74c2485502f4da34aa3b0 Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '5224132b-0ebf-4489-95cf-e1cc1a98dccf'} Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:50.816638 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Returning 404 to user: Instance 5224132b-0ebf-4489-95cf-e1cc1a98dccf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d7dba87-74a6-49f4-91a5-0d2a6ca9d317 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf" status: 404 len: 111 microversion: 2.1 time: 0.044689 Oct 04 21:41:50.827548 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3148/6190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:50 2022] GET /compute/v2.1/servers/5224132b-0ebf-4489-95cf-e1cc1a98dccf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:57.360645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f6c1e3d-5bf1-49c4-bb2c-f132efc3cb76 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '.version_select at 0x7f54f50228b0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:57.371269 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f6c1e3d-5bf1-49c4-bb2c-f132efc3cb76 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:41:58.383573 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f6c1e3d-5bf1-49c4-bb2c-f132efc3cb76 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38558. Oct 04 21:41:58.516939 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f6c1e3d-5bf1-49c4-bb2c-f132efc3cb76 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1551304050" status: 202 len: 0 microversion: 2.1 time: 1.163774 Oct 04 21:41:58.517948 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3043/6191] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 4 21:41:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1551304050 => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:41:58.593026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67d58b93-356a-44b2-9a96-0ce77562bb46 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: .version_select at 0x7f54fa6a09d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1533133801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQuGSouNIPpuUSBZN85TtEp4DvtSwQeVqEQaVp7RVWpfu6hh5WDsGE0XasoIgBxInYDoXqNd8rK946JjeiokA4HTl9GnGXjhnywaAGT3DlF/URTjRSFR1+iZr5uAbCR5Q=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:58.626794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-67d58b93-356a-44b2-9a96-0ce77562bb46 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:58.641322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-67d58b93-356a-44b2-9a96-0ce77562bb46 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:58.843199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67d58b93-356a-44b2-9a96-0ce77562bb46 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.268622 Oct 04 21:41:58.844876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3149/6192] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:41:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:16.690683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2107766791", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "8ed2b9bb-d7bb-4348-9501-3589fe31a1f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1533133801", "security_groups": [{"name": "tempest-secgroup-smoke-1298638026"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:16.726959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=49 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:16.752314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:16.977176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] validate_networks() for [('8ed2b9bb-d7bb-4348-9501-3589fe31a1f8', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:42:17.699025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:42:17.699854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:42:17.700013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:42:17.700381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:42:17.700808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:42:17.713590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:17.714076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:17.714791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:17.715556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:17.716226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:17.716873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:17.740859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:17.747748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Getting quotas for user 0be5e41e86e74c2485502f4da34aa3b0 and project a8b36941b2ae43e2a42d2b1954623c1f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:17.774027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:42:17.778872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:42:18.035338 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0556983b-3034-4483-a8ea-fa4d59e1c103 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.351132 Oct 04 21:42:18.047963 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3044/6193] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:42:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:42:18.057797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92f722d5-d273-448d-90d8-07acf0b6958a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:18.060027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92f722d5-d273-448d-90d8-07acf0b6958a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:18.074151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:18.076203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:18.078312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:18.184489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-92f722d5-d273-448d-90d8-07acf0b6958a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:18.195772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92f722d5-d273-448d-90d8-07acf0b6958a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1267 microversion: 2.1 time: 0.144628 Oct 04 21:42:18.198862 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3150/6194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:18 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:19.230204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f3044b2-b1e8-4b0c-a65a-6bfb61faea8f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:19.231143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f3044b2-b1e8-4b0c-a65a-6bfb61faea8f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:19.332272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f3044b2-b1e8-4b0c-a65a-6bfb61faea8f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:19.347856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f3044b2-b1e8-4b0c-a65a-6bfb61faea8f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1267 microversion: 2.1 time: 0.124103 Oct 04 21:42:19.348848 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3045/6195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:19 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:20.397444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:20.402376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:20.422636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:20.424215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:20.425090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:20.427180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:20.427909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:20.428779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:20.525762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:20.536007 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a70d0b74-9980-4d7c-b84f-3b94554bd326 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1271 microversion: 2.1 time: 0.150624 Oct 04 21:42:20.536250 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3151/6196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:20 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:21.569093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:21.570148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:21.589424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:21.589975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:21.590451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:21.591200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:21.591710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:21.592222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:21.797928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:21.814285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e8f58ac-a8ce-46ef-9af6-8c41a9e6682b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1319 microversion: 2.1 time: 0.253650 Oct 04 21:42:21.820524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3046/6197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:21 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:22.848831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:22.850330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:22.862818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:22.863455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:22.866128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:22.866128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:22.866128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:22.866128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:22.955192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:22.967386 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f561ac18-3d2f-4d40-b12b-2c293594636f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1325 microversion: 2.1 time: 0.122896 Oct 04 21:42:22.979591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3152/6198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:22 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1325 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:24.001522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:24.001522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:24.006425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:24.006984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:24.007666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:24.009468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:24.010052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:24.010614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:24.274334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:24.289826 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fea32699-7b0d-495f-b888-0dc69b9887b0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 0.297712 Oct 04 21:42:24.290915 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3047/6199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:23 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:25.317533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:25.318466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:25.328088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:25.330097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:25.330949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:25.331725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:25.332473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:25.333214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:25.597010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:25.609644 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06471e79-8cfc-4988-951a-9d183bd323aa tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 0.297754 Oct 04 21:42:25.624381 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3153/6200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:25 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:26.643107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:26.648249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:26.665113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:26.665984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:26.667031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:26.668439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:26.669602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:26.670480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:26.853133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:26.901414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:26.906317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:26.907760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:26.959148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] Creating event network-changed:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:42:26.975493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ba798011-837c-4e95-aa9a-53ab2a28c3ce req-c734a4cf-d1b0-42f2-a095-2e1239572ec5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133718 Oct 04 21:42:26.985795 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3154/6201] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:42:27.660564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:27.681127 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b885758-f28c-4e45-bdb5-f9535e61a919 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 1.047265 Oct 04 21:42:27.683568 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3048/6202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:26 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:28.713005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:28.720015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:28.788083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:28.791189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:28.792174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:28.794616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:28.796376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:28.797362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:29.219005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:29.235589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d48a3e1b-2bca-4541-ae9e-6a59b71a5632 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 0.531299 Oct 04 21:42:29.242951 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3155/6203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:28 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:30.283000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:30.283963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:30.306496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:30.310738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:30.312785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:30.313479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:30.314023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:30.323658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:30.324363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:30.324851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:30.972967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:30.984349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70d2b195-fec0-44d2-b501-c694a55593b7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 0.706748 Oct 04 21:42:30.986264 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3049/6204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:30 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:32.048027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:32.591680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:32.596848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:32.626097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:32.629168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:32.633203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:32.636027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:32.649327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:32.649327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:33.055878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:33.071637 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d43d0170-b46a-4129-b51b-f4ccf95d010b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 1.042740 Oct 04 21:42:33.073180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3156/6205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:32 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:34.101213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:34.102149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:34.137269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:34.144524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:34.145771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:34.147341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:34.158762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:34.160235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:34.860977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "name": "network-vif-plugged", "status": "completed", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:34.898881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:34.899694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:34.900446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:34.947785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] Creating event network-vif-plugged:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:42:34.958439 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1720a404-52d4-4ac5-b284-2f1567a4f322 req-a72ec6ca-ecdf-449f-aa6d-3ecbb7cbd1d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.553641 Oct 04 21:42:34.960510 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3157/6206] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:35.222448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:35.237493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f0b5e4f-966e-4747-b208-2672cbd7a1f9 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 1.142696 Oct 04 21:42:35.242545 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3050/6207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:34 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:36.289630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:36.290720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:36.308268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:36.309945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:36.309945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:36.317340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:36.319619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:36.322006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:36.877197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:36.891405 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73894fb6-4485-49b5-a705-7f39fbd5e7d7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1393 microversion: 2.1 time: 0.605254 Oct 04 21:42:36.907589 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3158/6208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:36 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1393 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:37.196933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-097d08e1-88e6-4cb6-9c50-249c4033daec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: .version_select at 0x7f54f4fe8550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1221051358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Ni2XyyS93Rv8Ng3O3hBKRgVM3czI2z0ba9UKZxuzRWvUw01OVro6aAI5g/M6k2TQce4C2lyWpVo/NK/ZL7ttLwZGpvPKNl9hI4g+MtDV+vt+ZpMBgaE1bK6VFz6DsYA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:37.233551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-097d08e1-88e6-4cb6-9c50-249c4033daec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:37.246257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-097d08e1-88e6-4cb6-9c50-249c4033daec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:37.472112 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-097d08e1-88e6-4cb6-9c50-249c4033daec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.284478 Oct 04 21:42:37.473588 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3051/6209] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:42:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:42:37.918169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:37.919864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:37.946036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:37.947172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:37.948070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:37.949374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:37.950345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:37.951435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:38.347723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:38.360638 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3c82f64e-a61d-42e7-8fdd-d090901621ae tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1564 microversion: 2.1 time: 0.448314 Oct 04 21:42:38.361490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3159/6210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:37 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1564 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:38.392868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:38.398742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:38.404136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:38.404927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:38.405336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:38.407429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:38.408861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:38.409458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:38.738751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:38.752102 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-91881a3f-34ee-404f-aef0-71d194dc2b8b tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1564 microversion: 2.1 time: 0.368329 Oct 04 21:42:38.763398 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3052/6211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:38 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1564 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:42.809918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-793268852", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "fc1313ff-51fa-4e9c-bcf0-77680f60aaef"}], "key_name": "tempest-TestNetworkBasicOps-1221051358", "security_groups": [{"name": "tempest-secgroup-smoke-1188778292"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:43.085906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] validate_networks() for [('fc1313ff-51fa-4e9c-bcf0-77680f60aaef', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:42:43.541902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:43.543017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:43.585440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:43.586539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:43.588218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:43.589685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:43.590743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:43.592535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:44.143964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:44.188294 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-062a9a41-f7d4-4959-a3e5-1cebe85f74f5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1564 microversion: 2.1 time: 0.649819 Oct 04 21:42:44.190456 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3053/6212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:43 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1564 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:44.224678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:44.255183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:44.256961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:44.259069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:44.315756 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] Creating event network-changed:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:42:44.357226 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-2b277675-d118-4d14-9ae9-85ca97d73241 req-c2524e9c-7202-4e8b-970a-117d4075b033 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151986 Oct 04 21:42:44.357447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:42:44.358248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:42:44.358920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3054/6213] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:44.360072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:42:44.362784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:42:44.363984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:42:44.398591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:44.405984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:44.407227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:44.411339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:44.418240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:44.419024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:44.494168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:44.515885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:44.569397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:42:44.573562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:42:44.838692 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b7069c38-b2fc-48fd-bf76-33272e3e4ed3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.032137 Oct 04 21:42:44.842077 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3160/6214] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:42:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:42:44.884659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4e68aeec-879e-4b97-a424-406350affa0a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:44.888316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4e68aeec-879e-4b97-a424-406350affa0a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:45.092668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4e68aeec-879e-4b97-a424-406350affa0a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:45.110469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4e68aeec-879e-4b97-a424-406350affa0a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1248 microversion: 2.1 time: 0.251205 Oct 04 21:42:45.117287 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3055/6215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:44 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1248 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:46.143448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03a1ad10-5392-467c-89ed-652f902c152a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:46.145116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03a1ad10-5392-467c-89ed-652f902c152a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:46.254889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-03a1ad10-5392-467c-89ed-652f902c152a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:46.269473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03a1ad10-5392-467c-89ed-652f902c152a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1248 microversion: 2.1 time: 0.130602 Oct 04 21:42:46.275610 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3161/6216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:46 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1248 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:47.295885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:47.296902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:47.311505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:47.312771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:47.317364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:47.317364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:47.317364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:47.317364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:47.434619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:47.455227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edca8919-9e38-4707-aeaa-f3cccdfa15d2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1252 microversion: 2.1 time: 0.164577 Oct 04 21:42:47.459004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3056/6217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:47 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1252 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:48.490252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:48.496396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:48.500354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.501032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.501831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:48.503048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.503665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.504403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:48.649564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:48.667306 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cce8778b-f349-44a0-9627-21cbd5ad8202 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1300 microversion: 2.1 time: 0.182101 Oct 04 21:42:48.671092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3162/6218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:48 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:49.714433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:49.720511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:49.734373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:49.738226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:49.739421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:49.740670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:49.742586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:49.743637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:49.744537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:49.755101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=53 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:49.878916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:49.892853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f88d9d5c-a0b0-4c89-8c64-e65e37b6672d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1306 microversion: 2.1 time: 0.187969 Oct 04 21:42:49.912211 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3057/6219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:49 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:50.936219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:50.937812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:50.959605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.961850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.964843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:50.966378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.967221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.970723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:51.236251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:51.249097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe916b42-a5eb-49d1-9bf4-7460834c8af8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.318902 Oct 04 21:42:51.250543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3163/6220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:50 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:52.281380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:52.282798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:52.300892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:52.303021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:52.303950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:52.306179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:52.307708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:52.308454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:52.540263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:52.552628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-33eb10e1-4b2c-4d5a-a0e1-0f1147e43d31 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.279233 Oct 04 21:42:52.567426 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3058/6221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:52 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:52.663098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1546b1ca-69fd-44fc-b6d9-368f13de0bab", "tag": "fd2397b4-8110-4d55-a023-4d8958120a9c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:52.687865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:52.688921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:52.689839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:52.722319 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] Creating event network-changed:fd2397b4-8110-4d55-a023-4d8958120a9c for instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab on n-h1-851029-13 Oct 04 21:42:52.737896 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9d04a685-554f-4e45-8c08-1dcdb57c047f req-8ff624c7-18cb-4621-b7b1-98dfb96304cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083695 Oct 04 21:42:52.739908 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3164/6222] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:53.603695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:53.611110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:53.623721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.625385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.627346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:53.629235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.630487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.631815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:54.147248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:54.160713 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3e502dc8-05c9-4bd7-bc61-05019f2c490f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.567134 Oct 04 21:42:54.161907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3059/6223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:53 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:55.199843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:55.205916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:55.206847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:55.215444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.216113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.220467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.220467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.220467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.220467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.438072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:55.442505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=67 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:55.457548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59313995-a22e-4935-acfd-f7fbf8c390c9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.259849 Oct 04 21:42:55.459453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3165/6224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:55 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:56.503807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:56.506181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:56.512316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:56.524668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.526045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.527276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.528637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.529492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.530293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.778642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:56.791146 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fb3e5cb-a1bf-4a60-905f-6ee7334cbcc2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.296480 Oct 04 21:42:56.791988 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3060/6225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:56 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:57.825267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:57.827756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:57.831743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:57.832857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:57.840761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:57.841667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:57.842265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:57.843669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:57.844498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:57.845224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:58.043730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:58.058131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b51f168-0637-4abd-90f4-f6a0f152fae2 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.238364 Oct 04 21:42:58.059219 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3166/6226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:57 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:59.096211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:59.097338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:59.127709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:59.129745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:59.129745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:59.142891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:59.144005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:59.144798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:59.413276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:59.430793 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aef10b16-ef5b-4fec-a53e-d2421b97d136 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.343459 Oct 04 21:42:59.432372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3061/6227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:59 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:00.457627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:00.458951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:00.470217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.470841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.471343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.472177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.472719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.473294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.787640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:00.807072 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-166f2568-663c-4db5-b0ed-dac82a9eb92a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.353716 Oct 04 21:43:00.808594 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3167/6228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:00 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:00.974302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:00.977308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:00.987396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.988425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.989418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.990457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:00.991318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:00.992260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.065328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4db0a73a-5937-42ec-adee-e88ca57cf52f tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action" status: 200 len: 24568 microversion: 2.1 time: 0.095824 Oct 04 21:43:01.066334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3062/6229] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:43:00 2022] POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action => generated 24568 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:01.363115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1546b1ca-69fd-44fc-b6d9-368f13de0bab", "name": "network-vif-plugged", "status": "completed", "tag": "fd2397b4-8110-4d55-a023-4d8958120a9c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:01.381610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.382123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.382731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.401096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] Creating event network-vif-plugged:fd2397b4-8110-4d55-a023-4d8958120a9c for instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab on n-h1-851029-13 Oct 04 21:43:01.408126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-35e1f54d-77c1-4445-8423-535818931da8 req-da8f32ad-1d5a-4162-9160-8620de19bdf1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052929 Oct 04 21:43:01.409276 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3168/6230] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:01.839186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:01.840400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:01.855239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.856150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.857533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.858999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.859926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.860748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:02.079433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:02.109880 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7fa932e7-fb76-4b7c-ac38-bfdc6b22f658 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.279183 Oct 04 21:43:02.110884 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3063/6231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:01 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:03.135326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.136157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:03.145273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.145778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.146237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.147161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.147658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.148121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.534592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:03.553800 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e98adf6-8584-4e2a-b86e-3c8fe7cc866f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1374 microversion: 2.1 time: 0.420153 Oct 04 21:43:03.569496 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3169/6232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1374 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:04.604455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:04.605713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:04.620426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:04.621385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:04.622177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:04.623552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:04.624455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:04.625724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:04.873329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:04.886530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08af777b-b7ce-45d8-aa2f-013ccba4a907 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1547 microversion: 2.1 time: 0.290592 Oct 04 21:43:04.891828 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3064/6233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:04 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1547 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:04.925729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:04.925729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:04.931733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:04.932170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:04.932615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:04.933431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:04.933884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:04.934314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:05.108002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:05.116776 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e29e3107-e621-4bf2-a4a3-34ab3b7dc790 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1547 microversion: 2.1 time: 0.204052 Oct 04 21:43:05.117491 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3170/6234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:04 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:08.621904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1546b1ca-69fd-44fc-b6d9-368f13de0bab", "tag": "fd2397b4-8110-4d55-a023-4d8958120a9c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:08.636199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:08.636725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:08.637427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:08.654032 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] Creating event network-changed:fd2397b4-8110-4d55-a023-4d8958120a9c for instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab on n-h1-851029-13 Oct 04 21:43:08.661950 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8e94c912-54e0-40d8-81ad-04d9e79d4963 req-15a7f551-ed13-42e8-a61a-90640dcda311 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Oct 04 21:43:08.663608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3065/6235] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:12.057009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "08650df2-2319-4b76-af09-4569093fd163"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:12.060529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:12.068253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.068872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.069322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.070127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.070624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.071275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.166988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:43:12.167408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:43:12.167881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:43:12.168288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:43:12.168697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:43:12.409377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:12.422447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.423745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.424963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.426113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.427389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.427931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.503747 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73220ddc-7b4a-4f9a-95d3-4558c42457db tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action" status: 202 len: 1137 microversion: 2.1 time: 0.450304 Oct 04 21:43:12.506963 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3171/6236] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:43:12 2022] POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action => generated 1137 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:43:12.552116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:12.556193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:12.571335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.572206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.572846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.574057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:12.574821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:12.576125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:12.802627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:12.812537 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84b9009d-65fa-4f6d-b4e4-4deb815e6182 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.277191 Oct 04 21:43:12.813140 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3066/6237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:12 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:13.837873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:13.839193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:13.847618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:13.848518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:13.848960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:13.849703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:13.850139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:13.850557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:14.050155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:14.062356 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc14d0ce-33de-4f74-832b-4a81f24049bf tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.228666 Oct 04 21:43:14.081820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3172/6238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:13 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:15.091996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:15.093226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:15.106979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:15.111304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:15.111304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:15.111304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:15.111304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:15.112320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:15.370414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:15.384848 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1310fce-c0a6-43b3-9f8c-5b817d6ceb44 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.298088 Oct 04 21:43:15.385495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3067/6239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:15 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:16.412093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:16.412937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:16.422293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:16.423121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:16.425324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:16.425324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:16.425324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:16.427809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:16.656293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:16.669946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d03cdcb-61c5-4a0c-8871-5865d0b2a835 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.262541 Oct 04 21:43:16.670985 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3173/6240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:16 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:17.694858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:17.695711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:17.703572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:17.704394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:17.704832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:17.705612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:17.706071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:17.706495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:17.949279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:17.972452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-140a0f8a-8291-4052-abbc-22c49b9e538a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.281000 Oct 04 21:43:17.972856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3068/6241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:17 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:19.005730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.011184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:19.044606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.045423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.045877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.046624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.047147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.047609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.289215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:19.303347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-70c887e2-2006-4405-9bf3-c02cb86fc0fc tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.308250 Oct 04 21:43:19.304317 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3174/6242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:18 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:20.332991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:20.334240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:20.347710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.347710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.347710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.348859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:20.349574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:20.350140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:20.548926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:20.565196 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31f455fe-749c-4bd7-8685-e6c12718b44e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.239550 Oct 04 21:43:20.566185 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3069/6243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:20 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:21.598562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:21.599560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:21.608025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.608660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.609119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.609902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.610391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.610872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.863080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:21.874993 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0ba03bf-c1ef-456c-9f3f-68f65e8d8d10 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.278873 Oct 04 21:43:21.876495 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3175/6244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:21 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:22.906713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:22.907846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:22.912201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:22.921462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.922357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.923193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.924552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.925423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.926237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.935347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=72 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:23.144838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:23.160841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20858372-7c14-4572-a4ce-f52f4deb9fe7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.262928 Oct 04 21:43:23.161916 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3070/6245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:22 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:24.186851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:24.191586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:24.195497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:24.195997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:24.196469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.197168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:24.197629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:24.198063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:24.366607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:24.376278 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb0c0332-5a33-4edd-a866-2f1f4c7696c7 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.193976 Oct 04 21:43:24.380162 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3176/6246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:24 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:25.401754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:25.402649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:25.413567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.414792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.415393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.416227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:25.416971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:25.417549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:25.783094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:25.792631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd720b51-d871-45d8-a30e-382a5d69f6d0 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.396461 Oct 04 21:43:25.793425 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3071/6247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:25 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:26.819629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:26.820251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:26.827683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.828086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.828525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:26.829293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:26.829699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:26.830210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:27.038794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:27.049471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6913a0eb-220d-49db-848e-50214ea90ece tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.234029 Oct 04 21:43:27.050264 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3177/6248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:26 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:28.077960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:28.078631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:28.086564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:28.087362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:28.087819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:28.088763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:28.089080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:28.089518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:28.266773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:28.274792 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00d59c81-ab21-4a50-8949-3e7a9c5e8e20 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.201764 Oct 04 21:43:28.275407 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3072/6249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:28 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:29.298255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:29.298893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:29.306484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:29.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:29.310563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:29.313634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:29.474986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:29.483588 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12596a8f-9966-444a-b892-c8c87673e26d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1692 microversion: 2.1 time: 0.190004 Oct 04 21:43:29.484194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3178/6250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:29 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:30.507479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:30.508424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:30.516101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.516618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.517056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:30.517764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:30.518274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:30.518735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:30.708868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:30.718153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff696cb5-2571-40e2-82ab-9517a320774e tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1698 microversion: 2.1 time: 0.214747 Oct 04 21:43:30.718787 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3073/6251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:30 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1698 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:31.750082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:31.750948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:31.753765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=30 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:31.760195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.760767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.761271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.762008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:31.762513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:31.770488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:31.947258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:31.956306 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d71ae913-0397-4f5e-a9df-b8472afb8a64 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1698 microversion: 2.1 time: 0.210489 Oct 04 21:43:31.956916 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3179/6252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:31 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1698 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:32.985830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:32.987361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:32.999032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:32.999805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.000461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.003040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.003736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.004550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.207706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:33.218934 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-329856ae-cf0b-4a19-b3b9-7934db5b06b5 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1683 microversion: 2.1 time: 0.239912 Oct 04 21:43:33.219803 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3074/6253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:32 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:33.876538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "name": "network-vif-unplugged", "status": "completed", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:33.886534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:33.887054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:33.887499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:33.904491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] Creating event network-vif-unplugged:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:43:33.912320 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-37a589a8-3334-4fb4-bbc1-97e4840320a4 req-6909210c-33c4-45de-afc4-0cadf92bab24 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041715 Oct 04 21:43:33.913098 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3180/6254] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:35.933686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "name": "network-vif-plugged", "status": "completed", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:35.949529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:35.949992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:35.950455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:35.967362 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] Creating event network-vif-plugged:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:43:35.975165 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c9e293a5-9b40-485a-83e3-924d234a7b65 req-cba75185-994f-4b1d-a06d-8d6b0328a1ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046538 Oct 04 21:43:35.975662 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3075/6255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:41.116603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:41.118884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:41.125642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.126144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.126589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.127335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:41.127804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:41.128240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:41.184286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01efbc16-df34-4fef-a27c-d4f611f93022 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab/action" status: 200 len: 24571 microversion: 2.1 time: 0.073267 Oct 04 21:43:41.185201 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3181/6256] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:43:41 2022] POST /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:43:57.463703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=11 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:57.465390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:57.470438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:57.474438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:57.479875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.480355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.480790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.481524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:57.481983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:57.483061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:57.536623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af14a52a-483d-401f-bbbc-431f836ba07a tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action" status: 200 len: 24575 microversion: 2.1 time: 0.074884 Oct 04 21:43:57.537329 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3076/6257] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:43:57 2022] POST /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13/action => generated 24575 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:44:09.606043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:09.606736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:09.610623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:09.611338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=17 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:09.619308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:09.619827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:09.620513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:09.623458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:09.623458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:09.623458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:09.651528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:44:09.840429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:09.865056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:09.866107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:09.866582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:09.879358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] Creating event network-changed:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:44:09.885163 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-edb6e5c4-3cf7-41ae-b7ea-fc9d5ea12ae5 req-39d71365-0bc3-48ec-be2a-f4346d31c898 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281175 Oct 04 21:44:09.886007 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3077/6258] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:10.046266 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d66d46c2-f14f-40a1-a718-79270b8c10f1 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 204 len: 0 microversion: 2.1 time: 0.444573 Oct 04 21:44:10.047118 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3182/6259] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:44:09 2022] DELETE /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:44:10.058001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:10.059447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:10.072792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.073698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.075287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.076727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:10.077224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:10.079184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:10.367057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:10.377665 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ea089b69-d282-41f8-b2bc-14034d514213 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1689 microversion: 2.1 time: 0.325690 Oct 04 21:44:10.384692 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3078/6260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:10 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:11.410641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:11.411369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:11.421027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.421550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.422357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.423119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:11.423917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:11.424355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:11.788983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:11.804899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50105a7e-c77f-4a63-917d-f1aa265e38de tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1689 microversion: 2.1 time: 0.398548 Oct 04 21:44:11.806048 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3183/6261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:11 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:12.160493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960bb2f2-f8f9-4bfe-8858-dd5b8962ec13", "name": "network-vif-deleted", "tag": "b3614cef-de35-4f25-9985-7dbd90158617"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:12.172096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.172763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.173622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.188122 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] Creating event network-vif-deleted:b3614cef-de35-4f25-9985-7dbd90158617 for instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 on n-h2-851029-13 Oct 04 21:44:12.193924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ec46bbd7-46a4-44b9-9e9d-8a37d0580a38 req-61789d1d-0272-4dd5-8a27-0686a60dc3eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037103 Oct 04 21:44:12.194691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3079/6262] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:12.847528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:12.848134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:12.856005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.856498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.856996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.857703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.858155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.858581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.898963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:12.899534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:12.900592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:12.900592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lazy-loading 'fault' on Instance uuid 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:44:12.947218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5e41e86e74c2485502f4da34aa3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b36941b2ae43e2a42d2b1954623c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:12.955638 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09a97cda-bad5-4aa0-8405-37e78f38840c tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 200 len: 1357 microversion: 2.1 time: 0.112583 Oct 04 21:44:12.956206 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3184/6263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:12 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 1357 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:13.980611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:13.981232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] [instance: 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:13.988854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.989346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.989791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:13.990508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:13.991013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:13.991449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:14.007056 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] HTTP exception thrown: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Request method failure captured: Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 HTTP/1.1 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKZVmI3T1VLzezIEF0m3sB9oiI1o_7H1a4LshFaP1jfNA3ZHLH6lyZGcafDeNgvfCX3Y6AnTkPcTs5gu0cYs_YsoQWmvJyUMnqCrWl6u-r4x83dGHptuJFGPiWtL5dpIh5no4Tsr4z5X6Z7y6p82bFX0CviBJmjkiPQSQWCx3S40T6Q Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b36941b2ae43e2a42d2b1954623c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: a8b36941b2ae43e2a42d2b1954623c1f Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278474244 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 0be5e41e86e74c2485502f4da34aa3b0 Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278474244-project Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '960bb2f2-f8f9-4bfe-8858-dd5b8962ec13'} Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.008739 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Returning 404 to user: Instance 960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c27f977d-634f-4097-9d60-721d1b514382 tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13" status: 404 len: 111 microversion: 2.1 time: 0.034795 Oct 04 21:44:14.016134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3080/6264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:13 2022] GET /compute/v2.1/servers/960bb2f2-f8f9-4bfe-8858-dd5b8962ec13 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:44:19.210635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-feb00958-4580-4664-a6c4-b0c5fc815e9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] Calling method '.version_select at 0x7f54f5fc01f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:19.341268 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-feb00958-4580-4664-a6c4-b0c5fc815e9d tempest-TestNetworkAdvancedServerOps-278474244 tempest-TestNetworkAdvancedServerOps-278474244-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1533133801" status: 202 len: 0 microversion: 2.1 time: 0.133947 Oct 04 21:44:19.342031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3185/6265] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 4 21:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1533133801 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:44:25.241279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2724096c-eb41-4c05-8b92-8af348b52671 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: .version_select at 0x7f54f4f7c940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2105254854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSfPcbf4BL7xYt1pzjFbQu5d9DVSgXgPgH7dqpKqM2jbMJUMqOPVEYnaInL3NdRUzf2s2ne9AAh1R4h8tlZguORXsOEnr392KPjFYuK3D22U0NgySIbaXwx5gKjEL53Cg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:25.248003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:25.248839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:25.262198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2724096c-eb41-4c05-8b92-8af348b52671 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:25.268293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2724096c-eb41-4c05-8b92-8af348b52671 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:25.377764 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2724096c-eb41-4c05-8b92-8af348b52671 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.140651 Oct 04 21:44:25.378885 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3081/6266] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:44:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:29.251329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:29.252128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:29.256118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2119465822", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "d832a203-8828-439c-81d2-9d2dd2dcc484"}], "key_name": "tempest-TestNetworkBasicOps-2105254854", "security_groups": [{"name": "tempest-secgroup-smoke-54751526"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:29.373933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] validate_networks() for [('d832a203-8828-439c-81d2-9d2dd2dcc484', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:44:30.181554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:44:30.182188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:44:30.182883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:44:30.183317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:44:30.183736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:44:30.196589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.197369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.197969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.198846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:30.199597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:30.200067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:30.222822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:44:30.229009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:44:30.254437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:44:30.254437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:44:30.461609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-302e759a-0e2a-4d41-9c7c-0913f3db5d00 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.211556 Oct 04 21:44:30.462806 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3186/6267] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:44:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:44:30.477637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19305b92-c87f-476b-b5ca-008672c7d6b6 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:30.479611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19305b92-c87f-476b-b5ca-008672c7d6b6 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:30.546205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-19305b92-c87f-476b-b5ca-008672c7d6b6 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:30.554354 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19305b92-c87f-476b-b5ca-008672c7d6b6 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1249 microversion: 2.1 time: 0.082817 Oct 04 21:44:30.555343 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3082/6268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:30 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:31.584455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f00cf7d9-af9a-4c05-b1a3-617359bb1d2a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:31.585081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f00cf7d9-af9a-4c05-b1a3-617359bb1d2a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:31.641295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f00cf7d9-af9a-4c05-b1a3-617359bb1d2a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:31.648390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f00cf7d9-af9a-4c05-b1a3-617359bb1d2a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1249 microversion: 2.1 time: 0.070536 Oct 04 21:44:31.648983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3187/6269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:31 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:32.673515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:32.675450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:32.684844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.685668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.686279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.687225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:32.688341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:32.689019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:32.790601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:32.803300 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ee747d9-db32-40d4-9610-6dec431cbfc8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1301 microversion: 2.1 time: 0.134188 Oct 04 21:44:32.804311 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3083/6270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:32 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1301 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:33.829378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:33.830008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:33.838045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.839581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.840236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.841759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:33.842441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:33.843098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:33.920031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:33.933440 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c635917b-d6a9-4710-9983-84871b189019 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1319 microversion: 2.1 time: 0.108471 Oct 04 21:44:33.935259 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3188/6271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:33 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:34.958270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:34.958850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:34.966487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.973832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.973832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:34.973832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:34.973832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:34.973832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.193485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:35.202473 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e79244cd-cee5-4224-aebb-d0bca5d87c56 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.248172 Oct 04 21:44:35.203502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3084/6272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:34 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:35.775509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b508fb67-39dc-49d1-b83e-4d865e49650c", "tag": "99760537-fc08-4726-a8d5-9e63f1303d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:35.788159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:35.788879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:35.789417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:35.802164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] Creating event network-changed:99760537-fc08-4726-a8d5-9e63f1303d7f for instance b508fb67-39dc-49d1-b83e-4d865e49650c on n-h2-851029-13 Oct 04 21:44:35.807744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e62fe47f-6fea-4b84-a408-8abdbb6356da req-e1a8ada6-3a1b-4c66-9bfe-c6f948ff11a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036989 Oct 04 21:44:35.808473 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3189/6273] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:36.228894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:36.229569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:36.238461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.238996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.239451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.240277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:36.240782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:36.241252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:36.497713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:36.506717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-880238c6-f228-478a-9053-49e26dca255e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.282075 Oct 04 21:44:36.507341 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3085/6274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:36 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:44:37.534044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:37.534808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:37.542140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.542632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.543102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.544292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:37.544778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:37.546187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:37.693188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:37.701038 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1143972c-5f39-4ea2-9ae3-b9cead337d47 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.172557 Oct 04 21:44:37.701619 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3190/6275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:37 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:38.723590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:38.724194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:38.731517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.732010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.732458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.733168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:38.733619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:38.734045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:38.881432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:38.896627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34f1ac54-2fb2-4fd4-b126-d3806c52aa85 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.175139 Oct 04 21:44:38.898739 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3086/6276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:38 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:39.921419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:39.922716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:39.929704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:39.930121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:39.930971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:39.931678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:39.932136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:39.932563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:40.089828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:40.098721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60649d78-ac4c-4ab6-a3fa-2f2da165666b tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.181654 Oct 04 21:44:40.099518 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3191/6277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:39 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:41.125654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:41.126966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:41.135337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:41.137774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.138831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.139800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.150536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:41.150536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:41.163211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:41.335691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:41.343911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa6aa650-6e9a-42ec-89fd-3186349f5bae tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.223223 Oct 04 21:44:41.344505 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3087/6278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:41 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:42.183616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b508fb67-39dc-49d1-b83e-4d865e49650c", "name": "network-vif-plugged", "status": "completed", "tag": "99760537-fc08-4726-a8d5-9e63f1303d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:44:42.190187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:42.191857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:44:42.197297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.197782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.198212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.210392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] Creating event network-vif-plugged:99760537-fc08-4726-a8d5-9e63f1303d7f for instance b508fb67-39dc-49d1-b83e-4d865e49650c on n-h2-851029-13 Oct 04 21:44:42.216177 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-96113dd7-d652-49e4-bb65-6b7170b77a1d req-60886b35-bccd-46cf-883c-6ce4ceec934b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037735 Oct 04 21:44:42.216826 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3192/6279] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:44:42.371507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:42.372740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:42.388075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.388884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.389924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.391096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:42.391808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:42.392484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:42.569132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:42.577517 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cede3e3c-9571-41ad-a31f-d6fca2ed0c82 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.210968 Oct 04 21:44:42.578124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3088/6280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:42 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:43.610970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:43.618522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:43.625945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.626864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.627659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.629042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:43.629905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:43.630743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:43.796507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:43.805667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d03ad2f-7f9b-4e62-b666-77a551a36840 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1373 microversion: 2.1 time: 0.206088 Oct 04 21:44:43.806447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3193/6281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:43 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:44.830506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:44.831196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:44.839408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:44.840764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:44.841471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:44.844659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:44.844659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:44.845022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.006838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:45.017037 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0496c37e-c703-4365-924b-8495c1eef291 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1545 microversion: 2.1 time: 0.190632 Oct 04 21:44:45.017643 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3089/6282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:44 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1545 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:44:45.041579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:44:45.042339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:44:45.050272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.050930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.051382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.052109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:44:45.052903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:44:45.053415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:44:45.212567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:44:45.222107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-897b252f-11d6-48c3-a359-4dd795c1e362 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1545 microversion: 2.1 time: 0.185008 Oct 04 21:44:45.222731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3194/6283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:44:45 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1545 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:10.023135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:10.024263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:10.028900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:10.029969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:10.036015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.036726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.037563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.039214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.040009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.040834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.083717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:45:10.416780 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ffb07d0-2276-42e9-a5cb-eb5be5b79482 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 204 len: 0 microversion: 2.1 time: 0.394982 Oct 04 21:45:10.418460 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3090/6284] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:45:10 2022] DELETE /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:45:10.427815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:10.429080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:10.435569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:10.436741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:10.438986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.439647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.440264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.441247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:10.441708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:10.442313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:10.625445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:10.634420 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b623c4e-ca19-4b2d-b4ec-0300f72f41bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1551 microversion: 2.1 time: 0.210976 Oct 04 21:45:10.635129 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3195/6285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:10 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:11.665653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:11.666691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:11.675892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:11.676579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:11.677278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:11.678490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:11.679252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:11.679797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:11.945023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:11.960291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0feb3894-a246-47c0-90fc-e297e33179e3 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1551 microversion: 2.1 time: 0.299124 Oct 04 21:45:11.961493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3091/6286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:11 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1551 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:12.553777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b508fb67-39dc-49d1-b83e-4d865e49650c", "name": "network-vif-deleted", "tag": "99760537-fc08-4726-a8d5-9e63f1303d7f"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:12.564784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:12.565263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:12.565694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:12.578862 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] Creating event network-vif-deleted:99760537-fc08-4726-a8d5-9e63f1303d7f for instance b508fb67-39dc-49d1-b83e-4d865e49650c on n-h2-851029-13 Oct 04 21:45:12.584313 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ab374552-7547-48e6-a911-a2ed72cec384 req-6e4cef79-00a7-4be7-a6a2-451bd342e51e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034875 Oct 04 21:45:12.584922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3196/6287] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:13.002805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:13.003491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:13.012754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.013291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.013737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.014465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.015107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.015721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.056697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:13.057178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:13.058346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:13.058828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lazy-loading 'fault' on Instance uuid b508fb67-39dc-49d1-b83e-4d865e49650c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:13.108559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:13.116354 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a4b7a99-fa8c-4c54-8916-6e67f34003f8 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 200 len: 1339 microversion: 2.1 time: 0.117601 Oct 04 21:45:13.117486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3092/6288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:12 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:14.158195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:14.158949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: b508fb67-39dc-49d1-b83e-4d865e49650c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:14.167856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:14.168353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:14.168799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:14.169505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:14.169965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:14.170396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:14.187969 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] HTTP exception thrown: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Request method failure captured: Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c HTTP/1.1 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKi6pmgYkVmUHYDQC-DooX_lw6fDQSY3BHAPIcTare905U0kr8JR8emDsJGih_kecFF_R8W7_aqye6jso4rPGa7dhZ6FM10CAyOVKEjzGPoC4x1pPq7hADqu3jom6GBUZhDl3_eokBfri-oBTVqT9KoIwuhJr3kJYK_aULzeEtPGa1s Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 9e4ea4cf61ee4073b23b2ee7e268c507 Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b508fb67-39dc-49d1-b83e-4d865e49650c'} Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:14.189986 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Returning 404 to user: Instance b508fb67-39dc-49d1-b83e-4d865e49650c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79e164c0-4af1-4e65-ac97-5f67042f3cee tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c" status: 404 len: 111 microversion: 2.1 time: 0.038621 Oct 04 21:45:14.201411 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3197/6289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:14 2022] GET /compute/v2.1/servers/b508fb67-39dc-49d1-b83e-4d865e49650c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:45:14.540963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-868e1835-f019-4329-b938-53ac2e1af197 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '.version_select at 0x7f54fa4d4ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:14.646288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-868e1835-f019-4329-b938-53ac2e1af197 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2105254854" status: 202 len: 0 microversion: 2.1 time: 0.109208 Oct 04 21:45:14.647251 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3093/6290] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 21:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2105254854 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:17.916421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:17.917662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:17.920010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1546b1ca-69fd-44fc-b6d9-368f13de0bab", "tag": "fd2397b4-8110-4d55-a023-4d8958120a9c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:17.930471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.934175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.934175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.934957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.936009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.937096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.938477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:17.939075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:17.939596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:17.954624 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] Creating event network-changed:fd2397b4-8110-4d55-a023-4d8958120a9c for instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab on n-h1-851029-13 Oct 04 21:45:17.960594 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-74294ad4-b7f7-473c-be9e-dfa6f9b7cf3a req-9ea0cc93-a163-4123-b242-1814edc6eae2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048058 Oct 04 21:45:17.961424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3094/6291] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:45:17.986430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:45:18.672546 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c1fae99-6db7-457a-a27e-a98a0e7f72bc tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 204 len: 0 microversion: 2.1 time: 0.757852 Oct 04 21:45:18.673653 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3198/6292] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:45:17 2022] DELETE /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 0 bytes in 765 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:45:18.692246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:18.693793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:18.701651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:18.702370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:18.703354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:18.704138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:18.704591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:18.705022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:18.887718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:18.899130 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d9afd9b-7b6b-4fd5-897b-cb7c768c3b9f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1672 microversion: 2.1 time: 0.217508 Oct 04 21:45:18.900002 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3095/6293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:18 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:19.929158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:19.930396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:19.944621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.945791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.946765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:19.948704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:19.949541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:19.950748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.177527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:20.193539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ff072a5-81d5-4e64-b1b4-a85e00e10096 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1553 microversion: 2.1 time: 0.270398 Oct 04 21:45:20.194392 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3199/6294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:19 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1553 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:20.826595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1546b1ca-69fd-44fc-b6d9-368f13de0bab", "name": "network-vif-deleted", "tag": "fd2397b4-8110-4d55-a023-4d8958120a9c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:20.838403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:20.842291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:20.842291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:20.856714 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] Creating event network-vif-deleted:fd2397b4-8110-4d55-a023-4d8958120a9c for instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab on n-h1-851029-13 Oct 04 21:45:20.865953 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a4fe5f5b-6bbc-45a0-b37b-593e022d9d31 req-a3f538cd-40a6-4db4-a4fe-85cf613ef195 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042962 Oct 04 21:45:20.867138 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3096/6295] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:21.218548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:21.227024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:21.227532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.228049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.228467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.229211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.229706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.230263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.284352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:21.284771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:21.285219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:21.285685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lazy-loading 'fault' on Instance uuid 1546b1ca-69fd-44fc-b6d9-368f13de0bab {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:45:21.361261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:21.370330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73e49c7a-9083-46e3-a758-36c739e2a4c5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 200 len: 1338 microversion: 2.1 time: 0.155323 Oct 04 21:45:21.371540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3200/6296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:21 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 1338 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:22.400478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:22.401331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: 1546b1ca-69fd-44fc-b6d9-368f13de0bab] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:22.409394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.409960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.410459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.411416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:22.411993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:22.412511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:22.429906 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] HTTP exception thrown: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Request method failure captured: Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab HTTP/1.1 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKi6pmgYkVmUHYDQC-DooX_lw6fDQSY3BHAPIcTare905U0kr8JR8emDsJGih_kecFF_R8W7_aqye6jso4rPGa7dhZ6FM10CAyOVKEjzGPoC4x1pPq7hADqu3jom6GBUZhDl3_eokBfri-oBTVqT9KoIwuhJr3kJYK_aULzeEtPGa1s Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9e4ea4cf61ee4073b23b2ee7e268c507 Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1546b1ca-69fd-44fc-b6d9-368f13de0bab'} Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:45:22.431934 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Returning 404 to user: Instance 1546b1ca-69fd-44fc-b6d9-368f13de0bab could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6a080cf-a20a-4c76-9eab-85d8c1280ae5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab" status: 404 len: 111 microversion: 2.1 time: 0.040119 Oct 04 21:45:22.439925 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3097/6297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:22 2022] GET /compute/v2.1/servers/1546b1ca-69fd-44fc-b6d9-368f13de0bab => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:45:22.710154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe4c483e-829d-480f-b376-b313e7b8e08f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '.version_select at 0x7f54f5545280>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:22.837082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe4c483e-829d-480f-b376-b313e7b8e08f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1221051358" status: 202 len: 0 microversion: 2.1 time: 0.132383 Oct 04 21:45:22.837876 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3201/6298] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 4 21:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1221051358 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:45:37.010970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eda87408-5189-429a-8a89-d31c9af27f44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: .version_select at 0x7f54f4f43e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-101389984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUebwNtDP26MGLRxQNTxQcJQvIAoCWVMGgYvrKvdAoAx4+yZkRvOk/dxTd8lFii6u8atlRGgWwgMHtkbUmDts6Lzt542rnGJLhh3cB9M+ilcgq9koYnzm/BUzjE9O9OYQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:37.019511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:37.020385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:37.033929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-eda87408-5189-429a-8a89-d31c9af27f44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:37.040353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-eda87408-5189-429a-8a89-d31c9af27f44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:37.198799 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eda87408-5189-429a-8a89-d31c9af27f44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.192129 Oct 04 21:45:37.199972 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3098/6299] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:45:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:40.949094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-303190052", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "47ce256a-f43b-42aa-8644-5c45bb8d9069"}], "key_name": "tempest-TestNetworkBasicOps-101389984", "security_groups": [{"name": "tempest-secgroup-smoke-2012373334"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:40.961137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:40.971277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:41.083277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] validate_networks() for [('47ce256a-f43b-42aa-8644-5c45bb8d9069', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:45:41.554727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:45:41.554727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:45:41.555132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:45:41.555867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:45:41.557092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:45:41.570838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.571600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.572416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.573690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:41.574468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:41.575234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:41.609719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:45:41.620507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Getting quotas for user 9e4ea4cf61ee4073b23b2ee7e268c507 and project 963fa338c3fe43adbeb85d3b6cb70d74. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:45:41.642772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:45:41.647173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:45:41.795026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e943ceb-7a07-479a-b75a-abb1e82082fb tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.849966 Oct 04 21:45:41.796403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3202/6300] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:45:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:45:41.823688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d48cb15-c737-4a6e-92f8-4a6b3260fc7e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:41.825242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d48cb15-c737-4a6e-92f8-4a6b3260fc7e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:41.937864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d48cb15-c737-4a6e-92f8-4a6b3260fc7e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:41.953210 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d48cb15-c737-4a6e-92f8-4a6b3260fc7e tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1247 microversion: 2.1 time: 0.143312 Oct 04 21:45:41.954259 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3099/6301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:41 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1247 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:42.979702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:42.980847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:42.988523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.989026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.989471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:42.990242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:42.990729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:42.991174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:43.079705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:43.090006 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-853b6620-c26e-4693-803b-5cce221f8fec tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1251 microversion: 2.1 time: 0.116053 Oct 04 21:45:43.098065 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3203/6302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:42 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1251 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:44.131876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:44.132799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:44.149374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.149868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.150370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.151127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:44.151594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:44.152021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:44.239323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:44.251791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-033c29a8-0f0c-42e1-bf90-8ff3bc48a1c1 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1299 microversion: 2.1 time: 0.125976 Oct 04 21:45:44.252528 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3100/6303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:44 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:45.284007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:45.286729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:45.304871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.307202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.307796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.309220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:45.310168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:45.310994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:45.434988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:45.451794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c96eb68b-47ca-466f-9f22-54d305ac98ed tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1305 microversion: 2.1 time: 0.177038 Oct 04 21:45:45.453151 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3204/6304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:45 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:46.488660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:46.489389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:46.496618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.497090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.497568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.498313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:46.498794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:46.499224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:46.757185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:46.769490 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3502ae00-56cb-4ef7-8767-183553c6a0fa tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.285588 Oct 04 21:45:46.770459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3101/6305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:46 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:47.156972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece928b9-7c6b-40a5-b0ee-e0f8517db4fc", "tag": "2c78b35f-dd46-4f54-8d5a-a27831249a87"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:47.176730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.178234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.179050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.201968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] Creating event network-changed:2c78b35f-dd46-4f54-8d5a-a27831249a87 for instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc on n-h2-851029-13 Oct 04 21:45:47.211312 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e4fcaf9f-8f34-4e6e-b20f-b878aa3125d5 req-4e7541c3-7025-4ee2-a82e-5655c9fbfd83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058334 Oct 04 21:45:47.211312 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3205/6306] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:47.795494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:47.799643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:47.803588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.804114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.804505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:47.805256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:47.805700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:47.806124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:48.031775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:48.040235 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80881d19-4647-437e-9fa6-d86d0beca81f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.249130 Oct 04 21:45:48.041550 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3102/6307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:47 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:49.068293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:49.069337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:49.086859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:49.254750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:49.262725 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ff7dee4-e125-4cd9-8953-4f48c50bcbf9 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.201380 Oct 04 21:45:49.263332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3206/6308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:49 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:50.285716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:50.286346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:50.294208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:50.294711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:50.295258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:50.295854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:50.296299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:50.296722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:50.453295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:50.462835 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ddf53a1-4b70-47c8-993c-9133648ba300 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.181023 Oct 04 21:45:50.463447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3103/6309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:50 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:51.485698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:51.486246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:51.494413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.494927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.495366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.496127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:51.496518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:51.496974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:51.590568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:51.631245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:51.656381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:51.665233 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0473199c-aa9b-47f4-a2f1-a66373b09c6a tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.183433 Oct 04 21:45:51.665846 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3207/6310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:51 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:45:52.690440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:52.691093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:52.693261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:52.699017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.699491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.699995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.700665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:52.701121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:52.701550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:52.866890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:52.877291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7993c384-e661-4658-82d4-5ab34f77741f tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.191367 Oct 04 21:45:52.878293 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3104/6311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:52 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:53.902337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:53.902902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:53.910684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.911237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.911684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:53.912403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:53.912867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:53.913306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.058356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:54.067060 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-877aed7e-b3a9-49a0-a56e-22c399bb6450 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.169219 Oct 04 21:45:54.067619 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3208/6312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:53 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:54.583597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece928b9-7c6b-40a5-b0ee-e0f8517db4fc", "name": "network-vif-plugged", "status": "completed", "tag": "2c78b35f-dd46-4f54-8d5a-a27831249a87"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:54.595091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:54.595574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:54.596005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:54.607869 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] Creating event network-vif-plugged:2c78b35f-dd46-4f54-8d5a-a27831249a87 for instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc on n-h2-851029-13 Oct 04 21:45:54.613167 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c8c7ebb1-7155-42ad-a285-b0647ac05077 req-0101e3b5-4d43-4e9e-b1eb-427ad010598a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Oct 04 21:45:54.613785 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3105/6313] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:45:55.091755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:55.092428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:55.100371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.100864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.101349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.102064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:55.102531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:55.103040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:55.262133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:55.273604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d671645-d126-45a2-b15a-c1e45559a826 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1373 microversion: 2.1 time: 0.187530 Oct 04 21:45:55.274186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3209/6314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:55 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.299060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.299715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.307020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.307516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.307955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.308723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.309193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.309623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.503811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.512814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61b00a92-3a4c-42aa-957e-57de63642377 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1546 microversion: 2.1 time: 0.218961 Oct 04 21:45:56.513431 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3106/6315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1546 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:56.554935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:56.556039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:56.568366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.569249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.570038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.571337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:56.572189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:56.573440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:56.735156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:56.750833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b6c837f-5cbc-4197-bcc7-c752ee945865 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1546 microversion: 2.1 time: 0.203142 Oct 04 21:45:56.754823 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3210/6316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:56 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:59.404731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece928b9-7c6b-40a5-b0ee-e0f8517db4fc", "tag": "2c78b35f-dd46-4f54-8d5a-a27831249a87"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:59.419094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:59.419742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:59.420284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:59.434748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] Creating event network-changed:2c78b35f-dd46-4f54-8d5a-a27831249a87 for instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc on n-h2-851029-13 Oct 04 21:45:59.441123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8328760f-254c-4312-a782-325abdb6a995 req-ea4abfc4-ad61-49db-91cf-3b8cc7157cdc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040999 Oct 04 21:45:59.442047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3107/6317] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:14.299364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:14.300874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=46 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:14.422817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa457463-b7f3-4fad-8c2d-1388d2c1e4b4 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-678844962", "availability_zone": "foo_zone"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:14.426585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.aggregate [None req-aa457463-b7f3-4fad-8c2d-1388d2c1e4b4 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Generated uuid 86cb3915-8279-4fca-a54e-4747cd586335 for aggregate {{(pid=123541) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:46:14.584804 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa457463-b7f3-4fad-8c2d-1388d2c1e4b4 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.291792 Oct 04 21:46:14.585813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3211/6318] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 4 21:46:14 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.595709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:14.601993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:14.601993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d53f4dd5-a13a-4075-87e9-f78bda4ce1e3 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:14.735728 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d53f4dd5-a13a-4075-87e9-f78bda4ce1e3 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.141962 Oct 04 21:46:14.736404 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3108/6319] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 21:46:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.753219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.757483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.757979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.758445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.759221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.759680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.760114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:14.785141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0649a31c-55c8-4f3d-acad-f7bdccbb5407 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039436 Oct 04 21:46:14.785768 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3212/6320] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.799050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bdfe19b-6687-45a2-a8a5-481ea91f59d0 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:14.808426 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bdfe19b-6687-45a2-a8a5-481ea91f59d0 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013271 Oct 04 21:46:14.809103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3109/6321] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 4 21:46:14 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:14.820892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d34260c3-90f8-4c5e-9ab7-158029df718d tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851029-13"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:14.833325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d34260c3-90f8-4c5e-9ab7-158029df718d tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:14.833805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d34260c3-90f8-4c5e-9ab7-158029df718d tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:14.834238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d34260c3-90f8-4c5e-9ab7-158029df718d tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.398995 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d34260c3-90f8-4c5e-9ab7-158029df718d tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.581822 Oct 04 21:46:15.400279 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3213/6322] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 21:46:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:15.411842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94dd27a4-7b16-45ef-88e2-fad7c207109f tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.420673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94dd27a4-7b16-45ef-88e2-fad7c207109f tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.012797 Oct 04 21:46:15.421244 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3110/6323] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:15.432858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2956b2c9-8ca8-4d10-a86f-97cc320d0211 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1005319459", "availability_zone": "foo_zone"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:15.618375 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2956b2c9-8ca8-4d10-a86f-97cc320d0211 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.189154 Oct 04 21:46:15.619281 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3214/6324] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 4 21:46:15 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:15.630309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76845115-8c19-4f55-8d6e-fde657900a81 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:15.823903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76845115-8c19-4f55-8d6e-fde657900a81 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.197117 Oct 04 21:46:15.824750 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3111/6325] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 21:46:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:15.839550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f3b90b0-18e5-4a87-a305-88eab2c21290 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:15.845104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f3b90b0-18e5-4a87-a305-88eab2c21290 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.012753 Oct 04 21:46:15.845793 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3215/6326] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 4 21:46:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:15.857974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c23cc948-8d75-4dc7-960f-41f4d07f49ce tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851029-13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:15.869313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c23cc948-8d75-4dc7-960f-41f4d07f49ce tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.869795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c23cc948-8d75-4dc7-960f-41f4d07f49ce tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.870231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c23cc948-8d75-4dc7-960f-41f4d07f49ce tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.317917 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c23cc948-8d75-4dc7-960f-41f4d07f49ce tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.463645 Oct 04 21:46:16.507691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3112/6327] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 4 21:46:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:16.508248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-35f2445e-d3f9-49e2-8eed-9be1173b74c0 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:16.535990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-35f2445e-d3f9-49e2-8eed-9be1173b74c0 tempest-TestAggregatesBasicOps-1324214695 tempest-TestAggregatesBasicOps-1324214695-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.203983 Oct 04 21:46:16.536591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3216/6328] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 4 21:46:16 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:46:21.806096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:21.808555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.814640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.815230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.815697 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.816397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.816853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.817276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.871450 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a50d2e2d-ed62-4171-b267-d95c2283891c tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc/action" status: 200 len: 24575 microversion: 2.1 time: 0.070218 Oct 04 21:46:21.872203 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3113/6329] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:21 2022] POST /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:46:31.798514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:31.799316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:31.799986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:31.918370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1450304774", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "e9cda077-53c4-43c8-8059-d5c11e4fb00a"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:31.974886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] validate_networks() for [('e9cda077-53c4-43c8-8059-d5c11e4fb00a', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:32.641514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:32.641943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:32.642470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:32.642953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:32.643480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:32.653471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.654002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.654458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.655278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:32.655751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:32.656740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:32.675560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Getting quotas for project 43f0e80a2cb1475ba03639ac24ef049a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:32.682546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Getting quotas for user 58b28615aab247f49f07ff612844dc3f and project 43f0e80a2cb1475ba03639ac24ef049a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:32.696085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:32.698426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:32.822833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a28eda25-0404-4c50-8962-fe8abe422781 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025810 Oct 04 21:46:32.823844 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3217/6330] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:46:32.845280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-180e6957-cc0a-445c-b7d0-42d6514d405d tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:32.847834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-180e6957-cc0a-445c-b7d0-42d6514d405d tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:32.851369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:32.853171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:32.967229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-180e6957-cc0a-445c-b7d0-42d6514d405d tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:32.975685 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-180e6957-cc0a-445c-b7d0-42d6514d405d tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1215 microversion: 2.1 time: 0.137734 Oct 04 21:46:32.977113 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3114/6331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:32 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:33.026298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:33.030096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:33.042274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.042893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.043348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.044186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:33.044526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:33.044955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:33.100554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ecdc39e-bd8f-4c33-9965-95af5fa5b4d5 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "POST /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc/action" status: 200 len: 32643 microversion: 2.1 time: 0.082452 Oct 04 21:46:33.106763 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3218/6332] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:33 2022] POST /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:46:34.009726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c65c3d1-1819-4227-93bc-cfa95711f21a tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.010395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c65c3d1-1819-4227-93bc-cfa95711f21a tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.086457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c65c3d1-1819-4227-93bc-cfa95711f21a tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.093620 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c65c3d1-1819-4227-93bc-cfa95711f21a tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1215 microversion: 2.1 time: 0.088080 Oct 04 21:46:34.094204 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3115/6333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:34.323027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.324226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.325039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece928b9-7c6b-40a5-b0ee-e0f8517db4fc", "tag": "2c78b35f-dd46-4f54-8d5a-a27831249a87"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:34.332025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.332784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.333222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.334003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.335756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.336911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.338652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.339274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.339794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.353578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] Creating event network-changed:2c78b35f-dd46-4f54-8d5a-a27831249a87 for instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc on n-h2-851029-13 Oct 04 21:46:34.359627 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-63427547-e01e-45da-bb9b-c7898eafdbcb req-c30266b6-5608-4591-82da-6dc7d773eacb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038794 Oct 04 21:46:34.360405 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3116/6334] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:34.367812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:34.783122 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cb21dbd-1cc5-49e5-bd70-9c6dc689dc44 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 204 len: 0 microversion: 2.1 time: 0.464206 Oct 04 21:46:34.784037 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3219/6335] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:34 2022] DELETE /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:34.794048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:34.795108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:34.802333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.803437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.804303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.805211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:34.805723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:34.806324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:34.958907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:34.968292 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9d9bff7-7540-432d-99c0-607da2c40a81 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1671 microversion: 2.1 time: 0.179290 Oct 04 21:46:34.982697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3117/6336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:34 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:35.118561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:35.119285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:35.128556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:35.128982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:35.129427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:35.130189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:35.130652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:35.131105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:35.216623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:35.224983 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06546df4-8361-42fd-b302-c394f55cdc86 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1267 microversion: 2.1 time: 0.111305 Oct 04 21:46:35.225582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3220/6337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:35 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:35.996525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:35.997603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.009198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.009911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.010570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.011657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.012341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.012832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.160938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:36.169267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b00b50ab-ad0a-4696-b3c5-bc7e14d3141d tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1671 microversion: 2.1 time: 0.179719 Oct 04 21:46:36.169875 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3118/6338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:35 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:36.261171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:36.261790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:36.270282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.270835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.272257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.273030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.274083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.274783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.349949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:36.359155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d9c1ed4-6536-42c7-9a57-dab9f9a90a30 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1273 microversion: 2.1 time: 0.104876 Oct 04 21:46:36.360733 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3221/6339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:36 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:36.818520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece928b9-7c6b-40a5-b0ee-e0f8517db4fc", "name": "network-vif-deleted", "tag": "2c78b35f-dd46-4f54-8d5a-a27831249a87"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:36.828767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:36.829298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:36.829927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:36.841332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] Creating event network-vif-deleted:2c78b35f-dd46-4f54-8d5a-a27831249a87 for instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc on n-h2-851029-13 Oct 04 21:46:36.846832 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-17082729-5046-4db3-8c47-21ea2ec74521 req-877cabe4-ed5f-4293-921c-458c6f6d2aa2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032277 Oct 04 21:46:36.847857 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3119/6340] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:37.195121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:37.195777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:37.204405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.205215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.205832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.206835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.207460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.208087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.253336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.253336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.253849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.254377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lazy-loading 'fault' on Instance uuid ece928b9-7c6b-40a5-b0ee-e0f8517db4fc {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:37.303079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e4ea4cf61ee4073b23b2ee7e268c507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '963fa338c3fe43adbeb85d3b6cb70d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.311452 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0be22eb6-cb2f-4001-887b-6806bdc1b746 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 200 len: 1337 microversion: 2.1 time: 0.121359 Oct 04 21:46:37.312606 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3222/6341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:37 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:37.396653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:37.403516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:37.416290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.416903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.417421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.418388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:37.418957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:37.419474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:37.584892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:37.599225 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89efb584-7fba-4aa0-8619-f7f89f18dbe6 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.206731 Oct 04 21:46:37.600303 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3120/6342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:37 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.254827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36818198-e27d-4df1-9014-8a6ecec395cf", "tag": "bec15c13-3d3a-466e-ab29-f28547d98aae"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:38.266684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.270333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.270333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.279986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] Creating event network-changed:bec15c13-3d3a-466e-ab29-f28547d98aae for instance 36818198-e27d-4df1-9014-8a6ecec395cf on n-h1-851029-13 Oct 04 21:46:38.285150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-00e5b1be-0e9a-4efc-83ea-3d2eaa055323 req-663a252d-d0e9-423d-bf05-66a60f575068 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Oct 04 21:46:38.286049 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3223/6343] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:38.336210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.336866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] [instance: ece928b9-7c6b-40a5-b0ee-e0f8517db4fc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.343328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.343824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.344260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.344971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.345432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.345997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.360103 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] HTTP exception thrown: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Request method failure captured: Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc HTTP/1.1 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKi6pmgYkVmUHYDQC-DooX_lw6fDQSY3BHAPIcTare905U0kr8JR8emDsJGih_kecFF_R8W7_aqye6jso4rPGa7dhZ6FM10CAyOVKEjzGPoC4x1pPq7hADqu3jom6GBUZhDl3_eokBfri-oBTVqT9KoIwuhJr3kJYK_aULzeEtPGa1s Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_963fa338c3fe43adbeb85d3b6cb70d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 963fa338c3fe43adbeb85d3b6cb70d74 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkBasicOps-2134864928 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 9e4ea4cf61ee4073b23b2ee7e268c507 Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkBasicOps-2134864928-project Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'ece928b9-7c6b-40a5-b0ee-e0f8517db4fc'} Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:38.364975 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Returning 404 to user: Instance ece928b9-7c6b-40a5-b0ee-e0f8517db4fc could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd373eb4-f393-4ed8-b27d-0a21dc221767 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc" status: 404 len: 111 microversion: 2.1 time: 0.031869 Oct 04 21:46:38.371042 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3121/6344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/ece928b9-7c6b-40a5-b0ee-e0f8517db4fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:38.637054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:38.637776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:38.644766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.645204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.645650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.646364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:38.646942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:38.647375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:38.805947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:38.810307 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6be2c155-9def-4d0f-ac37-f68eb3446456 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.177349 Oct 04 21:46:38.811409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3224/6345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:38 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:38.919813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0303e5c8-81b2-4928-8408-437b547d7f88 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] Calling method '.version_select at 0x7f54f4f60160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.058383 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0303e5c8-81b2-4928-8408-437b547d7f88 tempest-TestNetworkBasicOps-2134864928 tempest-TestNetworkBasicOps-2134864928-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-101389984" status: 202 len: 0 microversion: 2.1 time: 0.144485 Oct 04 21:46:39.059056 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3122/6346] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 21:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-101389984 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:39.835942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:39.837140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:39.845717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.846289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.846823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:39.847590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:39.848123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:39.848546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:40.092488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:40.100585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22f4902c-af2b-4e81-955f-f9fdf88d430e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.270473 Oct 04 21:46:40.101182 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3225/6347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:39 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:41.132008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:41.138707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:41.150227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.150988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.151934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.153468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:41.154379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:41.155213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:41.433133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:41.445348 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df627b9f-8acd-4887-bf60-7a0ef0890013 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.322959 Oct 04 21:46:41.446296 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3123/6348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:41 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:42.468499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.469139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.491046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.653073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.661206 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-376c1100-d110-4d83-996f-ad70956dfc39 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.196595 Oct 04 21:46:42.661810 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3226/6349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.688095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.688760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.697008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.697473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.698102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.698882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:43.699347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:43.699777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:43.837893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.845715 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d055eb63-e690-4c8b-9038-59be1774dd7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.163415 Oct 04 21:46:43.846304 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3124/6350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.378252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:44.379108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:44.385233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36818198-e27d-4df1-9014-8a6ecec395cf", "name": "network-vif-plugged", "status": "completed", "tag": "bec15c13-3d3a-466e-ab29-f28547d98aae"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:44.395655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.396126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.396575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.410042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] Creating event network-vif-plugged:bec15c13-3d3a-466e-ab29-f28547d98aae for instance 36818198-e27d-4df1-9014-8a6ecec395cf on n-h1-851029-13 Oct 04 21:46:44.416091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-75b27dad-b991-4f93-9ee1-f46687c02aa4 req-34427908-278c-4842-86ce-ece87542307b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038460 Oct 04 21:46:44.417280 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3227/6351] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:44.869354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.870059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:44.872456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:44.879800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.880531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.881044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:44.881976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:44.882550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:44.883057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:45.030246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:45.039618 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-132138fc-0d56-42a5-b37a-4e8388ec6779 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.173649 Oct 04 21:46:45.040049 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3125/6352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:46.067954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:46.068665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.076812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.077314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.077761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.078482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:46.078981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:46.079417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:46.261167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.271747 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-847dd4a4-5252-4a89-bd6a-c401affffbc0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1315 microversion: 2.1 time: 0.208742 Oct 04 21:46:46.278703 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3228/6353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:46 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:47.296405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.297001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.305102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.305588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.306020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.306744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.307204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.307628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.464226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.472184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-306e716f-8e07-427b-934b-37e213a10d11 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1503 microversion: 2.1 time: 0.179651 Oct 04 21:46:47.472778 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3126/6354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:47.497916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.498700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.506484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.507159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.507685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.508524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.509080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.509636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.656486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.668248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c1e69d1-3889-4721-ab6e-e9323a01a47b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1503 microversion: 2.1 time: 0.173759 Oct 04 21:46:47.674623 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3229/6355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:47.696491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:47.697371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.708238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.709126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.709931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.711879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.712721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.713506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.738694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lazy-loading 'flavor' on Instance uuid 36818198-e27d-4df1-9014-8a6ecec395cf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:48.084065 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6c55c99-0782-4f3e-8719-7c24c4ed3d15 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action" status: 202 len: 0 microversion: 2.1 time: 0.395859 Oct 04 21:46:48.084728 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3127/6356] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:47 2022] POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:46:48.093432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.094069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.100314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.100806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.101291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.101998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.102456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.102923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.251167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.279460 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43e7b710-834a-4cbd-ab20-3fa84158cb03 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1511 microversion: 2.1 time: 0.170857 Oct 04 21:46:48.279460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3230/6357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:49.286020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.286911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.295329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.296168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.296855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.297653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.298195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.298725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.460739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.470530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-691fc772-0579-4f1b-874f-2794b525455b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1494 microversion: 2.1 time: 0.190568 Oct 04 21:46:49.475256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3128/6358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1494 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:49.497559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:49.502377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.506093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.506597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.507087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.508395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.508825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.509256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.807692 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f771a859-ea2f-4f5e-9245-56aae9113df0 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action" status: 202 len: 0 microversion: 2.1 time: 0.313656 Oct 04 21:46:49.810786 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3231/6359] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:49 2022] POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:49.818530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.819189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.825966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.826453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.826927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.827646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.828103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.828530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.140559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.150043 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b500d588-4637-49c4-b9e4-f1a9ce07fd07 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1500 microversion: 2.1 time: 0.335689 Oct 04 21:46:50.151708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3129/6360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1500 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:51.175555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:51.176335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:51.186326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.186756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.187294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.188477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:51.189087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:51.189498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:51.424753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:51.428386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:51.433348 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e24827af-0825-48f1-8136-ff97781c41dc tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1500 microversion: 2.1 time: 0.263384 Oct 04 21:46:51.433928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3232/6361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1500 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:52.459833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:52.460655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.468678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.469345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.469967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.471136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.471610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.472047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.740924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.751447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3980ff18-7871-4a78-8526-d97917c6f2c8 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1503 microversion: 2.1 time: 0.296411 Oct 04 21:46:52.752227 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3130/6362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:52 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:52.776773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:52.777323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.785622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.786104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.786746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.787458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.787967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.789185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.818210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lazy-loading 'flavor' on Instance uuid 36818198-e27d-4df1-9014-8a6ecec395cf {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:53.374652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6edf020e-e5aa-41ac-8f07-9f6403b2b011 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action" status: 202 len: 0 microversion: 2.1 time: 0.601092 Oct 04 21:46:53.379447 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3233/6363] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:52 2022] POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:53.384647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.385264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.391787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.392455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.393366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.394421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.395073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.395493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.658852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.671834 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-602930f7-f013-48dd-b4f1-dc31dd96cbf7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1511 microversion: 2.1 time: 0.291520 Oct 04 21:46:53.672643 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3131/6364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.701223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.702069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.709899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.711637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.713077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.713993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.714654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.716026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.883706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:54.892483 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e64a8085-07b1-4ab8-9d25-080b6aeedf4e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1494 microversion: 2.1 time: 0.198218 Oct 04 21:46:54.893104 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3234/6365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:54 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.916120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:54.916763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.924046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.924524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.924959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.925660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.926114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.926534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.142063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:55.295861 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55e7a929-9f8b-4333-b52b-42cd6daa49c3 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action" status: 202 len: 0 microversion: 2.1 time: 0.384201 Oct 04 21:46:55.296756 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3132/6366] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:54 2022] POST /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:55.305218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.305877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.312376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.312865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.313300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.314088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.314539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.314996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.504886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.514491 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b32cac72-34d8-44e8-bc92-16cf0a2727e7 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1500 microversion: 2.1 time: 0.213408 Oct 04 21:46:55.515543 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3235/6367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1500 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:56.541693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.542394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.549215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.549706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.550134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.550871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.551312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.551946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.720267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:56.731109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff5629be-98e5-4a91-bb37-82bf6fd19934 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1500 microversion: 2.1 time: 0.195451 Oct 04 21:46:56.731707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3133/6368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.758150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.759708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:57.769630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.770636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.771581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.772655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.773440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.773980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.950913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:57.960656 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7da14ae-9acc-4cd8-8a0b-c353ef13dcf4 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1503 microversion: 2.1 time: 0.208683 Oct 04 21:46:57.961576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3236/6369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:57 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:57.989925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:57.990608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.016561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.017323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.017773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.018506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.018997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.019430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.055679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:58.573063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58000813-1c42-4643-bcfe-bb470afc7093 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "DELETE /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 204 len: 0 microversion: 2.1 time: 0.586479 Oct 04 21:46:58.573063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3134/6370] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:57 2022] DELETE /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:46:58.595028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.595899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.611169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.611849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.612458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.613316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.613821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.614284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.798869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.825123 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1aaaee86-6e8f-4442-8062-ebd29cfc064e tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1509 microversion: 2.1 time: 0.236393 Oct 04 21:46:58.826298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3237/6371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:59.852207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.852928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.864123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.864655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.865122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.866117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.867295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.868420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.041433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.050614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47b501ae-62e7-4146-acf1-9948823b9298 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1509 microversion: 2.1 time: 0.204138 Oct 04 21:47:00.052310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3135/6372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.075593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.076208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.083548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.084311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.084925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.085734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.086791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.087234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.303559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:01.317535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a9190308-ad86-4ba4-96c4-f84601f5fa7b tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1509 microversion: 2.1 time: 0.245841 Oct 04 21:47:01.318316 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3238/6373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:01.996051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36818198-e27d-4df1-9014-8a6ecec395cf", "name": "network-vif-deleted", "tag": "bec15c13-3d3a-466e-ab29-f28547d98aae"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:02.003252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.004922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.005379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.019234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] Creating event network-vif-deleted:bec15c13-3d3a-466e-ab29-f28547d98aae for instance 36818198-e27d-4df1-9014-8a6ecec395cf on n-h1-851029-13 Oct 04 21:47:02.025274 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0c2f2395-f4fe-4542-ac6f-bfa320c4eb05 req-3a5e9a93-3d72-41e8-a70e-5f92ea757786 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046305 Oct 04 21:47:02.025893 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3136/6374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:02.348767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:02.349504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:02.357510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:02.359205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.359702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.360144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.360853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:02.361832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:02.362249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.435022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b28615aab247f49f07ff612844dc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f0e80a2cb1475ba03639ac24ef049a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.448423 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d8c7800-6d26-4867-a933-15eddbfe9582 tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 200 len: 1300 microversion: 2.1 time: 0.099854 Oct 04 21:47:02.448423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3239/6375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:02 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.469859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.470780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] [instance: 36818198-e27d-4df1-9014-8a6ecec395cf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.472048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b1d254b-3ed3-4fc3-9d49-4193674963be tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Action: 'create', calling method: .version_select at 0x7f54f4f72e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2004643161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtzRvLdhxmTyACWI/eaN86ICP2MyJP0Hf5Tn7Sy4QQbtuPFZbOzevBeG34KQ2SQ/xuYigom9H9cHIylrGn84Wf62vzq+VoOR6kr/1bAwfDcGA/1BR8dT4fGLC/CTPREtg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:03.479193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.479755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.480228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.480941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.481399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.481834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.495220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3b1d254b-3ed3-4fc3-9d49-4193674963be tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for project 2567a7f42a0e4eef9708359e94c1272d. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:03.497161 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] HTTP exception thrown: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Request method failure captured: Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf HTTP/1.1 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKm1RcG4XLJRIQdSXMyBmevi3fx_z9uV9lrDp4zWe3cf6HamWWLmnSoObwjllzGDH3cq5haeaupXKpZFZpunLLFsWsYulJ8KSvVLUcRvAnBKatKqWI6GPshE74bqZ_TxXfMTRKn1TFgw-QH0CxtCtt_1Ol6dKo5LjrVDLoYGFC3ICDQ Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 43f0e80a2cb1475ba03639ac24ef049a Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestServerAdvancedOps-1186973723 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/43f0e80a2cb1475ba03639ac24ef049a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/43f0e80a2cb1475ba03639ac24ef049a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/43f0e80a2cb1475ba03639ac24ef049a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_43f0e80a2cb1475ba03639ac24ef049a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestServerAdvancedOps-1186973723 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 43f0e80a2cb1475ba03639ac24ef049a Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestServerAdvancedOps-1186973723 Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestServerAdvancedOps-1186973723-project Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 58b28615aab247f49f07ff612844dc3f Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestServerAdvancedOps-1186973723-project Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '36818198-e27d-4df1-9014-8a6ecec395cf'} Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:47:03.499025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] Returning 404 to user: Instance 36818198-e27d-4df1-9014-8a6ecec395cf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d82d0160-af59-4393-9056-1b06422a9fed tempest-TestServerAdvancedOps-1186973723 tempest-TestServerAdvancedOps-1186973723-project] 10.222.0.36 "GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf" status: 404 len: 111 microversion: 2.1 time: 0.035024 Oct 04 21:47:03.507374 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3240/6376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/36818198-e27d-4df1-9014-8a6ecec395cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:47:03.508168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-3b1d254b-3ed3-4fc3-9d49-4193674963be tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for user b54dce15219a4f78ba227183eeedcf6d and project 2567a7f42a0e4eef9708359e94c1272d. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:03.658820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b1d254b-3ed3-4fc3-9d49-4193674963be tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.376346 Oct 04 21:47:03.659366 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3137/6377] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:47:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:07.426180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-723097333", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2004643161", "security_groups": [{"name": "tempest-secgroup-smoke-820617559"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "bba0bc6f-33bb-45b3-874e-6625bde9f624"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:07.603003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] validate_networks() for [('bba0bc6f-33bb-45b3-874e-6625bde9f624', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:47:08.141588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for project 2567a7f42a0e4eef9708359e94c1272d. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:08.155905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for user b54dce15219a4f78ba227183eeedcf6d and project 2567a7f42a0e4eef9708359e94c1272d. Resources: dict_keys(['metadata_items']) {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:08.177821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:47:08.179322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:47:08.180157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:47:08.180860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:47:08.181763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:47:08.196505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.197353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.198164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.199641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:08.200524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:08.201530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.244401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for project 2567a7f42a0e4eef9708359e94c1272d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:47:08.256508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Getting quotas for user b54dce15219a4f78ba227183eeedcf6d and project 2567a7f42a0e4eef9708359e94c1272d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:47:08.293935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:47:08.300009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:47:08.455583 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b56ce4ac-4e5a-4cf9-918d-258591f014fc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.034068 Oct 04 21:47:08.464161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3241/6378] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:47:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:47:08.472036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-178b5538-19c6-4eba-aa97-914f5dbd4816 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:08.473952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-178b5538-19c6-4eba-aa97-914f5dbd4816 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:08.477167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:08.567107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-178b5538-19c6-4eba-aa97-914f5dbd4816 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:08.581272 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-178b5538-19c6-4eba-aa97-914f5dbd4816 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1302 microversion: 2.1 time: 0.114793 Oct 04 21:47:08.581878 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3138/6379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:08 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:09.617680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c93f3c8c-579f-4714-b9a1-a632d5d20644 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:09.617680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c93f3c8c-579f-4714-b9a1-a632d5d20644 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:09.664410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c93f3c8c-579f-4714-b9a1-a632d5d20644 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:09.675738 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c93f3c8c-579f-4714-b9a1-a632d5d20644 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1302 microversion: 2.1 time: 0.071536 Oct 04 21:47:09.676329 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3242/6380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:09 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1302 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:10.699810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:10.700613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:10.708839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.709379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.710374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.711201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:10.711686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:10.712163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:10.800823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:10.809663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b8f8fc1-6ff4-4910-9fb6-bfcc9801a66e tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1298 microversion: 2.1 time: 0.114202 Oct 04 21:47:10.810286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3139/6381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:10 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:11.835155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:11.835813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:11.843914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.844403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.844835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.845548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:11.845993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:11.846596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:11.918200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:11.927616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-577b3cd4-d8fb-474c-9ff8-af2dc4e102f4 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1372 microversion: 2.1 time: 0.097093 Oct 04 21:47:11.928220 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3243/6382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:11 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:12.967280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:12.967971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:12.976191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.976665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.977108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:12.977825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:12.978360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:12.978825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.137375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:13.146090 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aba6d16f-a96d-4bc8-9c20-72004a036b81 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.183239 Oct 04 21:47:13.146715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3140/6383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:12 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:13.321550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdd190e-b842-41a8-ae3a-8f62a1d9059f", "tag": "48e2e768-0565-4d88-985e-e37800dfad02"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:13.334046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:13.335417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:13.335863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:13.352619 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] Creating event network-changed:48e2e768-0565-4d88-985e-e37800dfad02 for instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f on n-h1-851029-13 Oct 04 21:47:13.357865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2f52a26c-7ecb-4589-891f-af67ebc7b10f req-9ebc19ad-c229-45ff-9c4b-4aae5058330b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041149 Oct 04 21:47:13.358520 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3244/6384] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:14.169756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:14.177419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:14.177419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.177954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.179222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.179955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:14.180422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:14.180857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:14.346550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:14.355137 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40a3e264-8dac-44dd-aa5f-952f770fee90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.189337 Oct 04 21:47:14.355771 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3141/6385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:14 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:15.382289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:15.383081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:15.394768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.395243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.395966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.396966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:15.397439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:15.397868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:15.594550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:15.604655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c1fcd69-181f-4887-a81e-672475392d38 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.228669 Oct 04 21:47:15.605271 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3245/6386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:15 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:16.641327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:16.641999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:16.649406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.649933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.650369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.651109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:16.651568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:16.651994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:16.800604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:16.810466 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-783d795c-c53c-4407-a0f4-6b2c8bea644b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.173018 Oct 04 21:47:16.811095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3142/6387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:16 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:17.833881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:17.835040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:17.842468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.843001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.843442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:17.844163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:17.844622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:17.845071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:18.010356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:18.016914 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6b8c407-85a1-4280-89ad-9e5231ff8cbc tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.186970 Oct 04 21:47:18.017517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3246/6388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:17 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:19.043952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:19.044577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:19.047628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:19.053108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.054504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.054988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.055737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.056201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.056637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.223690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:19.236164 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6cebb63-b276-4834-a68e-ed27f3724e43 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.197960 Oct 04 21:47:19.237213 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3143/6389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:19 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:20.261531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:20.262161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:20.264220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:20.265751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:20.270881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.271373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.272381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.273091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.273550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.273978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.438612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:20.438612 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8bc3f36-4af2-45c8-892b-c1503382629b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.179218 Oct 04 21:47:20.438612 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3247/6390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:20 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:20.609445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdd190e-b842-41a8-ae3a-8f62a1d9059f", "name": "network-vif-plugged", "status": "completed", "tag": "48e2e768-0565-4d88-985e-e37800dfad02"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:20.623887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:20.624750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:20.625555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:20.649146 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] Creating event network-vif-plugged:48e2e768-0565-4d88-985e-e37800dfad02 for instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f on n-h1-851029-13 Oct 04 21:47:20.658010 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bb117b4e-301b-450c-ac32-b9f937b03539 req-411bf3a2-32a1-4bf7-b0a8-7a95d7ae3a0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051840 Oct 04 21:47:20.659162 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3144/6391] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:21.463244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:21.463879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:21.471942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.472428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.472868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.473629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.474111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.474542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.645563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:21.656299 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-298e1d78-be44-420f-93f9-0da4f23e85d2 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1427 microversion: 2.1 time: 0.198487 Oct 04 21:47:21.657166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3248/6392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:21 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:22.693849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:22.694590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:22.701122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.701616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.702053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.702806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.703266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.703696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.848380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:22.856895 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ab85bc7-6644-43c6-8423-a736882b9221 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1607 microversion: 2.1 time: 0.168473 Oct 04 21:47:22.857484 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3145/6393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:22 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1607 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:22.881938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:22.882565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:22.889945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.890484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.890975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.891706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.892171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.892608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.033925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:23.036184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:23.042535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56619bc6-28ce-4860-ba5a-4a7a46cab280 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1607 microversion: 2.1 time: 0.164756 Oct 04 21:47:23.043187 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3249/6394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:22 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1607 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:23.065686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:23.066300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:23.073218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.073705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.074142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.074882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.075337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.075764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.224114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:23.238722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e657ed-5310-4995-abfa-6125be9bd35b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1607 microversion: 2.1 time: 0.176604 Oct 04 21:47:23.246964 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3146/6395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:23 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1607 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:26.034697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdd190e-b842-41a8-ae3a-8f62a1d9059f", "tag": "48e2e768-0565-4d88-985e-e37800dfad02"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:26.048470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:26.049049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:26.049563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:26.064333 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] Creating event network-changed:48e2e768-0565-4d88-985e-e37800dfad02 for instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f on n-h1-851029-13 Oct 04 21:47:26.071003 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-bd6518fe-2a2f-4284-a66b-f0a72eca123f req-511539fb-ca46-47de-9359-4a840150897c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040586 Oct 04 21:47:26.071659 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3250/6396] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:33.105778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=19 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:33.106627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:33.110802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:33.111381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:33.117927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:33.118506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:33.118961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:33.119658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:33.120143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:33.120560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:33.146399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7370e9a-145b-4ec9-b23c-fa268601bfe7 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043365 Oct 04 21:48:33.147115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3147/6397] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 4 21:48:33 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:36.719641 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:52:36.720486 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:52:36.722218 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:52:36.722365 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:36.723608 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:52:36.723715 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:36.724751 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:52:36.724869 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:36.725814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:36.925868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:36.926571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:36.933278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.933761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.934199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.934923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:36.935379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:36.935807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:36.961373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:52:37.263894 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3771b226-318a-46b6-86c6-bace5fa74466 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 204 len: 0 microversion: 2.1 time: 0.545759 Oct 04 21:52:37.264432 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3251/6398] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:52:36 2022] DELETE /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:52:37.271455 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:52:37.272809 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:52:37.273982 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:52:37.274109 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:37.276082 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:52:37.276218 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:37.277856 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:52:37.278010 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f (ip 10.222.0.36) !!! Oct 04 21:52:37.289838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:37.291669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:37.299761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.300255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.300698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.301515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:37.301974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:37.302405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:37.505831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:37.513865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d17ab6e7-5600-4056-87dd-d3797594fd90 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1732 microversion: 2.1 time: 0.244940 Oct 04 21:52:37.514487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3148/6399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:37 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1732 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:38.539118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:38.539829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:38.549783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.550281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.550740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.551511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:38.551973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:38.552406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:38.570139 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41886. Oct 04 21:52:38.574183 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41884. Oct 04 21:52:38.750785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:38.758997 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a805dc7-133e-4cd4-b1cc-1db0c26e342b tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1732 microversion: 2.1 time: 0.224722 Oct 04 21:52:38.772938 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3252/6400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:38 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:39.185935 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41896. Oct 04 21:52:39.195692 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41894. Oct 04 21:52:39.241146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdd190e-b842-41a8-ae3a-8f62a1d9059f", "name": "network-vif-deleted", "tag": "48e2e768-0565-4d88-985e-e37800dfad02"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:39.252375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.254390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.254878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.269038 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] Creating event network-vif-deleted:48e2e768-0565-4d88-985e-e37800dfad02 for instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f on n-h1-851029-13 Oct 04 21:52:39.277617 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e2a91bb5-40be-427b-ad04-a656e19d92b6 req-9e51a0e7-3814-4a9f-adff-a180fc11f2f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117799 Oct 04 21:52:39.278228 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3149/6401] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:39.782929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:39.783818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:39.791281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.791767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.792199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.792947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.793400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.793854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.827856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:39.828904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:39.828904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:39.829296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lazy-loading 'fault' on Instance uuid 3bdd190e-b842-41a8-ae3a-8f62a1d9059f {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:52:39.874273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54dce15219a4f78ba227183eeedcf6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2567a7f42a0e4eef9708359e94c1272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:39.883864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9969f3d-a028-4980-a1a6-0f32a98d1ebf tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 200 len: 1388 microversion: 2.1 time: 0.104812 Oct 04 21:52:39.884486 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3253/6402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:39 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 1388 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:40.908643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:40.909259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:40.916168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.916681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.917119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.917811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:40.918270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:40.918788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:40.932535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] HTTP exception thrown: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Request method failure captured: Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f HTTP/1.1 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKnOs3L6Yc6rm3SW_98bgcDZIRPJ41o6r_RDoGW3CNFxQum6ktRkFx8_HTNSvzhQLPjbnVppopkgfTSmVNMdb4jyEvFrk6ROgue-FBMdj-gWPGBgxM14WTU7yUxjKdmzv155Zu_-NPWjqjDDmhsztXlia2hxto_y5XQb1FpaYIRKcO8 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b54dce15219a4f78ba227183eeedcf6d Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '3bdd190e-b842-41a8-ae3a-8f62a1d9059f'} Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:40.934168 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Returning 404 to user: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-65a0ba78-b809-4a4f-9105-6cc3eb567dbd tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 404 len: 111 microversion: 2.1 time: 0.032268 Oct 04 21:52:40.938512 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3150/6403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:40 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:41.473822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:41.474337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:41.481366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.481854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.482299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.483029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.483492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.483926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.498255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] HTTP exception thrown: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Request method failure captured: Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f HTTP/1.1 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKnOs3L6Yc6rm3SW_98bgcDZIRPJ41o6r_RDoGW3CNFxQum6ktRkFx8_HTNSvzhQLPjbnVppopkgfTSmVNMdb4jyEvFrk6ROgue-FBMdj-gWPGBgxM14WTU7yUxjKdmzv155Zu_-NPWjqjDDmhsztXlia2hxto_y5XQb1FpaYIRKcO8 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: b54dce15219a4f78ba227183eeedcf6d Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3bdd190e-b842-41a8-ae3a-8f62a1d9059f'} Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:41.500007 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Returning 404 to user: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f79bd9f-3868-460f-9090-c777bcabecce tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 404 len: 111 microversion: 2.1 time: 0.031640 Oct 04 21:52:41.504597 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3254/6404] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:52:41 2022] DELETE /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:52:41.510881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:41.511496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] [instance: 3bdd190e-b842-41a8-ae3a-8f62a1d9059f] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:41.517609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.518118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.518572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.519320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:41.519776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:41.520202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:41.533664 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] HTTP exception thrown: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Request method failure captured: Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f HTTP/1.1 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKnOs3L6Yc6rm3SW_98bgcDZIRPJ41o6r_RDoGW3CNFxQum6ktRkFx8_HTNSvzhQLPjbnVppopkgfTSmVNMdb4jyEvFrk6ROgue-FBMdj-gWPGBgxM14WTU7yUxjKdmzv155Zu_-NPWjqjDDmhsztXlia2hxto_y5XQb1FpaYIRKcO8 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2567a7f42a0e4eef9708359e94c1272d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2567a7f42a0e4eef9708359e94c1272d Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestServerBasicOps-2042656376 Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: b54dce15219a4f78ba227183eeedcf6d Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestServerBasicOps-2042656376-project Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '3bdd190e-b842-41a8-ae3a-8f62a1d9059f'} Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:52:41.535287 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Returning 404 to user: Instance 3bdd190e-b842-41a8-ae3a-8f62a1d9059f could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5042a48b-45ab-4f28-8490-6eb08bf7f8d5 tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f" status: 404 len: 111 microversion: 2.1 time: 0.029732 Oct 04 21:52:41.539420 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3151/6405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:41 2022] GET /compute/v2.1/servers/3bdd190e-b842-41a8-ae3a-8f62a1d9059f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:52:41.778189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2042c8f-c9e7-40c6-9727-b0085e5541ec tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] Calling method '.version_select at 0x7f54f5282670>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:41.880811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2042c8f-c9e7-40c6-9727-b0085e5541ec tempest-TestServerBasicOps-2042656376 tempest-TestServerBasicOps-2042656376-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2004643161" status: 202 len: 0 microversion: 2.1 time: 0.106556 Oct 04 21:52:41.881403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3255/6406] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 21:52:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2004643161 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:44.150503 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:55:44.151499 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:55:44.152353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=10 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:44.153103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:44.154432 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:44.154600 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 04 21:55:44.156824 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:44.156973 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 04 21:55:44.158303 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:44.158463 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 04 21:55:44.165132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86827d09-a8f9-4418-ac90-48d8682848c0 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Action: 'create', calling method: .version_select at 0x7f54f50223a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1246277290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIYkp0dTSyaF6ws8pCRDUyHVI5E8Vn7PpwZs8adC+y9T+2OiMScsCgZs3Dn0vYJ59EYwCZvuAc7FCjzq8wxFUXMZWB54W4jXnI2Vt6Gk+LDF2T1NvwCEBUR/BdGwNPV6Q=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:44.192299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-86827d09-a8f9-4418-ac90-48d8682848c0 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Getting quotas for project 4bbb581da65b4e2eab85934cedb6d559. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:44.197986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-86827d09-a8f9-4418-ac90-48d8682848c0 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Getting quotas for user 4ab709eaab9c4c3faa5c4bb6ded768af and project 4bbb581da65b4e2eab85934cedb6d559. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:44.278254 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86827d09-a8f9-4418-ac90-48d8682848c0 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.129597 Oct 04 21:55:44.278676 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3152/6407] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 21:55:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:46.674894 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:55:46.675883 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:55:46.676503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:46.677274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:46.678522 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:46.678650 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 21:55:46.683843 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:46.683843 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 21:55:46.683843 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:55:46.683843 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 21:55:46.688155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-578466575", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0ea1554f-3c82-4634-b1ee-e240b7e5b151", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1246277290", "security_groups": [{"name": "tempest-secgroup-smoke-515159140"}], "networks": [{"uuid": "00d6bdf3-15b2-460d-a87c-40fe122536fc"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:46.823275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] validate_networks() for [('00d6bdf3-15b2-460d-a87c-40fe122536fc', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:47.348936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:47.349355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:47.349827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:47.350238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:47.350644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:47.359613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.360087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.360517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.361229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:47.361677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:47.362597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:47.381172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Getting quotas for project 4bbb581da65b4e2eab85934cedb6d559. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:47.386522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Getting quotas for user 4ab709eaab9c4c3faa5c4bb6ded768af and project 4bbb581da65b4e2eab85934cedb6d559. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:47.451966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:47.454155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ea1554f-3c82-4634-b1ee-e240b7e5b151',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:47.683757 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43210. Oct 04 21:55:47.684424 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43212. Oct 04 21:55:47.989616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-121d0205-e7d7-414a-90f1-beb1dc027849 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.316235 Oct 04 21:55:47.990167 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3256/6408] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:55:48.008158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db8aff2c-70b0-4b46-a2b8-e8e1f78dd2b5 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:48.008802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db8aff2c-70b0-4b46-a2b8-e8e1f78dd2b5 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:48.021777 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43218. Oct 04 21:55:48.022796 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43220. Oct 04 21:55:48.074950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db8aff2c-70b0-4b46-a2b8-e8e1f78dd2b5 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:48.082819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db8aff2c-70b0-4b46-a2b8-e8e1f78dd2b5 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1098 microversion: 2.1 time: 0.084608 Oct 04 21:55:48.083407 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3153/6409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:47 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1098 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:49.107206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d06dc36b-22f6-47f5-8736-f3e4b4495a51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:49.108009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d06dc36b-22f6-47f5-8736-f3e4b4495a51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:49.164470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d06dc36b-22f6-47f5-8736-f3e4b4495a51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:49.171667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d06dc36b-22f6-47f5-8736-f3e4b4495a51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1098 microversion: 2.1 time: 0.069237 Oct 04 21:55:49.172189 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3257/6410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:49 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1098 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:50.196642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3933dcb6-7b29-4010-9a37-8210a950e2d9 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:50.197259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3933dcb6-7b29-4010-9a37-8210a950e2d9 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:50.254741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3933dcb6-7b29-4010-9a37-8210a950e2d9 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:50.261695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3933dcb6-7b29-4010-9a37-8210a950e2d9 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1098 microversion: 2.1 time: 0.069916 Oct 04 21:55:50.262271 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3154/6411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:50 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:51.287061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:51.287737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:51.295579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.296106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.296552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.297284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:51.297784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:51.298263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:51.368066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:51.376158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4e71d654-8d58-407d-b819-12a1afcf6482 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1148 microversion: 2.1 time: 0.094573 Oct 04 21:55:51.376732 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3258/6412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:51 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1148 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:52.399582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:52.400188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:52.407349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.407840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.408310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.409535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:52.410018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:52.410443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:52.474150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:52.482100 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47acd034-b6e5-4ee8-a540-389bd886860d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1196 microversion: 2.1 time: 0.086318 Oct 04 21:55:52.482695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3155/6413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:52 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1196 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:53.506337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:53.507631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:53.514828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.515394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.515882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.516577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:53.517045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:53.517469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:53.584433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:53.592568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a8aded9-1993-4464-b243-5a4a30ad0cdd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1214 microversion: 2.1 time: 0.090600 Oct 04 21:55:53.593180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3259/6414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:53 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:54.616715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:54.617567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:54.624716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.625234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.625672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.626599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:54.627092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:54.628023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:54.828956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:54.837201 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73b7c554-b7b8-4dd5-8f2c-a1e5944b375d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1281 microversion: 2.1 time: 0.224413 Oct 04 21:55:54.837939 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3156/6415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:54 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:55.035850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:55.047775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.048600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.049713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.063049 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] Creating event network-changed:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:55:55.070162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fd941533-3b46-4b62-b85e-975dfd29f1a8 req-faebb57f-39de-4409-8ad2-c88bc5d4c10d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180977 Oct 04 21:55:55.071132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3260/6416] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:55.860428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:55.862242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:55.869527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.870020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.870615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.871452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.871920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.872374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.300144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:56.309002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e974b56-9038-4832-bd3f-b1acac411d05 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1281 microversion: 2.1 time: 0.452436 Oct 04 21:55:56.309741 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3157/6417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:55 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:57.333877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:57.334773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:57.341616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.342101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.342540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.343316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:57.343773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:57.344196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.378838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:57.496061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:57.504050 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9a86c4a-b97a-402f-962a-e38b74cd16e3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1281 microversion: 2.1 time: 0.175423 Oct 04 21:55:57.516042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3261/6418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:57 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:58.528577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:58.531751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:58.536244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.536733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.537179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.537888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.538346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.538814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.683617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:58.692043 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca9c82cb-a8a7-4635-8d1a-9562490042d3 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1281 microversion: 2.1 time: 0.167362 Oct 04 21:55:58.697737 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3158/6419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:58 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:59.715221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:59.715839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:59.718597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:59.724101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.724587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.725023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.725719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.726169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.726593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.862422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:59.870282 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c94a1c05-5141-4be5-92f5-1c6b3bd19820 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.159113 Oct 04 21:55:59.870873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3262/6420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:59 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:00.893394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:00.893937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:00.896572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:00.901396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.901878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.902315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.903051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.903509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.903934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.034182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:01.041960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-075b4960-112d-4592-b8d5-f27b7253131e tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.152621 Oct 04 21:56:01.042526 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3159/6421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:00 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:02.066120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:02.066763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:02.073608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.074080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.074532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.075234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:02.075686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:02.076110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.214282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:02.222271 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32cd344a-180c-4d3f-8f3b-ee32a08cce9f tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.160755 Oct 04 21:56:02.222878 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3263/6422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:02 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:03.245437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:03.246060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:03.253046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.253534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.253973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.254712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.255172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.255605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.390572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:03.398600 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-503a19ed-e606-4347-828f-581e0f6acb0b tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.157031 Oct 04 21:56:03.399209 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3160/6423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:03 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:04.421988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:04.422612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:04.430465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.430978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.431423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.432128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.432678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.433094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.574458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:04.582730 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e861fddd-123e-4c09-8c04-340651193c51 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.164747 Oct 04 21:56:04.583325 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3264/6424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:04 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:05.605725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.606375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.613904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.614391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.614863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.615565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.616024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.616451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.749704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:05.757669 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f1d7ed3-f1e8-4abd-92bf-36a1b4dba3a2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.155901 Oct 04 21:56:05.758240 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3161/6425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:06.781578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:06.782199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:06.789336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.789839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.790282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.791047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:06.791505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:06.791945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:06.943286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:06.951138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc5b8adf-2ab2-4f03-a916-b2a600443a58 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.173542 Oct 04 21:56:06.951730 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3265/6426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:06 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:07.973515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:07.974190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:07.981217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.981736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.982183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:07.982922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:07.983384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:07.983815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.126201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.136418 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d351ba8d-d44a-4aa7-bc85-24add1472ec2 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.166737 Oct 04 21:56:08.137312 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3162/6427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:07 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.162123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:09.162784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:09.169953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.170443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.170919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.171622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.172073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.172499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.308025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:09.316418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0efcdd07-589a-49c2-8fdb-4d7a10d679ea tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.158366 Oct 04 21:56:09.316997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3266/6428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:09 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:09.564308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "name": "network-vif-plugged", "status": "completed", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:09.579455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:09.579936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:09.580370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:09.593037 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] Creating event network-vif-plugged:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:56:09.599437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8b71506b-88b2-4c57-8f5a-ba3629f7245e req-2a242939-6df2-4af6-ace8-bf088a2a4d09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106011 Oct 04 21:56:09.600054 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3163/6429] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:10.339865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:10.340738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:10.348900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.349382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.349813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.350511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:10.351000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:10.351428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:10.489312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:10.497392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6997cd3f-25b6-49a0-a0d1-fc8d54b57828 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1269 microversion: 2.1 time: 0.161429 Oct 04 21:56:10.497966 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3267/6430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:10 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.521730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:11.522484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:11.528846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.529335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.529951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.530583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.531089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.531550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.674938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:11.683706 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f2ede2cf-ef22-40c3-b2cc-89b5c159d723 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1457 microversion: 2.1 time: 0.167128 Oct 04 21:56:11.684301 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3164/6431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:11 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:11.707540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:11.708153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:11.715327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.715822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.716263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.716973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:11.717429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:11.717854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:11.852285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:11.861208 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d0bc6b9-4535-4c20-87a8-604a6a3b1d2d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1457 microversion: 2.1 time: 0.158251 Oct 04 21:56:11.861956 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3268/6432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:11 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:13.966359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:13.978200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:13.978992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:13.979412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:13.991659 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] Creating event network-changed:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:56:13.997078 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-69923a41-cb4f-4ca8-a313-b2f0e9948830 req-3a780eda-14ab-4f4d-be1c-13bd7f0959a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 Oct 04 21:56:13.998143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3165/6433] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:16.013337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}, {"name": "network-changed", "server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:16.024765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:16.025244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:16.025685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:16.037843 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Creating event network-changed:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:56:16.038351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] Creating event network-changed:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:56:16.043778 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3b8a49ad-cf76-444b-8bd7-54f8b7df03de req-c5d2ca14-f790-4a5a-8712-b4a9290e21f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034153 Oct 04 21:56:16.048155 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3269/6434] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:20.816258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:20.816965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:20.817363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:20.818695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=66 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:20.819266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:20.819928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=58 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:20.824635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:20.826065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.826543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.827025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.827749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.828949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.829669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.840109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:20.841472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:20.842085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.857895 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] Creating event network-changed:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:57:20.858398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:57:20.864897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6fc7102a-42b5-4a0b-ab55-0b06151da243 req-78f3e589-4189-42bf-93ae-3345f67d25bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051413 Oct 04 21:57:20.866158 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3270/6435] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:21.293107 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c99045ac-501e-4296-ad9d-231bf509a36d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 204 len: 0 microversion: 2.1 time: 0.482584 Oct 04 21:57:21.297868 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3166/6436] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:57:20 2022] DELETE /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:57:21.304482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.305227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:21.313356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.313844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.314475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.315233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.315696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.316124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.459566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:21.468446 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6637306e-5fd3-4865-b849-1899864ee761 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1582 microversion: 2.1 time: 0.168729 Oct 04 21:57:21.469081 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3271/6437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:21 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1582 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:22.495698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:22.496393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:22.503586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.504068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.504505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.505210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.505692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.506089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.641903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:22.650350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51985df4-7d9b-47f8-ad2a-fe060e7e6d12 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1582 microversion: 2.1 time: 0.159636 Oct 04 21:57:22.652177 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3167/6438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:22 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1582 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:23.508399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfb8bf4-81f9-42fe-9b48-21557e03e2a2", "name": "network-vif-deleted", "tag": "887aabda-9da9-44e5-8cbf-5b0c6deee13c"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:23.520087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.520630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.521007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.534467 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] Creating event network-vif-deleted:887aabda-9da9-44e5-8cbf-5b0c6deee13c for instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 on n-h2-851029-13 Oct 04 21:57:23.540234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c75df270-b6f1-4e50-bf4d-6d1012edaec6 req-f73ca9c4-d6c5-4a31-b450-0a73971382f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Oct 04 21:57:23.540997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3272/6439] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:23.674985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.675535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.683306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.683796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.684264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.684985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.685446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.685878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.751062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:23.760531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7b4c025-5212-4f69-9ccb-aced5779208d tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1229 microversion: 2.1 time: 0.089047 Oct 04 21:57:23.761129 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3168/6440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:24.788580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:24.789218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:24.796091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.796600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.797049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.797753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.798211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.798641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.875556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:24.884545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c59a97c-6825-4d35-8d0e-de8570c67958 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1229 microversion: 2.1 time: 0.101051 Oct 04 21:57:24.885153 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3273/6441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:24 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:25.909790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:25.916732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:25.918769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.919271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.919713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:25.920431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.920892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.921358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:25.994081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:26.002551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7b163bf-8be5-435e-bcf2-f11677903f89 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1229 microversion: 2.1 time: 0.096770 Oct 04 21:57:26.003198 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3169/6442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:25 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:27.026914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:27.027560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:27.036300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.036973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.037427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.038413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.039124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.039718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.107583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:27.116086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-319cc965-99e9-4674-8a29-36380d4b1edd tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1229 microversion: 2.1 time: 0.094067 Oct 04 21:57:27.116690 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3274/6443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:27 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:28.141735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:28.142285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:28.149058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.149544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.150018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.150745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.151208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.151638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.184101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:28.184595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:28.185049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:28.185495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lazy-loading 'fault' on Instance uuid 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:57:28.229203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab709eaab9c4c3faa5c4bb6ded768af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bbb581da65b4e2eab85934cedb6d559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:28.237602 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5c808c7-fe5b-4d61-8b42-80588a969a9a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 200 len: 1234 microversion: 2.1 time: 0.099833 Oct 04 21:57:28.238202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3170/6444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:28 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:29.263465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:29.264236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] [instance: 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:29.271468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.271965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.272411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.273138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:29.273604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:29.274040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:29.292900 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] HTTP exception thrown: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Request method failure captured: Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 HTTP/1.1 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKtIeJNHWHSj4zaUa_pblxzz0A2Yl9IOKXaT1sQwWS4zQtrz2IzpGpX0TG5bE9U1MAUXYs5lNvYZe0gCpOZQjhNDLQCTGZhpBYuL3_tnnGsqJ8RAs4XDyRhDBZ7q-VCcksdN7v7YszSZ4FqjGFcEegZQMjTZgJKMjJWAg9WakyrdRNg Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 4bbb581da65b4e2eab85934cedb6d559 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBackupRestore-1945686245 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4bbb581da65b4e2eab85934cedb6d559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4bbb581da65b4e2eab85934cedb6d559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4bbb581da65b4e2eab85934cedb6d559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4bbb581da65b4e2eab85934cedb6d559"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBackupRestore-1945686245 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 4bbb581da65b4e2eab85934cedb6d559 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1945686245 Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBackupRestore-1945686245-project Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 4ab709eaab9c4c3faa5c4bb6ded768af Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBackupRestore-1945686245-project Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7cfb8bf4-81f9-42fe-9b48-21557e03e2a2'} Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:57:29.294702 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Returning 404 to user: Instance 7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1860283-50aa-4940-9abb-1710330d8e2a tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2" status: 404 len: 111 microversion: 2.1 time: 0.037318 Oct 04 21:57:29.300682 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3275/6445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:29 2022] GET /compute/v2.1/servers/7cfb8bf4-81f9-42fe-9b48-21557e03e2a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:57:29.560727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4369b0f-6bda-4109-bb92-5dd6abeac453 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] Calling method '.version_select at 0x7f54f4f7cd30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:29.682283 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4369b0f-6bda-4109-bb92-5dd6abeac453 tempest-TestVolumeBackupRestore-1945686245 tempest-TestVolumeBackupRestore-1945686245-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1246277290" status: 202 len: 0 microversion: 2.1 time: 0.126227 Oct 04 21:57:29.683090 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3171/6446] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 21:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1246277290 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:58:02.883468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-395878600", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d824c1f8-e133-4cc8-89fa-2570cbedcbfd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:02.894026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:02.894702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=24 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:03.067114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:03.481011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:03.481431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:03.481901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:03.482345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:03.482908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:03.493267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.493747 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.494179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.494932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:03.495383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:03.495803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:03.513242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:03.518453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:03.584218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:03.584218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d824c1f8-e133-4cc8-89fa-2570cbedcbfd',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:04.092845 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7932b929-99c7-413e-b7af-4ec1e65648d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214070 Oct 04 21:58:04.093865 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3276/6447] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:58:04.103875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:04.104973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:04.109334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e14ec9f2-72b0-4c24-8413-e426c3d479aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:04.110157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e14ec9f2-72b0-4c24-8413-e426c3d479aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:04.301826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e14ec9f2-72b0-4c24-8413-e426c3d479aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:04.311225 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e14ec9f2-72b0-4c24-8413-e426c3d479aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1056 microversion: 2.1 time: 0.209882 Oct 04 21:58:04.312110 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3172/6448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:04 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1056 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:05.337023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3824b0f4-d88c-447b-aeaf-2eeb2dafb25e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:05.337651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3824b0f4-d88c-447b-aeaf-2eeb2dafb25e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:05.391684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3824b0f4-d88c-447b-aeaf-2eeb2dafb25e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:05.399787 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3824b0f4-d88c-447b-aeaf-2eeb2dafb25e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1056 microversion: 2.1 time: 0.068166 Oct 04 21:58:05.400395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3277/6449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:05 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:06.430680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:06.431368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:06.439007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.439504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.439968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.440676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:06.441144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:06.441608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:06.508679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:06.516833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-406d9f72-94ed-4520-9c7d-e9def0999f0c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1154 microversion: 2.1 time: 0.090581 Oct 04 21:58:06.517622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3173/6450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:06 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1154 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:07.543699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:07.544930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:07.552663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.553377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.554219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.556540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:07.557155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:07.557725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:07.792004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:07.809724 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1bb379e-c562-454f-9740-eae44ef999ac tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1214 microversion: 2.1 time: 0.272652 Oct 04 21:58:07.822734 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3278/6451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:07 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:08.807585 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b528b895-64c1-4ac4-8105-6b0db6aa44f0", "tag": "1198bfc5-b4e1-4b20-864c-4dd131b69872"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:08.820817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.821296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.821923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.838386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:08.839325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:08.843712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] Creating event network-changed:1198bfc5-b4e1-4b20-864c-4dd131b69872 for instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 on n-h2-851029-13 Oct 04 21:58:08.847846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.848346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.849189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.850099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:08.858957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:08.859668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:08.861904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-24520fb8-1641-4d9c-8877-ae8d8ef6847f req-b1a155d0-1f61-487e-be64-d07f516f8095 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059607 Oct 04 21:58:08.862839 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3174/6452] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:09.174399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:09.183413 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd88fec6-7f1d-4b84-a17d-a236b62dcebf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1214 microversion: 2.1 time: 0.349594 Oct 04 21:58:09.184445 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3279/6453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:08 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:10.210019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:10.211454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:10.218159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.218653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.219196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.219916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:10.220378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:10.220804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:10.372090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:10.380579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b84847a0-dd74-4c31-a857-bfdda9fa965a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1214 microversion: 2.1 time: 0.176741 Oct 04 21:58:10.381133 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3175/6454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:10 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:11.406624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:11.407342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:11.414727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.415231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.416228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.416813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:11.417519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:11.417971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:11.561697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:11.569846 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-effbb5fc-4f99-4d8b-afb4-a01c00c3e734 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1214 microversion: 2.1 time: 0.167224 Oct 04 21:58:11.582699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3280/6455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:11 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:12.595059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:12.595642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:12.603214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.603706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.604153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.604865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:12.605332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:12.605767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:12.744379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:12.752295 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7debdd4b-6e71-4c56-bb46-29d1f184310d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1214 microversion: 2.1 time: 0.161354 Oct 04 21:58:12.752879 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3176/6456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:12 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:13.777791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:13.778410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:13.781094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:13.786343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.793628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.793628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.793628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:13.793628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:13.793628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:13.922073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:13.930215 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-177b436e-fce4-4e41-be73-754f7c1e10c9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.156880 Oct 04 21:58:13.930826 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3281/6457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:13 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:14.954352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:14.954931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:14.957743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:14.963076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.969052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.969052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:14.969052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:14.969052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:14.969052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:15.100284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:15.108749 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f1e691b-c992-4ceb-b8c3-ea2122af5c7b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.158398 Oct 04 21:58:15.109388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3177/6458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:14 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:16.133673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:16.134297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:16.137022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:16.141828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.142313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.142782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.143483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:16.143941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:16.144382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:16.279320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:16.287158 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-896a46b8-a704-40a4-9b0c-d6cae1a03e28 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.158163 Oct 04 21:58:16.287762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3282/6459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:16 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:17.313032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:17.313647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:17.320879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.321368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.321872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.322786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:17.323254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:17.323689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:17.456277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:17.464409 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81b2efa4-3bbd-4fdc-b797-fecd67ac924a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.155448 Oct 04 21:58:17.464993 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3178/6460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:17 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:18.488943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:18.489572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:18.496381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.496868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.497309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.498014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:18.498475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:18.498940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:18.641895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:18.650436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-680ce6c3-808d-4b85-920c-53b05bc7425e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.166081 Oct 04 21:58:18.651062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3283/6461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:18 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:19.673439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:19.674045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:19.681575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.682068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.682509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.683276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:19.683763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:19.684195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:19.813276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:19.821345 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ee08b54-28f1-4e8a-aef2-a37ae3c0446b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.151755 Oct 04 21:58:19.821929 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3179/6462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:19 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:20.845162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:20.845872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:20.853913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.854411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.854888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.855616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:20.856076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:20.856569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:20.998516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:21.006589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f27f955c-51d3-4777-85de-ce81ddd2ce55 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.165395 Oct 04 21:58:21.007348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3284/6463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:20 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:22.030300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:22.030985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:22.038946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.039889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.040364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.041099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.041565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.042030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.107464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528b895-64c1-4ac4-8105-6b0db6aa44f0", "name": "network-vif-plugged", "status": "completed", "tag": "1198bfc5-b4e1-4b20-864c-4dd131b69872"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:22.118928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:22.119408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:22.119845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:22.131709 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] Creating event network-vif-plugged:1198bfc5-b4e1-4b20-864c-4dd131b69872 for instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 on n-h2-851029-13 Oct 04 21:58:22.137885 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e7f94330-0d76-4ce5-adf9-c162bdf8d226 req-434a20b6-908f-4f3f-a1ef-e671aff6d0fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Oct 04 21:58:22.138513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3285/6464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:22.185186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:22.194288 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e38f0c36-4473-4316-a665-20cd4ff81e62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.168360 Oct 04 21:58:22.198795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3180/6465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:22 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:23.219488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:23.220096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:23.226615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.227133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.227578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.228288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:23.228755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:23.229189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:23.368757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:23.376606 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81c6e8a5-36a5-48ce-8087-0f3396660f11 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1202 microversion: 2.1 time: 0.162467 Oct 04 21:58:23.380354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3286/6466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:23 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:24.401049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.401735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.409267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.409793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.410230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.410987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.411458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.411895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.546926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.555178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5763968b-0aa6-4308-bbc6-d46d7bb01f41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1388 microversion: 2.1 time: 0.158752 Oct 04 21:58:24.555754 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3181/6467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1388 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:24.578433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.579078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.586290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.586805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.587253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.588569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.589053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.589485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.726581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.734720 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-307232ac-d73f-4518-aea0-f6e9e1b7ec3e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1388 microversion: 2.1 time: 0.160186 Oct 04 21:58:24.735678 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3287/6468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1388 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:24.757184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.757805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.764498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.764987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.765465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.766168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.766628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.767114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.896396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:24.906031 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-87446421-a31c-4815-a702-4d61ae6a9e52 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1388 microversion: 2.1 time: 0.152716 Oct 04 21:58:24.906604 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3182/6469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:24 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:24.927864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:24.928280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:24.935141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.935631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.936062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.936750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:24.937202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:24.937626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:24.962917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:58:25.227038 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-528610a4-1f43-49cc-9048-42539211ac86 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 204 len: 0 microversion: 2.1 time: 0.302634 Oct 04 21:58:25.227572 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3288/6470] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:58:24 2022] DELETE /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:58:25.235760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:25.236438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:25.244612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.245093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.245528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.246229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:25.246698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:25.247124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:25.380009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:25.387737 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b9dc183-eda4-49b7-a14d-f38d5943109c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1394 microversion: 2.1 time: 0.155823 Oct 04 21:58:25.388304 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3183/6471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:25 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:26.411652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:26.412499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:26.420246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.420743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.421187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.421901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:26.422363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:26.422827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:26.558696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:26.566819 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b97c8e05-cd9f-44e9-98be-a77bca80625b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1394 microversion: 2.1 time: 0.159534 Oct 04 21:58:26.567409 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3289/6472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:26 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1394 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:27.339899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528b895-64c1-4ac4-8105-6b0db6aa44f0", "name": "network-vif-deleted", "tag": "1198bfc5-b4e1-4b20-864c-4dd131b69872"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:27.351489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.352103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.352402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.365081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] Creating event network-vif-deleted:1198bfc5-b4e1-4b20-864c-4dd131b69872 for instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 on n-h2-851029-13 Oct 04 21:58:27.370881 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-04d1be62-ea98-445c-af80-7411ecde381c req-a916322b-38a6-437d-9b0b-e4dcf66fa660 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034654 Oct 04 21:58:27.371502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3184/6473] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:27.590090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:27.590871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:27.598182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.601113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.601113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.601113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:27.601113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:27.601113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:27.666494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:27.675682 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b691b0b-9812-40bc-bb66-c1ebe361543b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1187 microversion: 2.1 time: 0.089499 Oct 04 21:58:27.676286 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3290/6474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:27 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:58:28.701720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:28.702438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:28.708899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.709386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.709850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.710550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:28.711039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:28.711476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:28.787996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:28.796381 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5e6c71b-b322-4826-8286-59114147ade8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1187 microversion: 2.1 time: 0.100365 Oct 04 21:58:28.796965 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3185/6475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:28 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:29.821164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:29.821794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:29.829677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.830075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.830511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.831244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:29.831699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:29.832125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:29.919060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:29.929876 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c08fcbe-130d-4a1a-9683-0a89709dfe3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1187 microversion: 2.1 time: 0.111586 Oct 04 21:58:29.930702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3291/6476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:29 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:30.953395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:30.959212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:30.961641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.962485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.963194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:30.963861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:30.964853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:30.965352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:31.033184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:31.042413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c304497-b453-4b8d-975a-35cfbd857e17 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1187 microversion: 2.1 time: 0.093411 Oct 04 21:58:31.043055 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3186/6477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:30 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:32.066886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:32.067721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:32.076026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.076522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.076972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.077716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.078418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.078892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.115232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:32.115700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:32.116149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:32.116609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lazy-loading 'fault' on Instance uuid b528b895-64c1-4ac4-8105-6b0db6aa44f0 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:58:32.163345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:32.168193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:32.174517 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eaf31cba-624e-46a1-b92b-1ba125767e21 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 200 len: 1192 microversion: 2.1 time: 0.111050 Oct 04 21:58:32.175428 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3292/6478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:32 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:33.203131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:33.203911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b528b895-64c1-4ac4-8105-6b0db6aa44f0] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:33.211550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.212110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.213068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.213838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:33.214299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:33.216436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:33.240867 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 HTTP/1.1 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b528b895-64c1-4ac4-8105-6b0db6aa44f0'} Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:58:33.242567 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance b528b895-64c1-4ac4-8105-6b0db6aa44f0 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f90beb2-b0b3-4cea-80a6-31a0015204f2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0" status: 404 len: 111 microversion: 2.1 time: 0.044958 Oct 04 21:58:33.246853 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3187/6479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:33 2022] GET /compute/v2.1/servers/b528b895-64c1-4ac4-8105-6b0db6aa44f0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:58:40.195528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1754707279", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0f42192f-5ba7-44d8-99b4-4a3b580a9909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:40.206685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:40.257390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:58:40.632541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:58:40.632954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:58:40.633429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:58:40.633834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:58:40.634789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:58:40.643555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.644029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.644459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.645176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:40.645631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:40.646054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:40.663325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:58:40.668499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:58:40.729564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:58:40.731795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f42192f-5ba7-44d8-99b4-4a3b580a9909',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:58:41.188902 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bcab154-28b2-4dee-8f5b-2441d383b07d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997230 Oct 04 21:58:41.189627 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3293/6480] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:58:41.200694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48aacd76-a1a6-4c3e-89f2-0e6fb351bb2b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:41.201365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48aacd76-a1a6-4c3e-89f2-0e6fb351bb2b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:41.204338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=35 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:41.257963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48aacd76-a1a6-4c3e-89f2-0e6fb351bb2b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:41.265029 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48aacd76-a1a6-4c3e-89f2-0e6fb351bb2b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1057 microversion: 2.1 time: 0.068208 Oct 04 21:58:41.265611 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3188/6481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:41 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1057 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:42.302431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:42.303147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:42.310003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.310479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.311046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.312051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:42.312502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:42.312926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:42.378328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:42.387002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ea704e47-a968-4ac0-8735-0321db7939a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1107 microversion: 2.1 time: 0.089370 Oct 04 21:58:42.387592 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3294/6482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:42 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1107 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:43.410999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:43.411674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:43.415291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:43.420530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:43.421024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:43.421461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:43.422167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:43.422620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:43.423068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:43.499232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:43.507176 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7df104a4-7f71-4225-80ad-05799a61499f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1155 microversion: 2.1 time: 0.100384 Oct 04 21:58:43.507740 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3189/6483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:43 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:44.533038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:44.533793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:44.542837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.543346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.543885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.544623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:44.545081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:44.545510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:44.818349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:44.831198 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7d035be-2487-4a81-8559-56d1f10248fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1215 microversion: 2.1 time: 0.302216 Oct 04 21:58:44.831903 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3295/6484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:44 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:45.473547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c065851-4a3e-44a5-bd37-39ed34a3411a", "tag": "11eead39-51d3-44a6-8a9e-fcbcc8f3c09d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:45.486322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.486830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.487262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.499628 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] Creating event network-changed:11eead39-51d3-44a6-8a9e-fcbcc8f3c09d for instance 7c065851-4a3e-44a5-bd37-39ed34a3411a on n-h2-851029-13 Oct 04 21:58:45.504994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-56c07b88-d777-4e53-9f39-6763f195464d req-9d391ee1-84f5-4115-8a01-e8a4f2ca5a9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Oct 04 21:58:45.507247 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3190/6485] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:45.855924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:45.856712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:45.864534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.865132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.865641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:45.866412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:45.867126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:45.867617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:46.089786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:46.098620 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a7f92b0-9e18-4fe9-8dc2-bdc557d1dcc9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1215 microversion: 2.1 time: 0.247076 Oct 04 21:58:46.099909 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3296/6486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:45 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:47.124629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:47.128750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:47.131690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.132185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.132651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.133359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:47.133822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:47.134279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:47.276222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:47.284631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81b655a9-82f3-4224-a6a5-df97abe6f6cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1215 microversion: 2.1 time: 0.165178 Oct 04 21:58:47.285158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3191/6487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:47 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:48.308425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:48.309076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:48.315551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.316032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.316466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.317163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:48.317615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:48.318032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:48.452713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:48.459952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bfcdd4d-f596-4362-aacb-be894071888d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1215 microversion: 2.1 time: 0.155576 Oct 04 21:58:48.460517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3297/6488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:48 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:49.483761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:49.484383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:49.490782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.491287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.491723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.492430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:49.492888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:49.493321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:49.630789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:49.639012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a2070a4b-fecd-4abc-87c4-82a208f64624 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1215 microversion: 2.1 time: 0.159020 Oct 04 21:58:49.639682 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3192/6489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:49 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:50.662969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:50.663582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:50.666248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:50.671048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.671528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.671969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.672654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:50.673108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:50.673535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:50.677795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:50.805519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:50.814186 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf7ff609-5380-41ce-bf98-76ad812efcbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.155393 Oct 04 21:58:50.814813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3298/6490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:50 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:51.836962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:51.837582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:51.841085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:58:51.845971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.846465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.846937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.847642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:51.848102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:51.848533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:51.981709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:51.989841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a18a49b-49d3-422f-acdf-bc9a8850e061 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.156739 Oct 04 21:58:51.990441 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3193/6491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:51 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:53.013702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:53.014248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:53.021071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.021549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.021981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.022719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:53.023176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:53.023655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:53.156829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:53.164502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fae53993-5844-4736-bc02-fc0329a71d2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.155402 Oct 04 21:58:53.165073 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3299/6492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:53 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:54.186882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:54.187705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:54.194717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.195202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.195636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.196354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:54.196809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:54.197238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:54.326121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:54.334707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fecc5a0e-1847-4435-ba55-ba57f90c4e63 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.151829 Oct 04 21:58:54.344504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3194/6493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:54 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:55.358827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:55.359454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:55.366192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.366695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.367128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.367826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:55.368278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:55.368701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:55.504060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:55.511929 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e28df372-7320-4509-aaba-a1d61a990c97 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.157599 Oct 04 21:58:55.512506 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3300/6494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:55 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:56.535132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:56.535796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:56.542732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.543223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.543664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.544910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:56.545371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:56.545796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:56.677655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:56.685765 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-12b70335-d3fa-4c54-9afd-d9e8446789dc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.154604 Oct 04 21:58:56.686290 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3195/6495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:56 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:57.709369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:57.709991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:57.717048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.717535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.717974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.718708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:57.719174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:57.719616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:57.848179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:57.855977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-727445c8-4056-406a-ae49-a3d09f6f01d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.150778 Oct 04 21:58:57.856573 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3301/6496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:57 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:58:58.317119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c065851-4a3e-44a5-bd37-39ed34a3411a", "name": "network-vif-plugged", "status": "completed", "tag": "11eead39-51d3-44a6-8a9e-fcbcc8f3c09d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:58:58.328070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.328557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.329000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.340197 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] Creating event network-vif-plugged:11eead39-51d3-44a6-8a9e-fcbcc8f3c09d for instance 7c065851-4a3e-44a5-bd37-39ed34a3411a on n-h2-851029-13 Oct 04 21:58:58.346145 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9c919b56-91aa-465d-b0af-24de08091ed1 req-568d49d5-2444-4b38-974c-4b48c9bc7558 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032886 Oct 04 21:58:58.346772 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3196/6497] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:58:58.879166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:58:58.879751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:58:58.886738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.887221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.887654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:58.888951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:58:58.889407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:58:58.889832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:58:59.019330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:58:59.027178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61648a04-43c2-4b33-91e5-3fa6d6c391ca tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1203 microversion: 2.1 time: 0.151906 Oct 04 21:58:59.027751 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3302/6498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:58:58 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:00.050935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.051667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.058516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.059028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.059468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.060746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.061314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.061782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.195094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.203930 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3e3fdd73-f37a-4d0f-a0ec-1d8fa3230dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1390 microversion: 2.1 time: 0.158200 Oct 04 21:59:00.204513 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3197/6499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:00.226012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.226613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.233465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.233949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.234390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.235114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.235629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.236067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.363683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.371629 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-992fb6c9-8f47-405f-8b08-43861b0031ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1390 microversion: 2.1 time: 0.149485 Oct 04 21:59:00.372207 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3303/6500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:00.395243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.395867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.402053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.402411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.402884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.403586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.404085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.404510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.537480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:00.545757 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-17840001-c4e1-4de9-bab3-3166000bd75e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1390 microversion: 2.1 time: 0.154407 Oct 04 21:59:00.546330 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3198/6501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:00.569094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.569520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.575561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.576070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.576503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.577198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.578087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.578087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.603664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:59:00.929581 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-561a2486-9289-49dd-8aab-583600627510 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 204 len: 0 microversion: 2.1 time: 0.363834 Oct 04 21:59:00.930108 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3304/6502] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 21:59:00 2022] DELETE /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:59:00.938492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:00.939168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:00.945136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.945614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.946048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:00.946767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:00.947220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:00.947644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:01.078874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:01.086846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fdb85c2b-072f-42fb-b9f2-2a6f76d45459 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1396 microversion: 2.1 time: 0.152284 Oct 04 21:59:01.087427 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3199/6503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:00 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1396 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:02.110605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:02.111426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:02.118218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.118729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.119169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.119859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:02.120310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:02.120735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:02.250311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:02.258589 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c720ba34-4008-4621-8a23-314841d14df2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1396 microversion: 2.1 time: 0.152808 Oct 04 21:59:02.259213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3305/6504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:02 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:03.234940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c065851-4a3e-44a5-bd37-39ed34a3411a", "name": "network-vif-deleted", "tag": "11eead39-51d3-44a6-8a9e-fcbcc8f3c09d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:03.247082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.255657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.255657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.260302 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] Creating event network-vif-deleted:11eead39-51d3-44a6-8a9e-fcbcc8f3c09d for instance 7c065851-4a3e-44a5-bd37-39ed34a3411a on n-h2-851029-13 Oct 04 21:59:03.265955 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fd8aed2e-af35-4451-bc43-a989d473943a req-05124d8d-c154-4d6c-9ab9-3790888e3635 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Oct 04 21:59:03.266586 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3200/6505] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:03.282388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:03.283576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:03.290701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.291184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.291621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.292414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:03.292774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:03.293200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:03.368711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:03.377516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3fdbdded-0e07-42fe-be3d-4a3ae0365c8a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1354 microversion: 2.1 time: 0.099300 Oct 04 21:59:03.382284 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3306/6506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:03 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:04.402707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:04.403418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:04.410277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.410795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.411235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.412050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:04.412472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:04.412903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:04.483958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:04.492131 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a658b27-bbb9-49ed-9a07-d4d688f90f3f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1188 microversion: 2.1 time: 0.094660 Oct 04 21:59:04.492826 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3201/6507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:04 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:05.516126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:05.516755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:05.523738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.524232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.524673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.525396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:05.525841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:05.526281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:05.592539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:05.601597 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0eb0d569-8f9d-4af8-9df4-e814bffa0d26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1188 microversion: 2.1 time: 0.089255 Oct 04 21:59:05.602443 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3307/6508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:05 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:06.627666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:06.628521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:06.631977 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:59:06.632126 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 21:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a (ip 10.222.0.36) !!! Oct 04 21:59:06.641296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.641848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.642294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.643066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:06.643750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:06.644234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:06.710678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:06.718837 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd03e67c-49df-4a69-ab81-3c119421000c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1188 microversion: 2.1 time: 0.095133 Oct 04 21:59:06.719425 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3202/6509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:06 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:07.742205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:07.742776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:07.745705 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:59:07.745856 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 21:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a (ip 10.222.0.36) !!! Oct 04 21:59:07.752210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.752696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.753132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.753827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:07.754306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:07.754762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:07.775364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:07.820843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:07.829566 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a411a4eb-711d-45c4-b462-5ab281e377a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 200 len: 1188 microversion: 2.1 time: 0.091318 Oct 04 21:59:07.830393 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3308/6510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:07 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:08.853493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:08.854033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 7c065851-4a3e-44a5-bd37-39ed34a3411a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:08.860938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:08.861421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:08.861859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:08.862554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:08.863033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:08.863458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:08.877021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a HTTP/1.1 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '7c065851-4a3e-44a5-bd37-39ed34a3411a'} Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:59:08.878696 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 7c065851-4a3e-44a5-bd37-39ed34a3411a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8dbe40a-913a-42e0-8cad-e136a5d1e040 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a" status: 404 len: 111 microversion: 2.1 time: 0.030816 Oct 04 21:59:08.883326 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3203/6511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:08 2022] GET /compute/v2.1/servers/7c065851-4a3e-44a5-bd37-39ed34a3411a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:59:38.257036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942965967", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b6b0e111-81dc-4535-b46d-8cea79ea97eb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:38.267944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:38.350614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:59:38.719636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:59:38.720064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:59:38.720534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:59:38.720940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:59:38.721564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:59:38.731704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:38.732183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:38.732614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:38.733326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:38.733773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:38.734192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:38.751631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:59:38.757702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:59:38.770205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:59:38.772339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b6b0e111-81dc-4535-b46d-8cea79ea97eb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:59:38.960205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f25c576-2c6d-46fe-9ccb-8d172fd0cd31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707718 Oct 04 21:59:38.967557 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3309/6512] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 21:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:59:38.973692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80a846d5-3a61-4814-a460-54563a063c36 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:38.974311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80a846d5-3a61-4814-a460-54563a063c36 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:38.976779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:38.977671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=74 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:39.034815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80a846d5-3a61-4814-a460-54563a063c36 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:39.053495 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80a846d5-3a61-4814-a460-54563a063c36 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1057 microversion: 2.1 time: 0.073245 Oct 04 21:59:39.053495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3204/6513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:38 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1057 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:40.066875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:40.067672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:40.074527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:40.074938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:40.075370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:40.076078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:40.076645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:40.077123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:40.139851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:40.148255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11902d70-34bd-4428-87d8-20217b138103 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1061 microversion: 2.1 time: 0.086837 Oct 04 21:59:40.148845 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3310/6514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:40 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1061 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:41.176874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:41.177614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:41.186958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:41.187454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:41.187919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:41.188681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:41.189098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:41.189530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:41.274474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:41.282353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a759f35a-8c1a-4165-aa8d-7c9e0e03dc1e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1117 microversion: 2.1 time: 0.110456 Oct 04 21:59:41.283216 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3205/6515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:41 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1117 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:42.309240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:42.309857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:42.317757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:42.318248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:42.318703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:42.319606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:42.320064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:42.320488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:42.578910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:42.588154 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83ae3bd4-37ac-4ff3-85a7-fad2aeff17ee tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.282662 Oct 04 21:59:42.588968 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3311/6516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:42 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:43.226207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "941a0233-35f4-4e17-b188-66291fea79e2", "tag": "a06280ce-ddf4-4a33-b812-9c3149da501e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:43.238003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.238495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.238983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.251380 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] Creating event network-changed:a06280ce-ddf4-4a33-b812-9c3149da501e for instance 941a0233-35f4-4e17-b188-66291fea79e2 on n-h2-851029-13 Oct 04 21:59:43.257430 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bb164816-3841-4930-b8ed-637e471cfea0 req-cbe35855-16f7-4d95-b31e-dc2f122eec62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035165 Oct 04 21:59:43.258940 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3206/6517] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:43.614893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:43.614893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:43.621538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.622039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.622516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.623267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.623828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.624634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.841149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:43.850433 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bec28f76-bd46-4491-b202-34a8e128f405 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.241559 Oct 04 21:59:43.863222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3312/6518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:43 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:44.874021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.875370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:44.883461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.883994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.884445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.885210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.885764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.886204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:45.032082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:45.042704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e59d6ff1-dfe2-4fef-bbab-88ba8f76309d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.172934 Oct 04 21:59:45.043604 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3207/6519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:44 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:46.067459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:46.068105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:46.075230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.075720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.076166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.076880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:46.077341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:46.077779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.226808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.235417 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22b94f37-e17e-4b60-ac3a-1e0f7290f56d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.171845 Oct 04 21:59:46.236062 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3313/6520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:46 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:47.259087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:47.259687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:47.267218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.267703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.268157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:47.268923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.269442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.269879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:47.449722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:47.459350 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8090e337-d749-42b5-9d83-f09b045cc6da tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.203185 Oct 04 21:59:47.459350 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3208/6521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:47 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:48.484045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:48.484606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:48.493245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:48.493830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:48.494289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:48.495049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:48.495513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:48.495943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:48.654202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:48.663149 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1167eff6-27e1-4c94-91b5-5dcc3e9af9f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.183280 Oct 04 21:59:48.663757 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3314/6522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:48 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:49.687941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.689107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.692388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:49.696474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.696970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.697413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.698127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.698588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.699041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.852959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.860872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cbc4d68-267e-4271-bc9e-87f4948cf3c6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.177289 Oct 04 21:59:49.861983 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3209/6523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:50.890779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:50.891963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:50.895768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:50.896929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:50.907103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.907744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.909090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.909866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.910386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.911041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.063362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:51.075767 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53e780e6-17fd-408f-8311-0d00127eca62 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.192265 Oct 04 21:59:51.076813 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3315/6524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:50 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:52.103797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.105694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.115823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.116314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.116790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.117527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.118001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.118454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.269592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.280622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15eb7838-4b2a-42e8-b9a7-8f569c9a7f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.180804 Oct 04 21:59:52.281230 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3210/6525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:53.307509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.308138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.318082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.318481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.319185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.320150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.320618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.321059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.487975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.495830 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-604cbda3-a85b-41b7-8a21-1adc94796efb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.192628 Oct 04 21:59:53.496413 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3316/6526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:54.525560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:54.526602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:54.538873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.539409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.539892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.540659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:54.541165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:54.541782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:54.690505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:54.699251 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-910ec129-4658-4cfc-bbce-55da925583a1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.183249 Oct 04 21:59:54.700236 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3211/6527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:54 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:55.723695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:55.724297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:55.733323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.733944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.734378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.735206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.735654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.736116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.882086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.890561 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72ebea53-479e-4eb4-bdc0-02c84c951132 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.170719 Oct 04 21:59:55.891181 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3317/6528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:55 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:56.918457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:56.919104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:56.927944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.928786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.929842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.931160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.931860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.932359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.086603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.094584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c952280d-b97e-46e5-a126-9e0f191b4e4c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.180007 Oct 04 21:59:57.095205 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3212/6529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:56 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:58.118564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:58.119250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:58.126155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.126680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.127134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.127820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:58.128277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:58.128729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:58.275246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:58.284457 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86a8a7ea-013d-4965-9a0a-ebd48894337f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.170543 Oct 04 21:59:58.285054 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3318/6530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:58 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:59.307388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.307943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.316763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.317311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.317751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.318507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.318992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.319421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.464458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.472918 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16c5eda9-a37f-43d7-a3cd-196761c0775f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.169906 Oct 04 21:59:59.473502 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3213/6531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:00.496385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.497048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.504568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.505092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.505502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.506200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.506678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.507120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.653194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.665218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e706d7f8-d0ab-4707-92ab-0ec26accb594 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.172642 Oct 04 22:00:00.665999 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3319/6532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:01.691936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:01.694602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:01.699085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.700667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.700667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.700667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.702741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.702741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.851345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:01.859732 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c246d607-4010-43a4-9084-f5357c095285 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.173931 Oct 04 22:00:01.860691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3214/6533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:01 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:02.883420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:02.884012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:02.891072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.891577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.893102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.893805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.894259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.894900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.037188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.046455 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-865875c9-d6e6-46cf-8bfd-c688cd891d92 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.166952 Oct 04 22:00:03.047200 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3320/6534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:02 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:04.069362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.069976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:04.076917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.077409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.077858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.078567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.079062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.079999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.223926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.232169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35625b42-fd61-44ee-ab1f-3b84bcc9268a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.166711 Oct 04 22:00:04.232779 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3215/6535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:05.255819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.256358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:05.263616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.264103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.264539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.265239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.265694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.266116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.410862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:05.418919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f5ab01a4-4908-4c51-bd84-c31c838c24e3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.167093 Oct 04 22:00:05.419620 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3321/6536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:05 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:06.444246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:06.444875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:06.460936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.461437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.461883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.462608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.463103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.463537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.601791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.609698 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f60a7d1a-46b3-4813-898d-f943832f58a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.169548 Oct 04 22:00:06.610281 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3216/6537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:06 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:07.633426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:07.634039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:07.641091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.641569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.642674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.643379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.643836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.644256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.778792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:07.786758 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cb419913-8c86-4e9c-92a3-4e19fa4c8b5f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.157219 Oct 04 22:00:07.787341 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3322/6538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:07 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:08.810539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:08.811194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:08.818309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.818870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.819357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.820098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:08.820582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:08.821027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.963768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.971599 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5334bb0d-bae1-40b6-b49d-6cfc0e0511ed tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1169 microversion: 2.1 time: 0.165559 Oct 04 22:00:08.972216 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3217/6539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:08 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:09.995655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.996239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.999084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:10.004825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.013217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=83 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:10.140661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:10.148478 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ad688ac-dc64-45e3-9973-6b22a47760dd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.156996 Oct 04 22:00:10.149058 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3323/6540] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:11.171587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:11.172207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:11.179440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.179923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.180358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.181057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:11.181516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:11.181943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:11.186145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=76 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:11.319338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:11.327661 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08d512ae-2d9f-4d20-a7f1-a5755b879f07 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.159994 Oct 04 22:00:11.328235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3218/6541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:11 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:12.351443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:12.352051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:12.359037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.359522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.359952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.361144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:12.361596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:12.362020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:12.498005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:12.505782 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97c82f51-d3fa-4773-985d-dd64fcc51acb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.158321 Oct 04 22:00:12.506387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3324/6542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:12 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:13.529370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:13.530007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:13.533187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:13.538118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.545359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.545359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.545359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:13.545359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:13.545359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:13.673652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:13.682126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a21e4059-8113-4efb-a3ce-670d6fc9cf22 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.156671 Oct 04 22:00:13.682729 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3219/6543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:13 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:14.706528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:14.707127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:14.714424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.714955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.715396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.716107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:14.716583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:14.717045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:14.868189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:14.876310 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03dda803-fba7-4229-9e5f-43b823db1a2e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.174374 Oct 04 22:00:14.876915 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3325/6544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:14 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:15.899067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:15.899689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:15.906645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.907172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.907601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:15.908820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:15.909279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:15.909707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:16.041884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:16.049904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e135f904-d757-49f9-a46a-c216832d63bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.154658 Oct 04 22:00:16.050508 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3220/6545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:15 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:17.072946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:17.073561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:17.080924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.081407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.081842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.082532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:17.083020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:17.083444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:17.219614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:17.227739 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75cde43b-1f52-4359-a164-30869e3fd31e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.158722 Oct 04 22:00:17.228332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3326/6546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:17 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:18.250122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:18.250762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:18.257244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.257737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.258176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.258927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.259386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.259818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.404878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:18.413486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-92e5ca78-1bcc-495f-b25a-ce2aa2b5b469 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.167496 Oct 04 22:00:18.414464 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3221/6547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:18 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:18.604624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "941a0233-35f4-4e17-b188-66291fea79e2", "name": "network-vif-plugged", "status": "completed", "tag": "a06280ce-ddf4-4a33-b812-9c3149da501e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:18.616169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:18.616674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:18.617102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:18.629497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] Creating event network-vif-plugged:a06280ce-ddf4-4a33-b812-9c3149da501e for instance 941a0233-35f4-4e17-b188-66291fea79e2 on n-h2-851029-13 Oct 04 22:00:18.635104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2ee9306c-1868-4ad6-9486-14ee4af0f8df req-8eb826a6-e377-439f-96a8-ad0768372bbd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Oct 04 22:00:18.635742 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3327/6548] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:19.436409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:19.437034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:19.444732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.445226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.445671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.446407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:19.446893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:19.447326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:19.582285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:19.590274 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2eb1b5e7-f674-459a-8e98-d38b3af85de5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1203 microversion: 2.1 time: 0.157706 Oct 04 22:00:19.590902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3222/6549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:19 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:20.614896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.615603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.622004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.622501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.622970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.623678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.624143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.624574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.763478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.772552 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6de5fd0a-ccd5-4b6e-a792-46416cb4bdfe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1389 microversion: 2.1 time: 0.163339 Oct 04 22:00:20.773245 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3328/6550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:20.798605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.799542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.808078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.808797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.809510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.810211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.810684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.811115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.947840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:20.961758 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d303c955-26b9-4c28-af89-5f33b67eef9d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1389 microversion: 2.1 time: 0.168326 Oct 04 22:00:20.962315 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3223/6551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:20.985692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:20.986310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:20.992936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.993440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.993888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:20.994615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:20.995114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:20.995547 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.132316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.140677 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b89f3bfa-ae2c-4e96-9846-43f49b88ac50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1389 microversion: 2.1 time: 0.158868 Oct 04 22:00:21.141309 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3329/6552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:20 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:21.222378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.222819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.228843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.229318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.229748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.230430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.230916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.231339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.257622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:00:21.619393 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3804c1a5-f745-4ac6-8d40-78650e4b532e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 204 len: 0 microversion: 2.1 time: 0.401148 Oct 04 22:00:21.629896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3224/6553] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:21 2022] DELETE /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:00:21.630073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:21.630073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:21.637199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.637862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.638303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.639035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:21.639544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:21.639977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:21.780505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:21.788427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-505b9d1e-8b47-4151-9bd7-1ea7cce64cbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1395 microversion: 2.1 time: 0.164077 Oct 04 22:00:21.789000 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3330/6554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:21 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:22.813718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:22.814424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:22.824217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.824709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.825153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.825863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:22.826317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:22.826765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:22.963974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:22.972633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b2f39ee-5e68-4f2d-adcb-3e34f98fe8f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1395 microversion: 2.1 time: 0.164375 Oct 04 22:00:22.973234 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3225/6555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:22 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:23.598589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "941a0233-35f4-4e17-b188-66291fea79e2", "name": "network-vif-deleted", "tag": "a06280ce-ddf4-4a33-b812-9c3149da501e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:23.608945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:23.614834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:23.614834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:23.622573 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] Creating event network-vif-deleted:a06280ce-ddf4-4a33-b812-9c3149da501e for instance 941a0233-35f4-4e17-b188-66291fea79e2 on n-h2-851029-13 Oct 04 22:00:23.628852 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-393bc5b1-cbca-4b57-97f7-56916475efe0 req-7d8dfb21-8586-49a9-bd17-306489a82b16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Oct 04 22:00:23.629671 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3331/6556] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:23.996010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:23.996626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:24.004256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.011258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.011258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.011258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:24.011258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:24.011258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:24.071252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:24.079131 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-024680b5-859d-4977-9310-9fbc85880f94 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1188 microversion: 2.1 time: 0.087029 Oct 04 22:00:24.080191 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3226/6557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:23 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:25.104477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:25.105336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:25.112872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:25.112872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:25.113226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:25.113925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:25.114379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:25.114834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:25.181283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:25.189427 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bca4e79-bca8-44fd-92f6-b8e31bdbd91d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1188 microversion: 2.1 time: 0.090228 Oct 04 22:00:25.190031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3332/6558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:25 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:26.214191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:26.214882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:26.222152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:26.222655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:26.223115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:26.223831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:26.224286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:26.224708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:26.294203 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:26.302922 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0b15204-d383-4fbf-977f-9b8151781d1b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1188 microversion: 2.1 time: 0.093434 Oct 04 22:00:26.303858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3227/6559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:26 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:27.325444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:27.326055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:27.333592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.334074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.334511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.335234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:27.335693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:27.336115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:27.405895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:27.415680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ec3f8192-63a4-4c78-8945-5f3596831579 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1188 microversion: 2.1 time: 0.093124 Oct 04 22:00:27.415680 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3333/6560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:27 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:28.438110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:28.438756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:28.447451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.454067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.454067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.454067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.454067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.454067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.485179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:28.485659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:28.486100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:28.486542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lazy-loading 'fault' on Instance uuid 941a0233-35f4-4e17-b188-66291fea79e2 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:00:28.532293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:28.542616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9ccd4e7-9887-4b74-a61c-31a6afed17b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 200 len: 1193 microversion: 2.1 time: 0.108925 Oct 04 22:00:28.543374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3228/6561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:28 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:29.568651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:29.569281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:29.577049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.577554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.578401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.578733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:29.579202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:29.579635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:29.595030 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 HTTP/1.1 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '941a0233-35f4-4e17-b188-66291fea79e2'} Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:29.596769 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-438ecdb3-0aae-413f-80f8-2dd69edc88e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 404 len: 111 microversion: 2.1 time: 0.034264 Oct 04 22:00:29.601488 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3334/6562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:29 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:00:31.746360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:31.746925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:31.754786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.755277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.755715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.756414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.756869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.757294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.771787 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 HTTP/1.1 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '941a0233-35f4-4e17-b188-66291fea79e2'} Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:31.773485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94932489-2cbf-4288-9e8e-f9bd3c06ddec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 404 len: 111 microversion: 2.1 time: 0.032453 Oct 04 22:00:31.778584 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3229/6563] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:00:31 2022] DELETE /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:31.783770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:31.784388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 941a0233-35f4-4e17-b188-66291fea79e2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:31.791377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.791865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.792306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.792998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:31.793457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:31.793885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:31.808159 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 HTTP/1.1 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '941a0233-35f4-4e17-b188-66291fea79e2'} Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:00:31.809731 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 941a0233-35f4-4e17-b188-66291fea79e2 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68f5419f-4834-4bc6-81c5-a056915d2271 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2" status: 404 len: 111 microversion: 2.1 time: 0.031262 Oct 04 22:00:31.813820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3335/6564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:31 2022] GET /compute/v2.1/servers/941a0233-35f4-4e17-b188-66291fea79e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:00:59.695300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1243914329", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "82f9693e-62e9-46d7-8cd8-c53849ea7a10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:59.705611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:59.706268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:00:59.707060 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:00:59.707275 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:00:59.775951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:00.213081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:00.213528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:00.214002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:00.214416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:00.214917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:00.224239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.224715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.225147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.225872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:00.226323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:00.226787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:00.243418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:00.248568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:00.307502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:00.309967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82f9693e-62e9-46d7-8cd8-c53849ea7a10',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:00.765641 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6aa370a9-87e8-40f9-962b-d92f1f5af1fe tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074885 Oct 04 22:01:00.766593 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3230/6565] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:00.778503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e9e39b5f-1eb1-49d5-93cb-97d5c6139af2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:00.779144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e9e39b5f-1eb1-49d5-93cb-97d5c6139af2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:00.781431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=25 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:00.782262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=61 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:00.840792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e9e39b5f-1eb1-49d5-93cb-97d5c6139af2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:00.847041 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e9e39b5f-1eb1-49d5-93cb-97d5c6139af2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1071 microversion: 2.1 time: 0.072445 Oct 04 22:01:00.847693 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3336/6566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:00 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1071 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:01.871789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:01.872409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:01.879280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.879960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.880469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.881289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:01.881841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:01.882448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:01.949197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:01.957806 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2ad27e0-e971-433b-9f87-f29d1fc3f3d2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1121 microversion: 2.1 time: 0.091071 Oct 04 22:01:01.961927 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3231/6567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:01 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1121 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:02.981737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:02.982429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:02.991129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:02.996493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:02.996493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:02.996493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:02.996493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:02.996493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:03.064000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:03.073457 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10471a4c-16b8-4be3-a55d-cf61a12fa706 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1187 microversion: 2.1 time: 0.095617 Oct 04 22:01:03.074162 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3337/6568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:02 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:04.097608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:04.099488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:04.106785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:04.107434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:04.107761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:04.108443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:04.108921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:04.109344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:04.375776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:04.381452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4049907e-aabb-40b8-aac8-2e12d7740f6d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1229 microversion: 2.1 time: 0.287683 Oct 04 22:01:04.382076 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3232/6569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:04 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1229 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:05.033386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7608997-90a5-4961-b3e9-a69ea5089657", "tag": "7d33d0f5-55c5-481c-959c-32d7b66e1014"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:05.046761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:05.047478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:05.048090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:05.061097 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] Creating event network-changed:7d33d0f5-55c5-481c-959c-32d7b66e1014 for instance b7608997-90a5-4961-b3e9-a69ea5089657 on n-h2-851029-13 Oct 04 22:01:05.067033 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1e6b07f1-98a1-4e37-a243-0c0a4fce2879 req-ca06208e-1d5d-4c62-b6ae-478f138f8175 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104537 Oct 04 22:01:05.067932 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3338/6570] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:05.405624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:05.406507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:05.413658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:05.414152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:05.414593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:05.415334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:05.416011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:05.416629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:05.564622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:05.577329 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2c1d422-a2ca-49a4-ab0b-27cef869a692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1229 microversion: 2.1 time: 0.175550 Oct 04 22:01:05.579470 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3233/6571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:05 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1229 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:06.601870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:06.602569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:06.608774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:06.609252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:06.609685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:06.610368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:06.610857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:06.611284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:06.761141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:06.769067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-172b4e8b-e403-4df0-9834-20d04459bad3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1229 microversion: 2.1 time: 0.172282 Oct 04 22:01:06.770390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3339/6572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:06 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1229 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:07.792710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:07.793326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:07.800480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:07.800969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:07.801437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:07.802212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:07.802739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:07.803173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:07.940235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:07.947994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25497f86-a178-47a7-8c7f-f5b62612235e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1229 microversion: 2.1 time: 0.159282 Oct 04 22:01:07.948581 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3234/6573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:07 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:08.971195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:08.971741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:08.979241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:08.979721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:08.980157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:08.980850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:08.981300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:08.981721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:09.117993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:09.126250 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdc8ce76-0e57-4316-b4b0-15110681a0de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.159075 Oct 04 22:01:09.126869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3340/6574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:08 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:10.150506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:10.151152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:10.158011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:10.158498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:10.158982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:10.159681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:10.160740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:10.161174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:10.233339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:10.254836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:10.291549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:10.299760 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4c87448-0d66-435d-987a-6b1f687b8416 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.153183 Oct 04 22:01:10.300343 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3235/6575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:10 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:11.323292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:11.323918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:11.326911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:11.331778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.332266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.332706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.333401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:11.333862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:11.334295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:11.469433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:11.478335 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2fd00698-7673-4475-b5ef-6fa3140efe2c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.158879 Oct 04 22:01:11.478974 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3341/6576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:11 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:12.501662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:12.502306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:12.510026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.510518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.510994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.511699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:12.512165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:12.512621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:12.646905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:12.654619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db8085d9-7548-48eb-975c-d7bcc49869d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.156934 Oct 04 22:01:12.655214 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3236/6577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:12 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:13.678003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:13.678536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:13.685560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:13.686041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:13.686475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:13.687191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:13.687644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:13.688092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:13.816801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:13.824544 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcded00a-35c3-4120-9ced-9d9f14a45fff tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.151000 Oct 04 22:01:13.825119 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3342/6578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:13 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:14.848461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:14.849104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:14.856178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:14.856664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:14.857108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:14.857810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:14.858274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:14.858733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:14.995568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:15.003529 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b32c171-8dce-45e2-adb8-8a2eddaf7940 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.159648 Oct 04 22:01:15.004103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3237/6579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:14 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:16.026260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:16.026893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:16.033695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:16.034175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:16.034633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:16.035880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:16.036333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:16.036758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:16.170577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:16.178545 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e21258b7-5bda-4ba8-a275-ce74ffae10f6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.156226 Oct 04 22:01:16.179152 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3343/6580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:16 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:17.201676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:17.202304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:17.210047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.210542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.211007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.211730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:17.212192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:17.212624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:17.354552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:17.363136 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70af8447-731d-4719-af30-588027ce1881 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.165416 Oct 04 22:01:17.369375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3238/6581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:17 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:18.391388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:18.392028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:18.399012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:18.399502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:18.399939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:18.400633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:18.401091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:18.401522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:18.531553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:18.540281 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e59c5efa-5994-439e-ae87-23b1acbeaf1c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.152829 Oct 04 22:01:18.540862 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3344/6582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:18 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:18.940530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7608997-90a5-4961-b3e9-a69ea5089657", "name": "network-vif-plugged", "status": "completed", "tag": "7d33d0f5-55c5-481c-959c-32d7b66e1014"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:18.950453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:18.950968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:18.951398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:18.963417 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] Creating event network-vif-plugged:7d33d0f5-55c5-481c-959c-32d7b66e1014 for instance b7608997-90a5-4961-b3e9-a69ea5089657 on n-h2-851029-13 Oct 04 22:01:18.968616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f78f4e98-a7f5-453e-8856-52b0429b5c73 req-9222ec0a-91e6-459e-b986-7bd478526f46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096623 Oct 04 22:01:18.969399 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3239/6583] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:19.563347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:19.563966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:19.571366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.571849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.572287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.572981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:19.573441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:19.573867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:19.707523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:19.715828 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-299da452-f255-453a-81fa-ba55693c2214 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1217 microversion: 2.1 time: 0.156354 Oct 04 22:01:19.716401 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3345/6584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:19 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:20.740885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.741509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.747796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.748286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.748731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.749439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.749895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.750325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.893532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:20.902152 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b77c7de9-9bb3-4543-8b75-5b5eaed9efea tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1404 microversion: 2.1 time: 0.167086 Oct 04 22:01:20.902781 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3240/6585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:20.926293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.926943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.934517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.936241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.936241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.936241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.936686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.937310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.074561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.082538 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f00abf5-e359-4954-b8ac-a4b3a08062d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1404 microversion: 2.1 time: 0.160901 Oct 04 22:01:21.083161 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3346/6586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:21.106407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1640262313"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:21.109190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:21.116260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.116805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.117291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.118088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.118747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.119275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.219994 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Attempting to quiesce instance before volume snapshot. Oct 04 22:01:21.240045 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 22:01:21.477594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Creating snapshot from volume 82f9693e-62e9-46d7-8cd8-c53849ea7a10. {{(pid=123542) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 22:01:23.056748 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25767a2b-5369-4ec8-a24d-f35c37c8ff3b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657/action" status: 202 len: 0 microversion: 2.1 time: 1.954358 Oct 04 22:01:23.063049 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3241/6587] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:01:21 2022] POST /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657/action => generated 0 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:01:24.215758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-116306999", "imageRef": "544c0933-896a-4134-9fbd-47803a4076fe", "flavorRef": "452", "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:24.273123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:24.701439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:24.701872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:24.702489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:24.702943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:24.703364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:24.713026 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.713518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.713965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.714722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.715192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.715615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.734251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:24.739795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:24.752427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:24.755139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='50a0dda1-9f87-4c58-b39d-b68230d4f597',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:24.934958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f698b1f3-0337-4d04-9baf-7839b9ba9fc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722980 Oct 04 22:01:24.935618 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3347/6588] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:01:24.948868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-748f6293-442d-4cdd-b33c-16808219165d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:24.949507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-748f6293-442d-4cdd-b33c-16808219165d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:25.007227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-748f6293-442d-4cdd-b33c-16808219165d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:25.014642 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-748f6293-442d-4cdd-b33c-16808219165d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1229 microversion: 2.1 time: 0.071048 Oct 04 22:01:25.015556 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3242/6589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:24 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1229 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:26.039656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:26.040278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:26.050186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.050696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.051146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.051855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:26.052498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:26.052836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:26.116592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:26.124702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a623ef72-1b48-4cc3-828f-d8a67a3c794b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1233 microversion: 2.1 time: 0.090471 Oct 04 22:01:26.125505 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3348/6590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:26 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:27.149298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:27.150068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:27.157720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.158243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.158817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.159570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:27.160046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:27.161068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:27.233332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:27.242721 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d6674c2-fa2d-44b8-b0b4-346285c424d5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1299 microversion: 2.1 time: 0.097805 Oct 04 22:01:27.251784 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3243/6591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:27 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:28.284943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:28.286646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:28.294548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:28.295189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:28.295712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:28.296556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:28.297094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:28.297603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:28.456400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:28.465849 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9c2475d-0c55-4d37-8c15-6f06783b8a50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.185007 Oct 04 22:01:28.467125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3349/6592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:28 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:29.193191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488a9636-6acc-4b65-81fc-5a628598a98c", "tag": "eb248897-7b03-4264-947f-5cbdcd56fb5a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:29.203493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.204109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.204624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.226982 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] Creating event network-changed:eb248897-7b03-4264-947f-5cbdcd56fb5a for instance 488a9636-6acc-4b65-81fc-5a628598a98c on n-h1-851029-13 Oct 04 22:01:29.232880 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b2e06c60-a19d-4020-b15d-8f1d6c6ec850 req-c5b41197-abe6-4c59-a58f-c2dae7ed68ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111984 Oct 04 22:01:29.234373 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3244/6593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:29.489502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:29.490141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:29.497376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.497873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.498315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.499150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:29.499646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:29.500076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:29.660480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:29.667389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c32fe345-f5a0-421b-84cf-12fb98b4508d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.181917 Oct 04 22:01:29.667959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3350/6594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:29 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:30.693614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:30.694394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:30.696757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:30.702557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.703295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.703811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.704681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:30.705473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:30.705900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:30.711109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:30.860086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:30.869347 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d519754d-ebbe-4f20-9b99-7bc47691203a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.181855 Oct 04 22:01:30.870238 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3245/6595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:30 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:31.895295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:31.896177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:31.899594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:31.905306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.905908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.906342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:31.907136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:31.907693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:31.908117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:32.068699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:32.076568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2317c5de-4fbe-4c4d-a119-f6bb929ddf32 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.186071 Oct 04 22:01:32.077343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3351/6596] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:31 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:33.101616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:33.102268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:33.109671 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.110196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.110643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.111473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:33.111907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:33.112348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:33.283946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:33.293356 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52a03e49-4be1-49f4-a356-3efea3dd4543 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.196206 Oct 04 22:01:33.293975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3246/6597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:33 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:34.319011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:34.320280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:34.327790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.329831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.329831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.329831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:34.329831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:34.330312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:34.333746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=83 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:34.500857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:34.512103 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-286915cf-0f1c-4a70-9eea-0da4531cf351 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.195747 Oct 04 22:01:34.512103 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3352/6598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:34 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:35.536218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:35.536870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:35.540062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:35.545717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.546577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.547143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.547960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:35.548453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:35.548910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:35.702493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:35.711305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5946498-990a-462c-82b9-b699b09d8dc4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.178906 Oct 04 22:01:35.711903 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3247/6599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:35 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:36.739417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:36.741155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:36.742545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:36.743110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:36.748793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.749287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.751594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.751594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:36.751594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:36.751594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:36.910273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:36.918122 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e70665e4-1ff1-4f07-afc3-70bd0834643c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.183295 Oct 04 22:01:36.918714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3353/6600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:36 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:37.944150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:37.945075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:37.952789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:37.953294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:37.953749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:37.954497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:37.955036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:37.955485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:38.130821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:38.139448 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85680f5e-2911-422b-8842-b50cba44b680 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.200058 Oct 04 22:01:38.140339 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3248/6601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:37 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:39.163475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:39.164109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:39.171938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.172429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.172882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.173575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:39.174030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:39.174462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:39.324794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:39.333322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7016d4e-b276-4c07-900d-9264fbadeb41 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.174375 Oct 04 22:01:39.333928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3354/6602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:39 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:40.357106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:40.357742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:40.367355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.367878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.368534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.369487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:40.369967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:40.370422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:40.518120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:40.527301 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7cb55fa-9e55-4ad5-ac87-bc1eb5a43943 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.174033 Oct 04 22:01:40.527936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3249/6603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:40 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:41.552357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:41.553009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:41.560496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.561008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.561461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.562181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:41.562642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:41.563102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:41.701306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:41.709977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9df937e3-4c9e-4cca-a384-f55f331b588b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.162233 Oct 04 22:01:41.710574 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3355/6604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:41 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:42.734486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:42.735216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:42.742526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.743069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.746195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.746195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:42.746195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:42.746195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:42.890474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:42.898397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-acd41fc2-7089-49c3-8159-c8ee92041f51 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.167901 Oct 04 22:01:42.899006 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3250/6605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:42 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:43.921800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:43.922411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:43.930953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.931477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.931931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:43.932633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:43.933127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:43.933554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:44.071608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:44.079943 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f0bc1be-cabb-4a78-a583-e18fb3a7220b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.162000 Oct 04 22:01:44.080538 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3356/6606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:43 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:45.109660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:45.110368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.119131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.130632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.130632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.130632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.130632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.130632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.258815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.266909 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-28dfcd20-d124-4a6e-998d-3a35c3d8e34f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.161206 Oct 04 22:01:45.267503 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3251/6607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:45 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:46.293178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:46.293864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.301485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.301975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.302425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.303232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.303627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.304504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.448189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:46.459497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6d638fb-39df-4b22-a43e-5b1386e1f16b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.170549 Oct 04 22:01:46.460097 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3357/6608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:46 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:47.484238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.484877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.493038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.493542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.493995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.494766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.495506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.495724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.647796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:47.656058 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4e320bf-b28f-4673-aa5e-7bd31e8e297b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.175859 Oct 04 22:01:47.656673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3252/6609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:48.684043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:48.684748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:48.691931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.692419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.692858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.693743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.694214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.694645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.846287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.850231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77c0511f-d71b-4f94-8e35-da5964aa871f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.170753 Oct 04 22:01:48.850847 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3358/6610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:48 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:49.875186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.876166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.883093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.883527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.884398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.884712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.885169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.885603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.038904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.052017 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1144bee2-5e59-4455-b985-30790d615988 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.181271 Oct 04 22:01:50.053112 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3253/6611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:51.075657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:51.076274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:51.083840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.084332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.084773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.085485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:51.085946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:51.086374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:51.227704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:51.235607 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e51f579-f9ee-4c9c-8f3c-a3d90275ba26 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.163845 Oct 04 22:01:51.240981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3359/6612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:52.259439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.260096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.267090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.271084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.271084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.271084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.271084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.271084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.405569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.414331 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e949be1-e12b-4487-8fb5-fe275b5d096e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.158889 Oct 04 22:01:52.414992 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3254/6613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:52 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:53.437635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.457301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.879275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.887324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65aab862-ba75-4639-8e13-5f09d437af76 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.453505 Oct 04 22:01:53.887925 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3360/6614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:54.912311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.912896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.920900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.921412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.921873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.922741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.923232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.923749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.069575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.078270 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16dadbed-cdf2-4634-a3c6-164695e4a70a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.170838 Oct 04 22:01:55.078909 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3255/6615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:56.102706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:56.103380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:56.110699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.111204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.111639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.112841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.113310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.113837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.261213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:56.269467 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7f83a88-b600-4853-b598-4246ddfc59cb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.170644 Oct 04 22:01:56.270099 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3361/6616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:56 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:57.292868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:57.293493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:57.300891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.301390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.301843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.302648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:57.303145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:57.303583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.453718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.463298 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cab2f88-16f8-4943-8b2c-1fa3cc262933 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.174270 Oct 04 22:01:57.463912 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3256/6617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:57 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:58.486899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:58.487570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:58.494521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.495037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.495476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.502956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.502956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.502956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.641258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:58.650040 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a90a237-5318-4724-8238-87e49afab196 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.167116 Oct 04 22:01:58.650613 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3362/6618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:58 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:59.678064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:59.678679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:59.685954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.686452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.686948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.687666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.688145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.688589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.832696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.840843 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f38d4e9-68b7-42f9-9e5f-9c6a3d7de3cf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.166772 Oct 04 22:01:59.848745 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3257/6619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:59 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.865291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.865896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.873781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.874273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.874798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.875510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.875966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.876392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.021783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:01.030229 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dae4cbff-e6f6-4a6d-8889-3c48afa5a836 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.168931 Oct 04 22:02:01.030861 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3363/6620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:02.054184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.055270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.058448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:02.063791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.064302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.064784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.065767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.066396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.066900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.071670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:02.230891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:02.239351 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89d14696-30a6-4798-937f-a137a413273b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.189439 Oct 04 22:02:02.240041 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3258/6621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:02 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:03.274128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:03.274767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:03.277446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=26 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:03.282421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.282868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.283304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.284532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:03.284987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:03.285410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.442279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:03.452714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8291f1bc-127c-4726-90f1-77bc9cd90654 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.182477 Oct 04 22:02:03.453492 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3364/6622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:03 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:04.482695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.483440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.491225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.496823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.496823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.496823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.496823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.496823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.641149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.649919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a72e6c70-b3a7-4d72-acf2-b358e233d692 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.171841 Oct 04 22:02:04.650533 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3259/6623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:04 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:05.673647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.675111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.682861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.683363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.683787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.684491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.684942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.685365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.688365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=78 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:05.828833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.837906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bba8625b-e6d9-41bd-9311-42624467287b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.168093 Oct 04 22:02:05.838631 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3365/6624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:06.861983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:06.862548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:06.869922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.870605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.871166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.871893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.872361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.872804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:07.017770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:07.027352 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08f7ef3c-a13c-48fc-a2d4-7ef570c1296b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.169617 Oct 04 22:02:07.028111 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3260/6625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:06 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:08.052738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:08.053495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:08.061847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.062412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.062938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.063827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.064287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.064803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.221722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.236273 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ecf9fac-4d78-481e-bafa-7142b63b6c87 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.187603 Oct 04 22:02:08.237387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3366/6626] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:08 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:09.260998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:09.261527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:09.269339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.269844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.270292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.271050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:09.271521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:09.272070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:09.421785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:09.430965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6726a782-c9cb-4f88-84c1-78af06b95166 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1341 microversion: 2.1 time: 0.174036 Oct 04 22:02:09.431571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3261/6627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:09 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:10.458018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:10.458723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:10.466700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:10.470117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:10.470117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:10.470117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:10.470117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:10.470117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:10.620646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:10.630987 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3574605-ac48-4ab8-a1c2-6ae5c534f905 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1387 microversion: 2.1 time: 0.177522 Oct 04 22:02:10.631586 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3367/6628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:10 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1387 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:11.655624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:11.656241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:11.663851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.667492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.667492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.667492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:11.667492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:11.667492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:11.806383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:11.814794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e680903e-8a38-47f8-8e13-50a1b2ad1294 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.163284 Oct 04 22:02:11.815522 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3262/6629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:11 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:02:12.839179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:12.839815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:12.846988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:12.847482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:12.848458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:12.849174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:12.849637 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:12.850067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:12.989989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:12.998225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23bc741e-8a64-4e25-ae93-74ddb5e0d4ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.163044 Oct 04 22:02:12.998891 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3368/6630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:12 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:14.023022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:14.023648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:14.030695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:14.031195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:14.031640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:14.032351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:14.032819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:14.033251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:14.174232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:14.182521 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e2c5265-e747-4ce6-8ee2-08d620e654de tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.164285 Oct 04 22:02:14.183134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3263/6631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:14 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:15.206355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:15.207010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:15.213729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:15.214209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:15.214645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:15.215386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:15.215820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:15.216244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:15.351746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:15.360100 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57aff5e4-f484-4de7-af60-ee011c0edfb6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.157609 Oct 04 22:02:15.360696 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3369/6632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:15 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:16.383820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:16.384787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:16.391806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:16.392324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:16.392773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:16.393495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:16.393961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:16.394939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:16.539753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:16.547900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2c38d8e-b95f-4172-b605-410e6a5f62f4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.167940 Oct 04 22:02:16.548718 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3264/6633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:16 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:17.571620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:17.572343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:17.579271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:17.579765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:17.580203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:17.580952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:17.581407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:17.581834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:17.719160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:17.727852 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-914c8193-394f-4b38-bf29-e5ba2c031db3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.160102 Oct 04 22:02:17.728578 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3370/6634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:17 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:18.750091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:18.751043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:18.758181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.758725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.759176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.759888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:18.760353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:18.760792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:18.896533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:18.904607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-120a96a4-4b33-466a-be5c-a4b3ed574513 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.158379 Oct 04 22:02:18.905210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3265/6635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:18 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:19.928201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:19.929396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:19.936469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:19.936950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:19.937386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:19.938077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:19.938533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:19.938985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:20.084182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:20.087960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ffff74d-2fae-465e-8f06-540361a5072b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.163692 Oct 04 22:02:20.088594 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3371/6636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:19 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:21.111902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:21.112538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.129443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.162364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488a9636-6acc-4b65-81fc-5a628598a98c", "name": "network-vif-plugged", "status": "completed", "tag": "eb248897-7b03-4264-947f-5cbdcd56fb5a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:21.174092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:21.174630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:21.175094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:21.189288 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] Creating event network-vif-plugged:eb248897-7b03-4264-947f-5cbdcd56fb5a for instance 488a9636-6acc-4b65-81fc-5a628598a98c on n-h1-851029-13 Oct 04 22:02:21.199145 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5487d1cc-fe92-4640-bb01-31fdb431c6e7 req-754a54de-b9d1-45b1-8c55-b456c968a583 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040708 Oct 04 22:02:21.200236 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3372/6637] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:02:21.269948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:21.283352 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c2723d6-31f3-4e7d-bf74-d8dd3be42dbc tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.175470 Oct 04 22:02:21.284636 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3266/6638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:21 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:22.309567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:22.310330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:22.316643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:22.317128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:22.317570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:22.318272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:22.318770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:22.319202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:22.461419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:22.469706 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-251d0029-273b-4fe3-84b0-362d2f8b7bcf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1375 microversion: 2.1 time: 0.165553 Oct 04 22:02:22.470303 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3373/6639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:22 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:23.495019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.495695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:23.502979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.503479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.503920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.504631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.505099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.505538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.639343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:23.649395 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dfe1fe2a-7d83-4614-b0e4-13bdd7fcd101 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1562 microversion: 2.1 time: 0.158719 Oct 04 22:02:23.649986 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3267/6640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:23 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:23.675304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.675969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:23.683716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.684208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.684648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.685353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.685807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.686237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.815789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:23.823657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-78e80de3-aa0b-4e91-b3e6-8343c025efc8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1562 microversion: 2.1 time: 0.152486 Oct 04 22:02:23.824227 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3374/6641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:23 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:23.905535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:23.906070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:23.912084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.912579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.913604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.914313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:23.914811 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:23.915252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:23.941193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:24.405631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-537f699a-1e91-4e90-96e4-f73ecf07699f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 204 len: 0 microversion: 2.1 time: 0.503578 Oct 04 22:02:24.406338 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3268/6642] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:23 2022] DELETE /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:02:24.415114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:24.415730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:24.421668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.422154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.422589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.423311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:24.423762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:24.424304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:24.562563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:24.571159 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06cce7c8-f30a-4b6b-88d7-4fee128cc068 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1568 microversion: 2.1 time: 0.160527 Oct 04 22:02:24.571751 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3375/6643] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:24 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:25.595685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:25.596414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:25.603990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.604495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.604955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:25.605685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:25.606182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:25.606611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:25.748217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:25.756204 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-877443ee-a915-4837-a759-3a27fc5a97e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1568 microversion: 2.1 time: 0.164795 Oct 04 22:02:25.756845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3269/6644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:25 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:26.598868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488a9636-6acc-4b65-81fc-5a628598a98c", "name": "network-vif-deleted", "tag": "eb248897-7b03-4264-947f-5cbdcd56fb5a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:26.615383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:26.616022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:26.616583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:26.629221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] Creating event network-vif-deleted:eb248897-7b03-4264-947f-5cbdcd56fb5a for instance 488a9636-6acc-4b65-81fc-5a628598a98c on n-h1-851029-13 Oct 04 22:02:26.635902 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-915d7b8d-9a1c-474c-8e92-d0fe458f54b5 req-246ae2dc-9b18-4f4e-a6a6-30954a86b9cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040983 Oct 04 22:02:26.637470 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3376/6645] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:26.779599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:26.780234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:26.787206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:26.790447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:26.790447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:26.790447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:26.790447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:26.790447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:26.855918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:26.863803 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97894ef4-1d92-4462-adc4-edd1a2c6a111 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1526 microversion: 2.1 time: 0.088143 Oct 04 22:02:26.864393 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3270/6646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:26 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1526 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:27.890134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:27.890930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:27.897304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.898374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.898769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:27.899476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:27.899932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:27.900368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:28.254907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:28.264077 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0865345-6052-47e2-b4ce-798945839088 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1360 microversion: 2.1 time: 0.379137 Oct 04 22:02:28.264910 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3377/6647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:27 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1360 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:29.287413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:29.289049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:29.296399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:29.296895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:29.297345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:29.298054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:29.298525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:29.299049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:29.365375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:29.374081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e960d2c-6756-49af-8890-79c625a66cc0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1360 microversion: 2.1 time: 0.090699 Oct 04 22:02:29.374691 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3271/6648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:29 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:30.398082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:30.398793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:30.405688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:30.406215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:30.406648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:30.407357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:30.407870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:30.408299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:30.474315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:30.483227 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2acee00c-7a43-4bdf-ab68-2e1ecddf9c24 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1360 microversion: 2.1 time: 0.089668 Oct 04 22:02:30.483812 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3378/6649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:30 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:31.505632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:31.506414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:31.514265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.518459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.518459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.518459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.518459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.518459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.569577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:31.569577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:31.569577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:31.569577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lazy-loading 'fault' on Instance uuid 488a9636-6acc-4b65-81fc-5a628598a98c {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:02:31.604412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:31.604412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:31.610991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b0a0ce0-c4db-4f10-b151-143cdaed1001 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 200 len: 1365 microversion: 2.1 time: 0.109171 Oct 04 22:02:31.611758 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3272/6650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:31 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:32.640571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:32.641319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:32.648891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:32.649383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:32.649834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:32.650545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:32.651035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:32.651475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:32.665492 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c HTTP/1.1 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '488a9636-6acc-4b65-81fc-5a628598a98c'} Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:32.667234 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02791a29-abdc-4e29-a622-89141b9b3e04 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 404 len: 111 microversion: 2.1 time: 0.032405 Oct 04 22:02:32.672069 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3379/6651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:32 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:37.122120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:37.124138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:37.125703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:37.133039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.133819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.134273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.135024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.135497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.135942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.164469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:02:37.634333 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6cfc4165-029c-4b02-9c61-fecdc44fe375 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 204 len: 0 microversion: 2.1 time: 0.516344 Oct 04 22:02:37.634975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3273/6652] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:37 2022] DELETE /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:02:37.643498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:37.644131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:37.647187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=32 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:37.652212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.652697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.653136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.653866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:37.654306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:37.654807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:37.661439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=78 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:02:37.801748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:37.816906 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d7d5c3e-abd4-4561-8462-6630e0ec90e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1410 microversion: 2.1 time: 0.177126 Oct 04 22:02:37.817976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3380/6653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:37 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1410 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:38.841461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:38.842180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:38.849944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.850447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.850918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.851635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:38.852107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:38.852553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:38.986925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:38.995474 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-253de466-f404-4291-a329-3524ed46dc7a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1410 microversion: 2.1 time: 0.158220 Oct 04 22:02:38.996064 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3274/6654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:38 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:39.824863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7608997-90a5-4961-b3e9-a69ea5089657", "name": "network-vif-deleted", "tag": "7d33d0f5-55c5-481c-959c-32d7b66e1014"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:39.837800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:39.838210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:39.838647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:39.850224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] Creating event network-vif-deleted:7d33d0f5-55c5-481c-959c-32d7b66e1014 for instance b7608997-90a5-4961-b3e9-a69ea5089657 on n-h2-851029-13 Oct 04 22:02:39.855369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b1c0b114-e6ca-4a13-9a83-4f9381c6878c req-2b040768-a990-4ef6-99cd-481b21727d95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035490 Oct 04 22:02:39.855973 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3381/6655] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:40.018420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:40.019364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:40.027844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.028352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.028812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:40.029550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:40.030024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:40.030471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:40.103020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:40.111844 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e221930-f2ea-40ad-a33d-849e2935f9e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1202 microversion: 2.1 time: 0.097456 Oct 04 22:02:40.112459 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3275/6656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:40 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:41.141163 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:02:41.141779 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 (ip 10.222.0.36) !!! Oct 04 22:02:41.149838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:41.150561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:41.162371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:41.162901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:41.163934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.164678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:41.165148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:41.165586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:41.235856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:41.244228 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c13ca360-3d82-4a26-984b-d084c4f8cea1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1202 microversion: 2.1 time: 0.104627 Oct 04 22:02:41.244815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3382/6657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:41 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:42.268991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:42.269638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:42.277006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.278172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.278172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.278716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:42.279202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:42.279644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:42.345518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:42.355247 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe627dd6-f517-46f0-8a5d-c58e7b827239 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1202 microversion: 2.1 time: 0.090163 Oct 04 22:02:42.355834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3276/6658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:42 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:43.381583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:43.381583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:43.388449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:43.388941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:43.389381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:43.390087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:43.390567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:43.391043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:43.457838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:43.466290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5c1d5f0-2dd8-4f93-8235-473ea9fe941f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1202 microversion: 2.1 time: 0.090841 Oct 04 22:02:43.466928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3383/6659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:43 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:44.489261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:44.489922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:44.498861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.498964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.499425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.500147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:44.500617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:44.501058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:44.565626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:44.573870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cbb0a89-0209-4ba3-b831-b36563e9dc78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 200 len: 1202 microversion: 2.1 time: 0.088463 Oct 04 22:02:44.574706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3277/6660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:44 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:45.597284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:45.597961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:45.606937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.607536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.608015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.608741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:45.609205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:45.609649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:45.624805 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 HTTP/1.1 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b7608997-90a5-4961-b3e9-a69ea5089657'} Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:45.626611 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:45.631250 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fcf8fd3b-289b-4f59-b91a-40e0814ea2c5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 404 len: 111 microversion: 2.1 time: 0.035077 Oct 04 22:02:45.632817 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3384/6661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:45 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:47.780754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:47.781362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:47.788474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:47.788979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:47.789431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:47.790150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:47.790618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:47.791077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:47.807772 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c HTTP/1.1 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '488a9636-6acc-4b65-81fc-5a628598a98c'} Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:47.809501 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a303034a-9ffd-4340-a6e2-b1e41ed22992 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 404 len: 111 microversion: 2.1 time: 0.034269 Oct 04 22:02:47.817851 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3278/6662] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:47 2022] DELETE /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:47.823983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:47.823983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 488a9636-6acc-4b65-81fc-5a628598a98c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:47.828545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:47.829078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:47.829522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:47.830236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:47.830788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:47.831643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:47.846041 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c HTTP/1.1 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '488a9636-6acc-4b65-81fc-5a628598a98c'} Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:47.847640 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 488a9636-6acc-4b65-81fc-5a628598a98c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8ebf726-7958-43e7-a80a-0601c3ba56d8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c" status: 404 len: 111 microversion: 2.1 time: 0.032894 Oct 04 22:02:47.855869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3385/6663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:47 2022] GET /compute/v2.1/servers/488a9636-6acc-4b65-81fc-5a628598a98c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:48.791051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:48.791658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:48.798052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.798561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.799074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.799793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.800262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.800700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.815712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 HTTP/1.1 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b7608997-90a5-4961-b3e9-a69ea5089657'} Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:48.817302 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3dfd16d4-428b-4767-be99-ec37dea7e76c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 404 len: 111 microversion: 2.1 time: 0.031915 Oct 04 22:02:48.823134 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3279/6664] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:02:48 2022] DELETE /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:48.829301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:48.829928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: b7608997-90a5-4961-b3e9-a69ea5089657] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:48.837846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.838279 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.838760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.839477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:48.839947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:48.840382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:48.854822 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 HTTP/1.1 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b7608997-90a5-4961-b3e9-a69ea5089657'} Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:02:48.856413 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance b7608997-90a5-4961-b3e9-a69ea5089657 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d84b0516-e556-42c2-a768-75acab9b6c5a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657" status: 404 len: 111 microversion: 2.1 time: 0.032482 Oct 04 22:02:48.864513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3386/6665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:48 2022] GET /compute/v2.1/servers/b7608997-90a5-4961-b3e9-a69ea5089657 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:02:48.941943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac82e347-de34-4cff-a6b4-f629e6ba5603 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: .version_select at 0x7f54f5581a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-617644318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoUZ2BdU/LZHEPLqy1LaBWj5+m+hEdEuOGL4D6nKZKzl28WFWYPAMKjk+pXsqc1CA9r1VlXNxJpC8SR4XQ2liW0JOl+sjAsiStQgIv2dwytRxTIjZCx0FTZ1t260SyO8g=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:48.958841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ac82e347-de34-4cff-a6b4-f629e6ba5603 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:02:48.964823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-ac82e347-de34-4cff-a6b4-f629e6ba5603 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:02:49.091566 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac82e347-de34-4cff-a6b4-f629e6ba5603 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.153404 Oct 04 22:02:49.092168 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3280/6666] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:02:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:13.630527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-475346808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-617644318", "security_groups": [{"name": "tempest-secgroup-smoke-306836538"}], "block_device_mapping_v2": [{"uuid": "80c95afc-969f-4df8-9337-db765cae1bd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:13.643680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=13 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:13.644343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=25 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:13.804271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:03:14.184331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:03:14.184767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:03:14.185347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:03:14.185941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:03:14.186366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:03:14.196504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.196996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.197433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:14.198166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:14.198624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:14.199083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:14.217495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:03:14.223023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:03:14.282846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:03:14.284977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80c95afc-969f-4df8-9337-db765cae1bd3',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:03:14.755864 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb075bd7-0ab5-4598-8d66-83b074cc92a4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.129029 Oct 04 22:03:14.757203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3387/6667] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:03:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:03:14.766138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:14.766968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:14.767615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:14.771510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8634a5f-645b-47ae-890f-dc461653a258 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:14.772195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8634a5f-645b-47ae-890f-dc461653a258 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:14.905515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a8634a5f-645b-47ae-890f-dc461653a258 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:14.905515 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8634a5f-645b-47ae-890f-dc461653a258 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1093 microversion: 2.1 time: 0.134397 Oct 04 22:03:14.905515 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3281/6668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:14 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1093 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:15.922048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01393992-a8e8-4366-9d91-fc8404bd5f7d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:15.922687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01393992-a8e8-4366-9d91-fc8404bd5f7d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:15.976169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01393992-a8e8-4366-9d91-fc8404bd5f7d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:15.983180 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01393992-a8e8-4366-9d91-fc8404bd5f7d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1093 microversion: 2.1 time: 0.065906 Oct 04 22:03:15.989097 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3388/6669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:15 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:17.006375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:17.007018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:17.016013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.016516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.016971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.017694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:17.018164 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:17.018611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:17.083306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:17.091195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7db7582c-2ba2-4cd9-a797-03707a67ab31 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1191 microversion: 2.1 time: 0.089550 Oct 04 22:03:17.091774 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3282/6670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:17 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:18.118654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:18.119459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:18.130029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:18.130529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:18.131033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:18.131775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:18.132472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:18.133013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:18.298990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:18.309853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-252ac0fe-a412-4486-9acb-99950f81e7be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1276 microversion: 2.1 time: 0.195195 Oct 04 22:03:18.310360 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3389/6671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:18 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:19.076728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a66ce4-9322-454a-8d24-3a06719dada6", "tag": "5816e65a-369c-4c0e-919d-1768569de8ad"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:19.089796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.090582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.091227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.110193 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] Creating event network-changed:5816e65a-369c-4c0e-919d-1768569de8ad for instance a2a66ce4-9322-454a-8d24-3a06719dada6 on n-h1-851029-13 Oct 04 22:03:19.116064 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-400f23eb-34d0-4fee-a2fb-553d8babc45e req-dc4697e1-0045-4016-ab5c-63186dac8593 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045611 Oct 04 22:03:19.116702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3283/6672] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:19.333498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:19.334474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:19.342145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.342842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.343362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.344195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:19.344955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:19.345461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:19.496847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:19.505391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c63f7988-c66d-424e-8be2-d4899dfd046c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1276 microversion: 2.1 time: 0.175787 Oct 04 22:03:19.505981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3390/6673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:19 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:20.531755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:20.532492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:20.539854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.543400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.543400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.543400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:20.543400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:20.543400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:20.698260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:20.706373 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38f38aa4-200f-4a87-91ad-d7856893dae7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1276 microversion: 2.1 time: 0.180533 Oct 04 22:03:20.707004 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3284/6674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:20 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:21.729091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:21.729817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:21.736960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.737951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.737951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.738568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:21.739053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:21.739479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:21.879694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:21.888178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7211c067-24aa-46b4-aa88-24a7f89c326c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1276 microversion: 2.1 time: 0.163159 Oct 04 22:03:21.889006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3391/6675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:21 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:22.911507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:22.912133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:22.919716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:22.920218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:22.920669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:22.921423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:22.921896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:22.922340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:23.056911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:23.065128 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e979d8d-d28c-4e1f-b0ae-a334f8708b29 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1276 microversion: 2.1 time: 0.157333 Oct 04 22:03:23.065720 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3285/6676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:22 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:24.087865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:24.088478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:24.095349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:24.095828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:24.096267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.096958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:24.097416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:24.097848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:24.205779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:24.237161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:24.245975 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d040b56-045a-4b6f-91dd-a5b46bde31e6 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.162063 Oct 04 22:03:24.246551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3392/6677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:24 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:25.270239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:25.270895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:25.277861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.278383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.278867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.279573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:25.280041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:25.280476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:25.412915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:25.420763 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-198005d7-d20c-4a16-8785-b9c591e10a99 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.154511 Oct 04 22:03:25.421344 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3286/6678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:25 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:26.443929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:26.444551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:26.447989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:26.453107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.453607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.454047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.454797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:26.455253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:26.455681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:26.597909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:26.606262 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37462b7a-7996-4ceb-98f3-bb3e27c92036 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.166264 Oct 04 22:03:26.606890 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3393/6679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:26 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:27.629926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:27.630586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:27.633557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:03:27.638399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.638937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.639395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.646829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:27.646829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:27.646829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:27.776379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:27.785147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-834cf0bc-c247-4928-bff1-6b0f5f5f6d89 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.159094 Oct 04 22:03:27.785729 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3287/6680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:27 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:28.809751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:28.810369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:28.817545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.818107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.818554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.819290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:28.819752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:28.820185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:28.954986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:28.963139 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b9daf8b-112c-48bc-b522-783e253ca010 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.158541 Oct 04 22:03:28.963711 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3394/6681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:28 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:29.985975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:29.986610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:29.994205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.994782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.995659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:29.995943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:29.996408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:29.996846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:30.133232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:30.141389 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94312120-a9c8-443b-b3ce-1813b7e0d224 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.159381 Oct 04 22:03:30.141975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3288/6682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:29 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:31.164217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:31.165470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:31.172428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.172919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.173360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.174060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:31.174527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:31.174992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:31.308860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:31.316952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4838bc0d-46ac-43c9-8f31-02dba8c32d64 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.156629 Oct 04 22:03:31.317552 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3395/6683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:31 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:32.340377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:32.340954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:32.348013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.348541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.349000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.349729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:32.350213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:32.350676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:32.485271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:32.493776 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c34ffbe5-8a7d-4c7a-85c6-f9236935808e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.157954 Oct 04 22:03:32.494376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3289/6684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:32 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:33.497789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a66ce4-9322-454a-8d24-3a06719dada6", "name": "network-vif-plugged", "status": "completed", "tag": "5816e65a-369c-4c0e-919d-1768569de8ad"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:33.508442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.508925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.509362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.517066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:33.517724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:33.520879 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] Creating event network-vif-plugged:5816e65a-369c-4c0e-919d-1768569de8ad for instance a2a66ce4-9322-454a-8d24-3a06719dada6 on n-h1-851029-13 Oct 04 22:03:33.525267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.525829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.526288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.526501 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a321da08-29f5-4afd-83eb-48de3e2d50f5 req-59fdb304-e213-46ba-95ee-b82e78f2915a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032489 Oct 04 22:03:33.527044 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:33.527453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3396/6685] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:03:33.527655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:33.527974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:33.678598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:33.686894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2024d639-3420-4673-9245-a689f7dc7fc3 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.173904 Oct 04 22:03:33.687534 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3290/6686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:33 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:03:34.711205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:34.711826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:34.718389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.718921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.719360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.720067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:34.720528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:34.720959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:34.860435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:34.868308 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ebc9512-f4ae-45ff-a31e-44433aebce78 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1264 microversion: 2.1 time: 0.162375 Oct 04 22:03:34.869110 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3397/6687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:34 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:35.893632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:35.894167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:35.901367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.901870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.902327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:35.903089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:35.903568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:35.904012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.045841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.053969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8daabb26-a9ed-4b90-bf51-18674b2d9ae9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1450 microversion: 2.1 time: 0.165441 Oct 04 22:03:36.054561 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3291/6688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:35 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:36.078700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:03:36.081195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:03:36.086256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.086779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.087224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.087984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:36.088446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:36.088878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:36.230225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:03:36.238878 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2dc75a6-2cb2-4340-bab3-608b9942f298 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1450 microversion: 2.1 time: 0.164111 Oct 04 22:03:36.239485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3398/6689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:03:36 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:03:38.731704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a66ce4-9322-454a-8d24-3a06719dada6", "tag": "5816e65a-369c-4c0e-919d-1768569de8ad"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:03:38.743105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:03:38.743601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:03:38.744738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:03:38.756223 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] Creating event network-changed:5816e65a-369c-4c0e-919d-1768569de8ad for instance a2a66ce4-9322-454a-8d24-3a06719dada6 on n-h1-851029-13 Oct 04 22:03:38.762113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-11762e42-71b2-49ae-8cfb-85e8a2a04023 req-855a0bcc-9da6-4a16-8089-341c932bf4ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Oct 04 22:03:38.762905 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3292/6690] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:15.662980 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:06:15.663946 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:06:15.664525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:15.665393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=58 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:15.666256 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:06:15.666385 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:15.667533 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:06:15.667661 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:15.668769 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:06:15.668896 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:15.673644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:15.676487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:15.685817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:15.686305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:15.686782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:15.687482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:15.687945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:15.688375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:15.714742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:16.005365 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7175598-995c-408a-aefd-72ac374bc82a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 204 len: 0 microversion: 2.1 time: 0.344257 Oct 04 22:06:16.005901 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3399/6691] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:15 2022] DELETE /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:06:16.012427 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:06:16.013229 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:06:16.013884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:16.014646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=58 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:16.015576 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:06:16.015728 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:16.016807 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:06:16.016928 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:16.018125 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:06:16.018275 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 (ip 10.222.0.36) !!! Oct 04 22:06:16.024364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:16.025101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:16.035356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:16.035855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:16.036396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:16.037108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:16.037589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:16.038036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:16.172292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:16.180200 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d81d533-d803-453d-bda3-ecf52ff4ad7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1575 microversion: 2.1 time: 0.169793 Oct 04 22:06:16.185253 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3293/6692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:16 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:17.205338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:17.206042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:17.216403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:17.217090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:17.217549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:17.218252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:17.218738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:17.219204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:17.237559 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45314. Oct 04 22:06:17.238308 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45312. Oct 04 22:06:17.360941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:17.369466 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d39e64f7-677b-4804-b220-81835aa34011 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1575 microversion: 2.1 time: 0.169077 Oct 04 22:06:17.370070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3400/6693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:17 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:18.393568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:18.394325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:18.409178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.413524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.413524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:18.413524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.413524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.413524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:18.418254 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45318. Oct 04 22:06:18.420200 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45320. Oct 04 22:06:18.556861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:18.565854 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b998735d-1ca2-4fd1-b107-4101d5a0c612 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1575 microversion: 2.1 time: 0.176079 Oct 04 22:06:18.566058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3294/6694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:18 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:18.881127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a66ce4-9322-454a-8d24-3a06719dada6", "name": "network-vif-deleted", "tag": "5816e65a-369c-4c0e-919d-1768569de8ad"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:18.894630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:18.895172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:18.895599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:18.912116 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] Creating event network-vif-deleted:5816e65a-369c-4c0e-919d-1768569de8ad for instance a2a66ce4-9322-454a-8d24-3a06719dada6 on n-h1-851029-13 Oct 04 22:06:18.919450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f12456e0-10cd-4479-b8df-572e5152ebb2 req-144b6afd-7713-4b5e-9607-48411b041ee9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042075 Oct 04 22:06:18.920323 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3401/6695] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:19.588995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:19.589637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:19.597132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.597897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.598357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.599407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:19.600039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:19.600595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:19.671392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:19.680026 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae9d5bec-a2bf-4e8e-bafd-37ad178b8bf4 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1224 microversion: 2.1 time: 0.094976 Oct 04 22:06:19.681199 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3295/6696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:19 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:20.706886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:20.707763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:20.714348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.714875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.715322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.716432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:20.716897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:20.717322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:20.796576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:20.805243 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77aeaba5-add4-4923-a661-1011fe4cd0ec tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1224 microversion: 2.1 time: 0.103890 Oct 04 22:06:20.805848 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3402/6697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:20 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:21.830027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:21.830574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:21.837659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:21.838165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:21.838622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:21.839377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:21.839852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:21.840301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:21.906353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:21.915275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b607275f-c6d7-4938-bde1-2c66f65e351a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1224 microversion: 2.1 time: 0.089267 Oct 04 22:06:21.915874 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3296/6698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:21 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:22.938805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:22.939420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:22.946413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.946928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.947501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:22.948088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:22.948543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:22.948969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:23.016562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:23.024761 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8e1169b-8b7d-4b0f-a5fb-06f2e2a76133 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1224 microversion: 2.1 time: 0.090537 Oct 04 22:06:23.025345 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3403/6699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:22 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:24.049255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:24.049890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:24.057393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.057900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.058360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.059682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.060244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.060690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.093185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:24.093684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:24.094168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:24.094631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lazy-loading 'fault' on Instance uuid a2a66ce4-9322-454a-8d24-3a06719dada6 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:24.138611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:24.147816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8e4e833-9155-4e4f-87a0-c3a8af4641b7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 200 len: 1183 microversion: 2.1 time: 0.102625 Oct 04 22:06:24.148923 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3297/6700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:24 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 1183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:25.173606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:25.174762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:25.184704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.185534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.186062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:25.186940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.187417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.187856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:25.204039 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 HTTP/1.1 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a2a66ce4-9322-454a-8d24-3a06719dada6'} Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:25.205792 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fca8831d-52c6-42ac-bb02-f01655182c3a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 404 len: 111 microversion: 2.1 time: 0.039193 Oct 04 22:06:25.214591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3404/6701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:25 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:25.292764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-639088195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-617644318", "security_groups": [{"name": "tempest-secgroup-smoke-306836538"}], "block_device_mapping_v2": [{"uuid": "80c95afc-969f-4df8-9337-db765cae1bd3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:25.413807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:06:25.884195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:25.884628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:25.885115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:25.885540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:25.885966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:25.896014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.899389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.899389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:25.899389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:25.899389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:25.899389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:25.916287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:25.922709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:25.984953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:06:25.987227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80c95afc-969f-4df8-9337-db765cae1bd3',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:06:26.462937 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13f56933-b083-4a3d-9387-098439b1f67d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.174184 Oct 04 22:06:26.463670 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3298/6702] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:06:26.475524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2841216b-fd50-4214-bfc9-747a3824e0be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:26.476182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2841216b-fd50-4214-bfc9-747a3824e0be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:26.532162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2841216b-fd50-4214-bfc9-747a3824e0be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:26.540468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2841216b-fd50-4214-bfc9-747a3824e0be tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1093 microversion: 2.1 time: 0.068823 Oct 04 22:06:26.541354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3405/6703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:26 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:27.572959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:27.574494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:27.583753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.584272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.584730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.585462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:27.585938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:27.586382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:27.649137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:27.658254 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abc7df7a-cf97-4779-846d-2bd990f6831b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1143 microversion: 2.1 time: 0.093963 Oct 04 22:06:27.670826 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3299/6704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:27 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:28.682888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:28.683546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:28.691350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.691837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.692278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.692984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:28.693447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:28.693917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:28.792152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:28.801603 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ac9b1c5-e82d-4652-8584-50ab83d6a1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1199 microversion: 2.1 time: 0.122804 Oct 04 22:06:28.804380 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3406/6705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:28 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1199 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:29.826090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:29.826755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:29.833948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.834454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.834937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:29.835663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:29.836139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:29.836580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:30.072810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:30.081545 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7cd7fb58-50ee-4628-8442-76625d2e4e4a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1276 microversion: 2.1 time: 0.259826 Oct 04 22:06:30.082219 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3300/6706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:29 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:30.623214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c92c5c-7b61-4a89-9fa2-9241f24b96cb", "tag": "4dee9a51-9884-48a6-a023-0e36a5926cec"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:30.633777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:30.634363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:30.634906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:30.646527 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] Creating event network-changed:4dee9a51-9884-48a6-a023-0e36a5926cec for instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb on n-h2-851029-13 Oct 04 22:06:30.651716 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1a71e30a-5558-49f9-b68f-f4a70d7f8df8 req-4e7020ef-c78d-42b0-a258-e5a2a8b2e3e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098947 Oct 04 22:06:30.652401 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3407/6707] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:31.105231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:31.106406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:31.114433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:31.114980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:31.115457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:31.116187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:31.116664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:31.117112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:31.356615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:31.365205 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab75f13d-0e58-4dd8-ab8c-a8fbee4c9c85 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1276 microversion: 2.1 time: 0.263834 Oct 04 22:06:31.365975 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3301/6708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:31 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:32.391371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:32.392232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:32.399223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:32.399705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:32.400141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:32.400861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:32.401316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:32.401770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:32.558947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:32.567596 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6ae7764f-9dfb-4a59-9270-4c286f4b76eb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1276 microversion: 2.1 time: 0.182134 Oct 04 22:06:32.568203 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3408/6709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:32 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:33.591223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:33.591974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:33.599093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.599603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.600068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.600792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:33.601409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:33.601865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:33.743787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:33.752372 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df6f4b0a-73b9-4c18-8e43-d8cd9d4a7cfb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1276 microversion: 2.1 time: 0.165288 Oct 04 22:06:33.752971 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3302/6710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:33 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:34.775975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:34.782856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:34.784222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.784712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.785154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.785856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:34.786313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:34.786781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:34.921930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:34.929930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de4af10c-3179-4955-8d73-9c15af863da1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1276 microversion: 2.1 time: 0.157955 Oct 04 22:06:34.930534 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3409/6711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:34 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:35.953614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:35.954229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:35.956869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:35.957553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:35.962594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:35.963120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:35.963573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:35.964276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:35.964759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:35.965704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:36.103595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:36.111334 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb09d130-9730-4e44-847f-02d570c4b3e1 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.161774 Oct 04 22:06:36.111911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3303/6712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:35 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:37.135405 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:37.136001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:37.138839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:37.143798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.144277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.144708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.145400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:37.145902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:37.146327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:37.285742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:37.292017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8089742-a12d-4550-8893-e3c00afa1a71 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.160642 Oct 04 22:06:37.292617 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3410/6713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:37 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:38.315979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:38.316839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:38.323845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.324351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.324807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.325551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:38.326029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:38.326478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:38.456190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:38.464096 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe67e6f6-9167-420b-b7a4-8527942b503c tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.152055 Oct 04 22:06:38.464669 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3304/6714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:38 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:39.487045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:39.487641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:39.494445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:39.494957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:39.495399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:39.496601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:39.497063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:39.497495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:39.632210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:39.640645 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c6304ae2-b986-45ff-8ecd-961bdfcd8ff9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.157604 Oct 04 22:06:39.641221 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3411/6715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:39 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:40.663181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:40.663805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:40.670834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.671335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.671786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.672498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.673001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.673443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.805651 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:40.813621 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04973c5d-0d77-4a77-9b17-3dd54798b365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.154447 Oct 04 22:06:40.814184 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3305/6716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:40 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:41.836813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:41.837363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:41.844310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:41.844795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:41.845232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:41.845934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:41.846393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:41.846929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:41.981611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:41.989484 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b19ffb0-b68e-4539-b3de-a42f93bed952 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.156669 Oct 04 22:06:41.990135 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3412/6717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:41 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:43.013346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:43.014007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:43.021558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:43.022211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:43.022682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:43.023426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:43.023902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:43.024345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:43.158680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:43.166649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-031e7e51-879f-41f3-bccb-fe431238a67a tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.158209 Oct 04 22:06:43.167256 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3306/6718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:43 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:44.189451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:44.190067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:44.196949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.201325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.201325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.201325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.201325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.201325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.331653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:44.339341 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e867a78d-2af6-4469-b560-49d45823e1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.153869 Oct 04 22:06:44.340472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3413/6719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:44 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:44.714324 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c92c5c-7b61-4a89-9fa2-9241f24b96cb", "name": "network-vif-plugged", "status": "completed", "tag": "4dee9a51-9884-48a6-a023-0e36a5926cec"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:44.723916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:44.724407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:44.724894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:44.735820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] Creating event network-vif-plugged:4dee9a51-9884-48a6-a023-0e36a5926cec for instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb on n-h2-851029-13 Oct 04 22:06:44.741727 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-827b5500-f849-4301-b5d1-bdbaf6d97a26 req-e700bc4f-a894-462a-b0e8-95431b1fcb91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083881 Oct 04 22:06:44.742375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3307/6720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:45.362383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:45.363011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:45.370074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.370556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.371683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.372409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.372865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.373290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.509480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:45.517519 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e899d246-055a-4c0a-b7c1-dd9ee8514d05 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1264 microversion: 2.1 time: 0.158980 Oct 04 22:06:45.518099 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3414/6721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:45 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:46.542177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:46.543479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:46.545794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.550869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.551371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.551826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.552543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.553021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.553478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.556287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=85 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.693735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:46.701728 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29b4c568-9322-4f7d-98f5-b8bfe879fecd tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1450 microversion: 2.1 time: 0.164922 Oct 04 22:06:46.702309 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3308/6722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:46 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:46.723473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:46.724088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:46.726757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.731929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.732410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.732845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.733526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.733979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.734404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.736967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:46.870573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:46.879280 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79c6549b-434c-43c6-844a-48fe462b39a7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1450 microversion: 2.1 time: 0.159689 Oct 04 22:06:46.879864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3415/6723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:46 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:49.233450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c92c5c-7b61-4a89-9fa2-9241f24b96cb", "tag": "4dee9a51-9884-48a6-a023-0e36a5926cec"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:49.243031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:49.243532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:49.243981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:49.259057 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] Creating event network-changed:4dee9a51-9884-48a6-a023-0e36a5926cec for instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb on n-h2-851029-13 Oct 04 22:06:49.264478 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-48ca8e63-f240-4bd6-bcbd-8d9b9014ba13 req-3580bd97-e4f0-44c8-8a85-69ccd2d1e9fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035598 Oct 04 22:06:49.265297 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3309/6724] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:16.222813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:16.223616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:16.224612 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:16.224764 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:09:16.226888 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:16.227027 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:09:16.228864 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:16.229026 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:09:16.234265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1833212236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-617644318", "security_groups": [{"name": "tempest-secgroup-smoke-306836538"}], "block_device_mapping_v2": [{"uuid": "bf8fbd46-5bca-40f3-91ce-02ca57a70438", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2cf2faff-87df-4ba2-a081-bed2ba7ed964"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:16.490145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] validate_networks() for [('2cf2faff-87df-4ba2-a081-bed2ba7ed964', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:16.983594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:16.984014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:16.984492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:16.984904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:16.985321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:16.995094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.997502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.997502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.997502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:16.997502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:16.997882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.015987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:17.021357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Getting quotas for user af3ebde75ac944d5a9cd020cf8de267d and project e03a60c4e4634280acc936e8d202018e. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:17.080846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:17.083160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf8fbd46-5bca-40f3-91ce-02ca57a70438',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:17.224639 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:09:17.512230 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-157a831d-e9ff-4209-9403-4bb74e238100 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291937 Oct 04 22:09:17.512919 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3416/6725] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:17.523499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:17.524340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:17.525465 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:17.525602 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 (ip 10.222.0.36) !!! Oct 04 22:09:17.526734 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:17.526844 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 (ip 10.222.0.36) !!! Oct 04 22:09:17.527998 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:09:17.528145 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 (ip 10.222.0.36) !!! Oct 04 22:09:17.533892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88d69c52-e399-49f5-9aa6-8cc7079231e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.535169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88d69c52-e399-49f5-9aa6-8cc7079231e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.649404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-88d69c52-e399-49f5-9aa6-8cc7079231e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:17.656439 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88d69c52-e399-49f5-9aa6-8cc7079231e5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1094 microversion: 2.1 time: 0.135871 Oct 04 22:09:17.657028 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3310/6726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1094 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:18.682419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:18.683329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:18.690967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.691449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.691886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.692580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:18.693034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:18.693456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.699780 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45578. Oct 04 22:09:18.758755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:18.766690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5c8f068c-ee61-4664-9c72-ad63a6f1ffad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1144 microversion: 2.1 time: 0.090842 Oct 04 22:09:18.768981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3417/6727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:18 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:19.789730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:19.790354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:19.797634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.798367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.799019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.800036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.805155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.805155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.875925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.885859 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a13098f3-c5e2-46ef-9d31-2b675110ff2d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1210 microversion: 2.1 time: 0.100105 Oct 04 22:09:19.902516 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3311/6728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:19 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:20.910271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:20.911685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:20.919627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.920475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.921134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.922098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.922826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.923464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.075306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:21.085378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96d4ddca-554d-452a-9995-6f2de4c1bd23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1277 microversion: 2.1 time: 0.179729 Oct 04 22:09:21.086204 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3418/6729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:20 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:21.542444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606ec3c3-2e6e-4dba-b551-565a9b469890", "tag": "9bb89b0e-a53d-4038-b776-4edbeba64579"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:21.553441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:21.553647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:21.558981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:21.587460 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] Creating event network-changed:9bb89b0e-a53d-4038-b776-4edbeba64579 for instance 606ec3c3-2e6e-4dba-b551-565a9b469890 on n-h1-851029-13 Oct 04 22:09:21.594309 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1bd50037-e09e-4192-af6a-1c76891ebe65 req-0c649f87-6427-42b7-9ce3-0229889b915a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118314 Oct 04 22:09:21.600443 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3312/6730] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:22.109965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:22.110606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:22.118062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.118913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.119517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.120415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.121086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.121519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.270940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.279559 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6032160-7654-4e38-ba0b-91471a14ab25 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1277 microversion: 2.1 time: 0.173862 Oct 04 22:09:22.280251 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3419/6731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:22 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.303615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:23.304230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:23.311025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.311530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.311983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.312701 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.313177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.313619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.455380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.464211 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e9780e1-0edf-471c-ad2b-c568443d9951 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1277 microversion: 2.1 time: 0.165843 Oct 04 22:09:23.464867 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3313/6732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:24.488047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.488764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.496310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.496895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.497344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.498050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.498509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.498961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.636476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.644392 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96b354a8-1ba0-4e28-babf-7774c9acc3f7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1277 microversion: 2.1 time: 0.160832 Oct 04 22:09:24.644981 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3420/6733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:24 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:25.668296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.668927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.676473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.678698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.678698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.678698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.678698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.679144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.818778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:25.826630 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4cff1c2-a582-4270-81c9-315822a89da7 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1277 microversion: 2.1 time: 0.162195 Oct 04 22:09:25.827169 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3314/6734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:26.849496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:26.850044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:26.857128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.859246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.859246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.859246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.859710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.859816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.995174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:27.004095 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37ad5010-b4a4-49f8-b999-22ef9e6596c0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.158650 Oct 04 22:09:27.004753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3421/6735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:26 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.027865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.028496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.031405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:28.036506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.037057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.037539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.038254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.038746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.039186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.177349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.185436 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bee0d566-800c-4453-864a-e7bb70f9416b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.161514 Oct 04 22:09:28.186018 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3315/6736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:29.207864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:29.208473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:29.210625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:29.211304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:29.216972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.224877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.224877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.224877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:29.224877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:29.224877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:29.356631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:29.365225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d03c5b46-e76a-46d3-b118-98b19214078e tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.161361 Oct 04 22:09:29.365802 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3422/6737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:29 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:30.388448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:30.389055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:30.395992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.396487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.396935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.397646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:30.398119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:30.398561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:30.534480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:30.543132 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-320f7e93-c500-4417-b30b-cd9ba127f1af tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.158501 Oct 04 22:09:30.543721 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3316/6738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:30 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:31.567274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:31.567887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:31.575110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.575601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.576035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.576759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.577211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.577635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.714455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:31.722811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66523304-b08f-4f18-8bd7-d7b164edda27 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.160031 Oct 04 22:09:31.723475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3423/6739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:31 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:32.746279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:32.747071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:32.754759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.755271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.755721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.756442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:32.756946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:32.757390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:32.897392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:32.905402 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0784adff-1d9b-4ee7-b9a2-fa80d5e05c23 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.163064 Oct 04 22:09:32.905990 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3317/6740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:32 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:33.929204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:33.929801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:33.936581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.937066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.937504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:33.938199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:33.938715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:33.939108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:34.075105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:34.083155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f9faa93-cc91-490a-8837-07b4b8da7026 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.158276 Oct 04 22:09:34.083731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3424/6741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:33 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:35.110804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:35.111425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:35.118905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.119399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.119849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.120558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.121024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.121515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.256436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:35.265579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f5313f2-43a4-4f90-981a-ce7b2ea82994 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.158693 Oct 04 22:09:35.266175 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3318/6742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:35 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:35.518496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606ec3c3-2e6e-4dba-b551-565a9b469890", "name": "network-vif-plugged", "status": "completed", "tag": "9bb89b0e-a53d-4038-b776-4edbeba64579"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:35.529616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:35.530365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:35.530837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:35.542508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] Creating event network-vif-plugged:9bb89b0e-a53d-4038-b776-4edbeba64579 for instance 606ec3c3-2e6e-4dba-b551-565a9b469890 on n-h1-851029-13 Oct 04 22:09:35.549360 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-72f24bc1-fc00-447f-abb5-66916842500d req-65029b85-4a65-4c3e-b52d-f365b2ff5618 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Oct 04 22:09:35.550628 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3425/6743] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:36.289348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:36.290026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:36.297194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.297698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.298152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.298982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:36.299457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:36.299903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:36.434726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:36.442989 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-94163081-284b-4975-91df-d2ccf1d2ab5d tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1265 microversion: 2.1 time: 0.157413 Oct 04 22:09:36.443504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3319/6744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:36 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:37.467035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:37.467752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:37.474994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.475492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.475937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.476648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.477112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.477549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.615385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.623311 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0d89e4e-4f55-43a0-aae8-30fc9338c365 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1452 microversion: 2.1 time: 0.160815 Oct 04 22:09:37.623890 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3426/6745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:37 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:37.646485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:37.647172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:37.654006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.654510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.654994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.655786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:37.656262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:37.656734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:37.788355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:37.796221 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-05f2295c-94cb-474d-bdd4-753aa8bab017 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1452 microversion: 2.1 time: 0.154285 Oct 04 22:09:37.796802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3320/6746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:37 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:40.450155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606ec3c3-2e6e-4dba-b551-565a9b469890", "tag": "9bb89b0e-a53d-4038-b776-4edbeba64579"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:40.461404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:40.461889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:40.462328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:40.474794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] Creating event network-changed:9bb89b0e-a53d-4038-b776-4edbeba64579 for instance 606ec3c3-2e6e-4dba-b551-565a9b469890 on n-h1-851029-13 Oct 04 22:09:40.480009 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fd924268-4f06-4a0f-bba3-557f89d97b6c req-c3336176-ed5a-4fa7-8c34-cfaea245a20b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 Oct 04 22:09:40.480646 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3427/6747] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:11.186338 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:12:11.187588 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:12:11.188461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=24 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:11.189442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=56 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:11.190292 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:12:11.193072 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 22:12:11.193904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:11.194856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:11.194986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=60 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:12:11.195390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:11.207665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.207665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.208020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.208969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.209476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.209930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.238270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:11.269127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606ec3c3-2e6e-4dba-b551-565a9b469890", "tag": "9bb89b0e-a53d-4038-b776-4edbeba64579"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:11.284516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.285037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.285468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.296235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] Creating event network-changed:9bb89b0e-a53d-4038-b776-4edbeba64579 for instance 606ec3c3-2e6e-4dba-b551-565a9b469890 on n-h1-851029-13 Oct 04 22:12:11.301347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d2e9ef28-58dc-4a6c-8cbd-64e7242931f3 req-9bac5c47-9017-446d-aacf-df4910867f3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114562 Oct 04 22:12:11.301968 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3428/6748] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:11.610171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5fa32d45-785d-4ba6-80d4-bc484258dd14 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 204 len: 0 microversion: 2.1 time: 0.425740 Oct 04 22:12:11.610905 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3321/6749] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:11 2022] DELETE /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:11.620584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:11.621661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:11.628604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.629394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.630033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.630988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:11.631443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:11.632157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:11.788881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:11.797574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf2042b7-0680-41c2-8938-77935f7cad50 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1576 microversion: 2.1 time: 0.181859 Oct 04 22:12:11.798701 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3429/6750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:11 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:12.823844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:12.824559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:12.833288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.833788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.834236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.834999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:12.835467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:12.835900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:12.863307 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45688. Oct 04 22:12:12.868949 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45690. Oct 04 22:12:12.999646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:13.015513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00b1fe7a-75e6-4ebd-938f-ee3ea6c0eed2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1576 microversion: 2.1 time: 0.195829 Oct 04 22:12:13.016351 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3322/6751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:12 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:13.953444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606ec3c3-2e6e-4dba-b551-565a9b469890", "name": "network-vif-deleted", "tag": "9bb89b0e-a53d-4038-b776-4edbeba64579"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:13.968116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:13.968591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:13.969035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:13.983639 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45694. Oct 04 22:12:13.985909 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] Creating event network-vif-deleted:9bb89b0e-a53d-4038-b776-4edbeba64579 for instance 606ec3c3-2e6e-4dba-b551-565a9b469890 on n-h1-851029-13 Oct 04 22:12:13.991727 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e3dbb1b6-cd1c-414b-adca-a619589ccab4 req-d1ea6700-3900-4e8e-b2f3-bd683c358a41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042094 Oct 04 22:12:13.993427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3430/6752] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:14.040838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:14.041943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:14.052341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.057378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.057378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.057378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:14.057378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:14.057378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:14.126216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:14.135757 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72513067-e9a2-42da-843f-70591e342ff8 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1391 microversion: 2.1 time: 0.098277 Oct 04 22:12:14.135757 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3323/6753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:14 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1391 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:15.154902 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45696. Oct 04 22:12:15.159735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:15.160474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:15.167113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.167602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.168044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.168749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:15.169207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:15.169633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:15.233258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:15.241210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68ac587b-d926-407f-9fe6-2cd7153c9b57 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1225 microversion: 2.1 time: 0.087403 Oct 04 22:12:15.241853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3431/6754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:15 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:16.264976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:16.265995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:16.273576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:16.274596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:16.275074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:16.275795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:16.276405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:16.276832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:16.346415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:16.355014 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0d9a29d-08df-4d9a-857d-f8c90bbc7aeb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1225 microversion: 2.1 time: 0.094293 Oct 04 22:12:16.355773 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3324/6755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:16 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:17.382139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:17.383114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:17.394511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.395305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.395996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:17.397156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:17.397929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:17.399178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:17.480064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:17.488817 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7de4d9a3-bab7-409d-8d93-f1318fcdc6bb tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1225 microversion: 2.1 time: 0.113653 Oct 04 22:12:17.491897 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3432/6756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:17 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:12:18.512175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:18.512801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:18.519934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.520435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.520878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.521590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.522056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.522490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.557631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:18.558546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:18.558747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:18.559116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lazy-loading 'fault' on Instance uuid 606ec3c3-2e6e-4dba-b551-565a9b469890 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:12:18.602889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:18.610927 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02659498-cd4a-4ca4-b476-85c335abb0b9 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 200 len: 1230 microversion: 2.1 time: 0.102635 Oct 04 22:12:18.611514 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3325/6757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:18 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:19.643955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:19.644589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 606ec3c3-2e6e-4dba-b551-565a9b469890] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:19.651545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:19.652029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:19.652464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:19.653149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:19.653601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:19.654027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:19.667846 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 HTTP/1.1 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '606ec3c3-2e6e-4dba-b551-565a9b469890'} Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:19.669519 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 606ec3c3-2e6e-4dba-b551-565a9b469890 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-43cbb194-0649-46e8-adc2-2d12996125b2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890" status: 404 len: 111 microversion: 2.1 time: 0.030968 Oct 04 22:12:19.674516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3433/6758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:19 2022] GET /compute/v2.1/servers/606ec3c3-2e6e-4dba-b551-565a9b469890 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:26.238357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:26.239043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:26.240179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c92c5c-7b61-4a89-9fa2-9241f24b96cb", "tag": "4dee9a51-9884-48a6-a023-0e36a5926cec"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:26.247711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.248368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.248983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.249789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.250305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.250958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.251679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.252347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.252779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.265210 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] Creating event network-changed:4dee9a51-9884-48a6-a023-0e36a5926cec for instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb on n-h2-851029-13 Oct 04 22:12:26.270686 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-066b4b0a-65ac-44d2-a48f-783a242d9df2 req-fe893b08-3eee-463f-ac61-18a4a7fe1e9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Oct 04 22:12:26.272510 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3434/6759] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:12:26.280029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:12:26.599595 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d35817e-c349-4d35-8b27-3d292ab853e0 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 204 len: 0 microversion: 2.1 time: 0.365636 Oct 04 22:12:26.600145 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3326/6760] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:26 2022] DELETE /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:12:26.609463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:26.619683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:26.824441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:26.832451 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-078bcab9-9758-4d8b-bcc6-1de94042ddbf tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1574 microversion: 2.1 time: 0.227310 Oct 04 22:12:26.833076 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3435/6761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:26 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:27.739928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c92c5c-7b61-4a89-9fa2-9241f24b96cb", "name": "network-vif-deleted", "tag": "4dee9a51-9884-48a6-a023-0e36a5926cec"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:12:27.751867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.752357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.752802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.763833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] Creating event network-vif-deleted:4dee9a51-9884-48a6-a023-0e36a5926cec for instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb on n-h2-851029-13 Oct 04 22:12:27.770198 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d890f059-4c4b-4897-9c74-549b6b206980 req-e2441456-3394-4d63-a45b-d87342cd3464 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Oct 04 22:12:27.770845 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3327/6762] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:12:27.857788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:27.858493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:27.865403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.865888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.866329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.867705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:27.868166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:27.868686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:27.934655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:27.942493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d3bef2bb-8af9-4eac-b12b-edc94e9cdae2 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1389 microversion: 2.1 time: 0.088645 Oct 04 22:12:27.943162 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3436/6763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:27 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:28.967192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:28.967992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:28.974509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.975046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.975499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:28.976222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:28.976690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:28.977133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:29.046119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:29.054406 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0f35ffa-df8e-4fe9-8df6-dd8a33a9e54b tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1224 microversion: 2.1 time: 0.092399 Oct 04 22:12:29.055037 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3328/6764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:28 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:30.078985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:30.079613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:30.086957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:30.087451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:30.087891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:30.088607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:30.089064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:30.089492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:30.160024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:30.168759 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b9c931a-6325-4fe1-b168-8299766f4605 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1224 microversion: 2.1 time: 0.093909 Oct 04 22:12:30.169390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3437/6765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:30 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:31.193300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:31.193882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:31.201767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.202273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.202762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.203497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:31.203975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:31.204420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:31.271069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:31.280050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d967ee23-1d75-4fb9-9b94-60c8a23d1f7f tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1224 microversion: 2.1 time: 0.090769 Oct 04 22:12:31.280992 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3329/6766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:31 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:32.302990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:32.303585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:32.312318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:32.312809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:32.313252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:32.314156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:32.314620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:32.315070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:32.382100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af3ebde75ac944d5a9cd020cf8de267d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03a60c4e4634280acc936e8d202018e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:12:32.390456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-679625f5-8d57-4926-aa62-5c52ade971aa tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 200 len: 1224 microversion: 2.1 time: 0.091537 Oct 04 22:12:32.391083 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3438/6767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:32 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:12:33.413218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:33.414446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: 03c92c5c-7b61-4a89-9fa2-9241f24b96cb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:33.421924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.422418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.422910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.423862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:33.424292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:33.424884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:33.440225 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb HTTP/1.1 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '03c92c5c-7b61-4a89-9fa2-9241f24b96cb'} Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:33.442573 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance 03c92c5c-7b61-4a89-9fa2-9241f24b96cb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79dafb8c-6f0e-442c-a0d5-06404aef66b5 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb" status: 404 len: 111 microversion: 2.1 time: 0.034293 Oct 04 22:12:33.449870 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3330/6768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:33 2022] GET /compute/v2.1/servers/03c92c5c-7b61-4a89-9fa2-9241f24b96cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:34.003355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:34.003975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:34.011554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.012053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.012497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.013208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.013668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.014101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.029225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 HTTP/1.1 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'a2a66ce4-9322-454a-8d24-3a06719dada6'} Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:34.030991 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0cd21ce-dbdf-4325-a03a-f03b11a5e8ad tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 404 len: 111 microversion: 2.1 time: 0.033122 Oct 04 22:12:34.035390 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3439/6769] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:12:33 2022] DELETE /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:34.041418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:34.042111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [instance: a2a66ce4-9322-454a-8d24-3a06719dada6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:12:34.048366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.048865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.049315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.050032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:12:34.050500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:12:34.051075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:12:34.066536 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] HTTP exception thrown: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Request method failure captured: Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 HTTP/1.1 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPKxgD_T2FxGhJ1NbpteFwCp5ioEuIRwDR3qmx-dp_fmhatMWPHkHOrnr7Ys8282hl1GmEDJHo_osRiPj7shRsc9ipvDb6X0qgKr1_3Uf6eleZVC2YdIsogPzxu2WHX8yapMlvM4RcR5EEfVM2_TiJzTF7DIbATFBLOn9gO1ZtAPuQFU Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e03a60c4e4634280acc936e8d202018e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e03a60c4e4634280acc936e8d202018e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: e03a60c4e4634280acc936e8d202018e Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestVolumeBootPattern-300490010 Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: af3ebde75ac944d5a9cd020cf8de267d Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestVolumeBootPattern-300490010-project Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'a2a66ce4-9322-454a-8d24-3a06719dada6'} Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:12:34.068158 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Returning 404 to user: Instance a2a66ce4-9322-454a-8d24-3a06719dada6 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6feab62-be1c-4e0f-8382-d5f338762d82 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6" status: 404 len: 111 microversion: 2.1 time: 0.032205 Oct 04 22:12:34.073856 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3331/6770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:12:34 2022] GET /compute/v2.1/servers/a2a66ce4-9322-454a-8d24-3a06719dada6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:12:37.736002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad84d3b2-b438-4379-bd90-c1f2396ae329 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] Calling method '.version_select at 0x7f54f4d9daf0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:12:37.742842 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ad84d3b2-b438-4379-bd90-c1f2396ae329 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:12:38.751872 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-ad84d3b2-b438-4379-bd90-c1f2396ae329 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45790. Oct 04 22:12:38.884564 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad84d3b2-b438-4379-bd90-c1f2396ae329 tempest-TestVolumeBootPattern-300490010 tempest-TestVolumeBootPattern-300490010-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-617644318" status: 202 len: 0 microversion: 2.1 time: 1.153085 Oct 04 22:12:38.885175 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3440/6771] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 4 22:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-617644318 => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:03.378059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:03.378858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:03.521062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2145848801", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:03.584017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] validate_networks() for None {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:03.894478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:03.895019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:03.895505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:03.895955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:03.896392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:03.906242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:03.906785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:03.907238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:03.908286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:03.908758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:03.909197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:03.927452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Getting quotas for project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:03.933551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Getting quotas for user bf4dd96cd17b4b63bec735c80e8ba463 and project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:03.947530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:03.949999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:04.088851 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [c4350d11-eb33-433e-bfd3-6b7781101508] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:13:05.097987 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [c4350d11-eb33-433e-bfd3-6b7781101508] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45906. Oct 04 22:13:05.102791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-630224cc-399f-46a8-b110-3ea373c52d92 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729792 Oct 04 22:13:05.103461 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3332/6772] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:13:05.122840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=52 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.124507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:05.133175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3cdc1bb6-3617-465e-aa0c-80e822b93b03 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:05.133845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3cdc1bb6-3617-465e-aa0c-80e822b93b03 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:05.191645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3cdc1bb6-3617-465e-aa0c-80e822b93b03 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:05.199553 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3cdc1bb6-3617-465e-aa0c-80e822b93b03 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1222 microversion: 2.1 time: 0.080325 Oct 04 22:13:05.200164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3441/6773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:05 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:06.223910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5e023de-6a2f-469c-9c9f-34341ea3bc88 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:06.224545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5e023de-6a2f-469c-9c9f-34341ea3bc88 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:06.279855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5e023de-6a2f-469c-9c9f-34341ea3bc88 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:06.287902 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5e023de-6a2f-469c-9c9f-34341ea3bc88 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1222 microversion: 2.1 time: 0.068323 Oct 04 22:13:06.288499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3333/6774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:06 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:07.313567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:07.314322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:07.323759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:07.324993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:07.325851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:07.326561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:07.327042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:07.327471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:07.392925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:07.400982 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16c69e34-046c-4740-8c71-aeb215818d86 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1274 microversion: 2.1 time: 0.091481 Oct 04 22:13:07.401562 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3442/6775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:07 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:13:08.430318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:08.430985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:08.438217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:08.445820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:08.445820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:08.445820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:08.445820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:08.445820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:08.505208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:08.513722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e977291-0a24-42be-8f94-f60fe41db6f1 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1280 microversion: 2.1 time: 0.087891 Oct 04 22:13:08.514290 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3334/6776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:08 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:09.536971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:09.537629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:09.544688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:09.545170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:09.545609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:09.546305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:09.546803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:09.547234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:09.780886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:09.789285 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-116fb711-6cd9-455d-a81b-04e9d47aaa5c tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.256512 Oct 04 22:13:09.789879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3443/6777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:09 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:10.051111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5234707-b4fa-43fa-beb3-6ea495eebd2b", "tag": "3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:10.063320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:10.063856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:10.064343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:10.076155 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] Creating event network-changed:3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a for instance c5234707-b4fa-43fa-beb3-6ea495eebd2b on n-h2-851029-13 Oct 04 22:13:10.081116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d9e4ca84-43fa-41e4-bff3-6afad1ea3b15 req-e4f0eb99-54ac-4005-995f-ab8ecba18246 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033886 Oct 04 22:13:10.081742 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3335/6778] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:10.814852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:10.815480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:10.822814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:10.823309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:10.823756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:10.824465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:10.824928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:10.825365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:10.962625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:10.970383 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a3aa593-c599-4310-b54d-a61f4e010099 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.160815 Oct 04 22:13:10.971004 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3444/6779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:10 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:11.993815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:11.994465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:12.002249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:12.002783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:12.003231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:12.003937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:12.004405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:12.004847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:12.135599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:12.143547 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99238aab-6d28-4802-967e-77e2eb58cafc tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.154538 Oct 04 22:13:12.144149 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3336/6780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:11 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:13.166603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:13.167185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:13.174062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:13.174559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:13.175011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:13.175707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:13.176162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:13.176647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:13.309358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:13.317923 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b6fd432-b638-411e-a77f-07f25b448d84 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.155311 Oct 04 22:13:13.319029 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3445/6781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:13 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:14.341581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:14.342215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:14.344458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:14.349514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:14.350019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:14.350478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:14.351241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:14.351719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:14.352168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:14.506933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:14.515470 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22e87aa8-0d60-4623-bfb5-6d82394a1de3 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.178170 Oct 04 22:13:14.516043 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3337/6782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:14 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:15.539628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:15.540228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:15.542005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:15.546998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.547483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.547923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.548649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:15.549105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:15.549531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:15.693879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:15.702086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4ef57ba-9556-4445-8e5b-96cad7562f57 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.166927 Oct 04 22:13:15.702749 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3446/6783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:15 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:16.386703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:16.459576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5234707-b4fa-43fa-beb3-6ea495eebd2b", "name": "network-vif-plugged", "status": "completed", "tag": "3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:16.469388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:16.469995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:16.470561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.483121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] Creating event network-vif-plugged:3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a for instance c5234707-b4fa-43fa-beb3-6ea495eebd2b on n-h2-851029-13 Oct 04 22:13:16.488498 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f4bac0f4-ca26-479b-8219-90711e0e47f9 req-e9c8ad6e-d5ba-4c72-813d-15547283d9bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107651 Oct 04 22:13:16.489115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3338/6784] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:16.725619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:16.726338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:16.733971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:16.734470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:16.734955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.735678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:16.736136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:16.736577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:16.870483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:16.879220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc874895-e4e4-44c9-81f2-4a27ba6f74d4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1322 microversion: 2.1 time: 0.157263 Oct 04 22:13:16.879220 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3447/6785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:16 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:17.904133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:17.904762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:17.912686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:17.913177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:17.913626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:17.914330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:17.914827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:17.915262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.052866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:18.061451 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18221fc1-1f5d-4f73-9d63-f8d5553cf1f7 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1472 microversion: 2.1 time: 0.162508 Oct 04 22:13:18.062082 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3339/6786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:17 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:18.143112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f979a81-8c90-46ab-8bb0-63766a05aff7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '.version_select at 0x7f54f5282e50>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.219231 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f979a81-8c90-46ab-8bb0-63766a05aff7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/212ef3f82b994c9b8f7ab0ca89481249" status: 200 len: 371 microversion: 2.1 time: 0.135688 Oct 04 22:13:18.220788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3448/6787] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/os-quota-sets/212ef3f82b994c9b8f7ab0ca89481249 => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:18.232114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47b460b6-bd2b-4c10-b627-fdb99a6037c8 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1766813178", "id": 735143965, "os-flavor-access:is_public": "True"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:18.343904 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47b460b6-bd2b-4c10-b627-fdb99a6037c8 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.115485 Oct 04 22:13:18.344531 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3340/6788] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:18 2022] POST /compute/v2.1/flavors => generated 435 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:18.357874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "735143965"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:18.360278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:18.367276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.367777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.368223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.368972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.369459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.369890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.464060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6bf40d48f654c08b374eec1c2392a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212ef3f82b994c9b8f7ab0ca89481249', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:18.471119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1766813178 {{(pid=123541) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:13:18.479164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.479662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.480104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.480846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.481302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.481734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.510380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Getting quotas for project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:18.514201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Getting quotas for user bf4dd96cd17b4b63bec735c80e8ba463 and project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:18.527107 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.compute.api [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] ram quota exceeded for 212ef3f82b994c9b8f7ab0ca89481249, tried to resize instance. Oct 04 22:13:18.527655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Request method failure captured: Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action HTTP/1.1 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 38 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPK_vjyR7oquZHLqbtx3wT0zrvZdwyxf6WSliDpTf1raGr-yoUUgnyScvky1OX2mkhkGP6O1P9K8eolI12m0byypEoMD67aUbmc-k7J0aKwhkFYMHpb_RcdVLHAEJFfd6welEDxxmfSVZrZkFDaGRVVMn93991dOJNdvQhmXT0cpavng Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 212ef3f82b994c9b8f7ab0ca89481249 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,admin,reader Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,admin,reader Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 212ef3f82b994c9b8f7ab0ca89481249 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersAdminNegativeTestJSON-1932318010-project-admin Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a6bf40d48f654c08b374eec1c2392a3d Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1932318010-project-admin Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: {"resize": {"flavorRef": "735143965"}} Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'c5234707-b4fa-43fa-beb3-6ea495eebd2b', 'body': {'resize': {'flavorRef': '735143965'}}} Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:18.529654 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e64b0cae-4861-4336-b2dd-9659d1510e74 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action" status: 403 len: 118 microversion: 2.1 time: 0.177334 Oct 04 22:13:18.534890 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3449/6789] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:18 2022] POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action => generated 118 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:18.540881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe140643-c55e-42dd-8a00-9c83a42b08e7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.626239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe140643-c55e-42dd-8a00-9c83a42b08e7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/735143965" status: 202 len: 0 microversion: 2.1 time: 0.089474 Oct 04 22:13:18.626969 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3341/6790] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 22:13:18 2022] DELETE /compute/v2.1/flavors/735143965 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:18.635603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1c06b16-9028-4531-9ea9-184c04c777d7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.657338 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b1c06b16-9028-4531-9ea9-184c04c777d7 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025380 Oct 04 22:13:18.657932 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3450/6791] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:18.680102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5d6ab3f-187f-4b10-b7e3-462858dcdb3f tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '.version_select at 0x7f54f5dc8ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:18.747962 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5d6ab3f-187f-4b10-b7e3-462858dcdb3f tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/212ef3f82b994c9b8f7ab0ca89481249" status: 200 len: 371 microversion: 2.1 time: 0.072093 Oct 04 22:13:18.748553 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3342/6792] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 4 22:13:18 2022] GET /compute/v2.1/os-quota-sets/212ef3f82b994c9b8f7ab0ca89481249 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:18.761612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73a5e1aa-cc83-403b-be99-e4d5da80067c tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1407111298", "id": 149419444, "os-flavor-access:is_public": "True"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:18.862074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73a5e1aa-cc83-403b-be99-e4d5da80067c tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.104265 Oct 04 22:13:18.862701 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3451/6793] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:18 2022] POST /compute/v2.1/flavors => generated 434 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:18.876167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "149419444"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:18.878557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:18.886154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.886805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.887168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:18.887881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:18.888350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:18.888787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.128245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6bf40d48f654c08b374eec1c2392a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212ef3f82b994c9b8f7ab0ca89481249', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:19.134752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1407111298 {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:13:19.141457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.141942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.142379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.143132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.143601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.144027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.167887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Getting quotas for project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:19.173842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Getting quotas for user bf4dd96cd17b4b63bec735c80e8ba463 and project 90adfb64334b4873bc2ea060c664fc3f. Resources: {'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:19.191987 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] cores quota exceeded for 212ef3f82b994c9b8f7ab0ca89481249, tried to resize instance. Oct 04 22:13:19.192534 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Request method failure captured: Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action HTTP/1.1 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 38 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPK_vjyR7oquZHLqbtx3wT0zrvZdwyxf6WSliDpTf1raGr-yoUUgnyScvky1OX2mkhkGP6O1P9K8eolI12m0byypEoMD67aUbmc-k7J0aKwhkFYMHpb_RcdVLHAEJFfd6welEDxxmfSVZrZkFDaGRVVMn93991dOJNdvQhmXT0cpavng Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 212ef3f82b994c9b8f7ab0ca89481249 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,admin,reader Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,admin,reader Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_212ef3f82b994c9b8f7ab0ca89481249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 212ef3f82b994c9b8f7ab0ca89481249 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1932318010 Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminNegativeTestJSON-1932318010-project-admin Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: a6bf40d48f654c08b374eec1c2392a3d Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1932318010-project-admin Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: {"resize": {"flavorRef": "149419444"}} Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c5234707-b4fa-43fa-beb3-6ea495eebd2b', 'body': {'resize': {'flavorRef': '149419444'}}} Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:19.194654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-662e9d0d-bc21-42cf-af4f-fb014eee0a35 tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action" status: 403 len: 113 microversion: 2.1 time: 0.324098 Oct 04 22:13:19.199249 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3343/6794] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:18 2022] POST /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b/action => generated 113 bytes in 325 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:13:19.205199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b05c42b4-52b0-43cc-a72b-5a2ef61e5afc tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.306196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b05c42b4-52b0-43cc-a72b-5a2ef61e5afc tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/149419444" status: 202 len: 0 microversion: 2.1 time: 0.104692 Oct 04 22:13:19.306846 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3452/6795] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 4 22:13:19 2022] DELETE /compute/v2.1/flavors/149419444 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:19.315307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10c66cee-3cb5-48e4-9126-ae8a5710078d tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.335103 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10c66cee-3cb5-48e4-9126-ae8a5710078d tempest-ServersAdminNegativeTestJSON-1932318010 tempest-ServersAdminNegativeTestJSON-1932318010-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023530 Oct 04 22:13:19.335695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3344/6796] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 4 22:13:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:19.357584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.358087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:19.364294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.364781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.366785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.366785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.367034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.367458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.392441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:13:19.786092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44237457-70de-4cd1-921b-e81c7a9e4cd6 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 204 len: 0 microversion: 2.1 time: 0.432189 Oct 04 22:13:19.787340 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3453/6797] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:13:19 2022] DELETE /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:13:19.795417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:19.796109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:19.802635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.803501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.804084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.804816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:19.805284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:19.805720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:19.947593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:19.956117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5bba7d26-9c96-409a-bfe0-75fa75ab0fc9 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1478 microversion: 2.1 time: 0.164569 Oct 04 22:13:19.957020 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3345/6798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:19 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:20.981598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:20.982314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:20.990212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.990737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.991179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:20.991896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:20.992352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:20.992779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.129745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:21.138813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2aac696-0a9c-4ff1-8dd1-ed8dfe22b218 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1478 microversion: 2.1 time: 0.161753 Oct 04 22:13:21.139415 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3454/6799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:20 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:21.708239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5234707-b4fa-43fa-beb3-6ea495eebd2b", "name": "network-vif-deleted", "tag": "3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:21.722644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:21.724016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:21.724016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:21.736756 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] Creating event network-vif-deleted:3cb02fa3-2ebc-4b95-8fe3-3035c809fa7a for instance c5234707-b4fa-43fa-beb3-6ea495eebd2b on n-h2-851029-13 Oct 04 22:13:21.743117 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bc9e30f0-1e73-4667-999f-48d4186c8da1 req-0b9c283d-d3aa-412a-a1a8-98e329c95b7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038563 Oct 04 22:13:21.743935 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3346/6800] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:13:22.161523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:22.162314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:22.169449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.174864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.174864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.174864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.174864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.174864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.205586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:22.206070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:22.206513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:22.207068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lazy-loading 'fault' on Instance uuid c5234707-b4fa-43fa-beb3-6ea495eebd2b {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:13:22.250835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4dd96cd17b4b63bec735c80e8ba463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90adfb64334b4873bc2ea060c664fc3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:22.260255 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4728736d-ec53-4f2b-9d00-57c4c5c287b4 tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 200 len: 1312 microversion: 2.1 time: 0.102686 Oct 04 22:13:22.261487 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3455/6801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:22 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:23.285363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:23.286078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] [instance: c5234707-b4fa-43fa-beb3-6ea495eebd2b] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:23.292360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.292854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.293303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:23.294013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:23.294479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:23.294947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:23.308980 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] HTTP exception thrown: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Request method failure captured: Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b HTTP/1.1 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPK_uOZuver-6RxOSPx8G0nob7YHa14B2-Y72_owU5me8CFYHfs8Gg_HamCJGXxh_wjYynKLXneZN3BFT6U97i7hGZPADbeL8Agq1hMO43B6azooGdMze82FvhfDp6pRnpdgsNUFzJUJj2VYcpjOfygUJnkEbRcbv36D5_syx-copPZM Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 90adfb64334b4873bc2ea060c664fc3f Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1765239567 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90adfb64334b4873bc2ea060c664fc3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90adfb64334b4873bc2ea060c664fc3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90adfb64334b4873bc2ea060c664fc3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90adfb64334b4873bc2ea060c664fc3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1765239567 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 90adfb64334b4873bc2ea060c664fc3f Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1765239567 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersAdminNegativeTestJSON-1765239567-project Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: bf4dd96cd17b4b63bec735c80e8ba463 Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1765239567-project Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'c5234707-b4fa-43fa-beb3-6ea495eebd2b'} Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:23.310944 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] Returning 404 to user: Instance c5234707-b4fa-43fa-beb3-6ea495eebd2b could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f083bb2c-c217-441a-b6d6-965fa24136cb tempest-ServersAdminNegativeTestJSON-1765239567 tempest-ServersAdminNegativeTestJSON-1765239567-project] 10.222.0.36 "GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b" status: 404 len: 111 microversion: 2.1 time: 0.032217 Oct 04 22:13:23.316325 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3347/6802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:23 2022] GET /compute/v2.1/servers/c5234707-b4fa-43fa-beb3-6ea495eebd2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:13:32.779395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:32.780232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:32.781019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:32.781660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:32.925257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1941475514", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "fe26f2da-1d2b-41c5-99a2-f9ef07ff7b83"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:32.986133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] validate_networks() for [('fe26f2da-1d2b-41c5-99a2-f9ef07ff7b83', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:13:33.489202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:33.490400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:33.491014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:33.491777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:33.492303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:33.510757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.511263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.511699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.512475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:33.512942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:33.513375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:33.531972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Getting quotas for project eaf6d3e466724d80b55ea633a470e151. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:13:33.540140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Getting quotas for user 96d096a5f66b47669cc3b99af81b5cd1 and project eaf6d3e466724d80b55ea633a470e151. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:13:33.553139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:13:33.555733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:13:33.730616 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:13:34.736649 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46056. Oct 04 22:13:34.740857 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4054ddcd-9d5b-4d64-9023-031b71797fc1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967556 Oct 04 22:13:34.753084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3641794-7692-4996-a381-23f1c3f7aab2 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:34.753911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3641794-7692-4996-a381-23f1c3f7aab2 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:34.759332 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3456/6803] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:13:34.760830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:34.761687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:34.762292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:34.762980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=53 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:34.820913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3641794-7692-4996-a381-23f1c3f7aab2 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:34.833648 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3641794-7692-4996-a381-23f1c3f7aab2 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1215 microversion: 2.1 time: 0.083469 Oct 04 22:13:34.834551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3348/6804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:34 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:35.859766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d06d6c4e-6f7a-4af3-a837-ccca7bf850fd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:35.860395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d06d6c4e-6f7a-4af3-a837-ccca7bf850fd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:35.919737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d06d6c4e-6f7a-4af3-a837-ccca7bf850fd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:35.927875 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d06d6c4e-6f7a-4af3-a837-ccca7bf850fd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1215 microversion: 2.1 time: 0.072314 Oct 04 22:13:35.928775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3457/6805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:35 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:36.957707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:36.958384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:36.966513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:36.967258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:36.967713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:36.968434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:36.968900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:36.969336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:37.037331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:37.045634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1764b30-32be-4243-8f14-56fac6396ce6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1267 microversion: 2.1 time: 0.092426 Oct 04 22:13:37.046217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3349/6806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:36 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:38.069749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:38.070461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:38.081570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.082073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.082519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.083300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:38.083768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:38.084231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:38.157829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:38.166582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97bbbd37-c29d-43f8-a294-b4e0f7c3b128 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1273 microversion: 2.1 time: 0.101059 Oct 04 22:13:38.167520 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3458/6807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:38 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:39.191255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:39.191883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:39.199941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.200433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.200879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.201593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.202057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.202493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.372006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:39.389827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:39.390213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:39.391344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:39.391907 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:39.399992 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d05d9dd8-27bb-4322-8e98-f4d262566b95 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.212866 Oct 04 22:13:39.400891 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3350/6808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:39 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:39.407668 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] Creating event network-changed:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h2-851029-13 Oct 04 22:13:39.413999 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2381cbdc-e600-46cf-8637-06173ba9302d req-5c7fa12f-7443-412a-a82d-94ba4d196b30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045960 Oct 04 22:13:39.414872 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3459/6809] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:40.429980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:40.430976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:40.438112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.438634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.439209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.440014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:40.440503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:40.440951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:40.592759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:40.600807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38445d4c-2d54-480b-b403-2f5e23268019 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.175301 Oct 04 22:13:40.601445 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3351/6810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:40 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:41.625370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:41.626090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:41.633298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.633812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.634252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.635014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:41.635467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:41.635896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:41.788319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:41.800811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0a37597-dd90-41de-9650-446a58f58ac5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.180343 Oct 04 22:13:41.801857 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3460/6811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:41 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:42.824570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:42.825268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:42.832104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.832600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.833075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.833777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:42.834246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:42.834700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:42.968444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:42.976965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4bcdd871-679c-4a92-b116-df96b45b96a5 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.155977 Oct 04 22:13:42.977313 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3352/6812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:42 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:44.000820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:44.001536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:44.003824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:44.009756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.033017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.033017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.033017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:44.033017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:44.033017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:44.151700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:44.160132 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7c61ab3-f379-4650-8767-115a3b586a30 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.163167 Oct 04 22:13:44.160728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3461/6813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:43 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:45.184081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:45.184762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:45.188202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:45.194954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.195796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.196354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.197078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:45.197715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:45.198218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:45.339422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:45.350325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2f70333-c382-4735-8ed3-d36724ef9251 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.170461 Oct 04 22:13:45.350980 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3353/6814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:45 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:46.374168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:46.374834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:46.377587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:13:46.383037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.383942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.384774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.386084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.386988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.387807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.510914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "name": "network-vif-plugged", "status": "completed", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:46.522972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:46.523473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:46.523928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:46.535647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] Creating event network-vif-plugged:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h2-851029-13 Oct 04 22:13:46.540974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:46.541520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c89fbe54-8db5-4625-b390-2d41ad9648fa req-c5ad2619-caf6-4a2c-b014-3d1431065329 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 Oct 04 22:13:46.542270 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3354/6815] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:13:46.549682 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd360a07-2825-4211-aa6d-9f82471c494a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.179739 Oct 04 22:13:46.551129 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3462/6816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:46 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:47.576632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:47.577133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:47.583213 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.583745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.584191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.584894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:47.585360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:47.585794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:47.724842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:47.732936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebc16930-ea2a-4047-b2cd-819fe4ced61c tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1315 microversion: 2.1 time: 0.161939 Oct 04 22:13:47.733515 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3355/6817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:47 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.757218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:48.758222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.766642 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.767162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.767603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.768312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.768769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.769197 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.914749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:48.923636 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-647d3677-7269-4493-abee-66135f561343 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1502 microversion: 2.1 time: 0.170782 Oct 04 22:13:48.924238 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3463/6818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:48 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:48.947788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:13:48.950154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:48.957373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.957875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.958336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.959092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:48.959564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:48.960004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:48.997292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.003465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:13:49.010923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:13:49.011357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:13:49.011867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:13:49.012273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:13:49.012700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:13:49.281054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f11fc20f-3b22-4912-8728-dbaadda4aeed tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "POST /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d/action" status: 202 len: 0 microversion: 2.1 time: 0.337195 Oct 04 22:13:49.284740 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3356/6819] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:13:48 2022] POST /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:13:49.290801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:49.291805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:49.298345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.298880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.299401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.300172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:49.300650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:49.301118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:49.490240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:49.498366 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c42f5a71-5585-4320-91b4-028acc624502 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1511 microversion: 2.1 time: 0.211724 Oct 04 22:13:49.498997 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3464/6820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:49 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:50.523823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:50.524644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:50.532630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.533151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.533599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:50.534339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:50.534853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:50.535288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:50.694995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:50.703741 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a433cfb2-8fe4-4c8c-a25b-b7bdd58dd541 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1511 microversion: 2.1 time: 0.184959 Oct 04 22:13:50.704319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3357/6821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:50 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:51.728639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:51.729283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:51.737441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.757013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.757013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.757013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:51.757013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:51.757013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:51.900141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:51.910070 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1deb5e9d-a1ef-4acb-aca2-cb6e7aa017c6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1511 microversion: 2.1 time: 0.185925 Oct 04 22:13:51.919006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3465/6822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:51 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:52.934086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:52.934691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:52.937331 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:13:52.937512 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d (ip 10.222.0.36) !!! Oct 04 22:13:52.946742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.947244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.947735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:52.948514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:52.948977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:52.949412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:53.102114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:53.110320 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43730d9b-b5ca-4df7-a503-d775be3fbaac tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1511 microversion: 2.1 time: 0.180216 Oct 04 22:13:53.110902 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3358/6823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:52 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:54.135075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:54.135773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:54.143239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.143734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.144183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.144901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:54.145360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:54.145848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:54.281288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:54.290104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f7a664f-1582-4d2d-9f33-e85fc5e5770f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.159608 Oct 04 22:13:54.291404 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3466/6824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:54 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:55.314945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:55.315571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:55.324504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.325033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.325475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.326188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:55.326681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:55.327133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:55.472285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:55.481036 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e83e947f-7587-4b07-be10-6262e6e641d9 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.170024 Oct 04 22:13:55.481623 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3359/6825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:55 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:56.505655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:56.506307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:56.513397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.513935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.514379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.515123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:56.515580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:56.516008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:56.651705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:56.659765 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-05f2755c-8637-4ba6-8051-6633604839bf tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.159422 Oct 04 22:13:56.660907 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3467/6826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:56 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:57.683939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:57.684580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:57.692926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.693441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.693900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.694646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:57.695132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:57.695583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:57.841192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:57.849533 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f4be82c-0922-45f0-b025-43f98d3bbfb3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.169446 Oct 04 22:13:57.850132 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3360/6827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:57 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:13:58.873928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:13:58.874543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:13:58.882716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.882716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.883057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:58.883764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:13:58.884217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:13:58.884641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:13:59.039205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:13:59.047692 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30cc9924-2fde-4a08-bd54-fb27bb2a93b3 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.177634 Oct 04 22:13:59.048291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3468/6828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:13:58 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:00.071498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:00.072111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:00.079445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.079947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.080399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.081136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:00.081608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:00.082555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:00.234557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:00.234557 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-267ddd70-b97f-4cd0-8011-e54e96459a3f tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.161449 Oct 04 22:14:00.234557 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3361/6829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:00 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:01.252835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:01.253497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:01.261754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:01.262249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:01.263014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:01.263733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:01.264198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:01.264638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:01.415108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:01.423178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-355762e7-f1e5-479e-9410-4d8ead0fe5bc tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.174405 Oct 04 22:14:01.423775 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3469/6830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:01 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:02.447282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:02.447912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:02.455501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.456013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.456468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.457282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:02.457752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:02.458192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:02.619706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:02.627968 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-812228a5-14b8-4784-b0ff-8b3f14d34ba6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.184747 Oct 04 22:14:02.628571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3362/6831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:02 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:03.651320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:03.651973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:03.654766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:03.659692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.660694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.661159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:03.661891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:03.662346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:03.662817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:03.668251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=71 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:03.805699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:03.815829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5d2ecd2-e366-4f62-8793-bc87450d5ecb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.168332 Oct 04 22:14:03.821159 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3470/6832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:03 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:04.839144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:04.839778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:04.846595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:04.847121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:04.848080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:04.848787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:04.849255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:04.849691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:04.981557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:04.992687 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a957b9aa-01fa-45b5-a000-2ee11e0a6dea tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.157563 Oct 04 22:14:04.993282 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3363/6833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:04 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:06.016294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:06.017068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:06.024387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.024865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.025300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.025983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:06.026439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:06.026892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:06.167208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:06.175554 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b99bd683-146a-44c1-951c-09cd6b792ddb tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.163133 Oct 04 22:14:06.176166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3471/6834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:06 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:07.199861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:07.200434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:07.208396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:07.208930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:07.209341 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:07.210058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:07.210518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:07.210974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:07.213748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:07.350598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:07.364195 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d1b33c9-e79b-46ae-9c95-4ba6770ae289 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.167853 Oct 04 22:14:07.364796 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3364/6835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:07 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:08.387681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:08.388340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:08.395634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:08.396126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:08.396573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:08.397284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:08.397741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:08.398169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:08.540076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:08.548080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bd6c4ab2-1da9-4c8c-ad46-a00b0ab1739a tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.164378 Oct 04 22:14:08.548660 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3472/6836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:08 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:09.572535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:09.573177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:09.576434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=41 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:09.582409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.582954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.583419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:09.584183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:09.584652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:09.585163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:09.741378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:09.749458 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ce7532f-2f25-44b1-8423-bbb4724821d6 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1516 microversion: 2.1 time: 0.180886 Oct 04 22:14:09.750071 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3365/6837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:09 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:10.773061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:10.773682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:10.782065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:10.787764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:10.787764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:10.787764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:10.787764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:10.787764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:10.962334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:10.974159 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25e0deff-fc4f-4eec-a93e-7b4526606e54 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1515 microversion: 2.1 time: 0.205418 Oct 04 22:14:10.975130 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3473/6838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:10 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:11.332593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "name": "network-vif-unplugged", "status": "completed", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:11.344491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:11.345000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:11.345448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:11.358344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Creating event network-vif-unplugged:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h1-851029-13 Oct 04 22:14:11.364637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:14:11.375860 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b6670226-07a7-4b04-9bd7-3620cf07af17 req-d5e0aca1-831f-4109-8ac2-9c6b7ef42e15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047530 Oct 04 22:14:11.376497 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3366/6839] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:12.001013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:12.001760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:12.009644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.010135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.010573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.011323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:12.011809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:12.012237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:12.158648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:12.167667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-515cd817-e5e1-4d98-a87a-bdd06ed24c6b tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1515 microversion: 2.1 time: 0.170624 Oct 04 22:14:12.168274 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3474/6840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:11 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:13.195273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:13.196094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:13.202635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:13.203163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:13.203615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:13.204344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:13.204816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:13.205261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:13.344339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:13.353119 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-acad96e6-18fa-457d-b83c-7be5a9538984 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1513 microversion: 2.1 time: 0.164493 Oct 04 22:14:13.358418 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3367/6841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:13 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:13.392000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:13.401760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:13.402104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:13.402530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:13.415762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Creating event network-changed:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h1-851029-13 Oct 04 22:14:13.421564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:14:13.433354 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e427f167-225c-4ebd-bed1-006305869ee7 req-579178ba-d677-4e5a-89a0-b538b48f9da8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046137 Oct 04 22:14:13.434044 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3475/6842] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:14.377476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:14.378100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:14.385943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.386485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.387125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:14.387843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:14.388310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:14.388748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:14.533893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:14.542393 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6a584d43-179f-460d-97bc-49740cdc58cd tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1513 microversion: 2.1 time: 0.168821 Oct 04 22:14:14.543009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3368/6843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:14 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:15.567699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:15.568413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:15.580030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:15.580551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:15.580998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:15.581728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:15.582192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:15.582627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:15.725771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:15.734031 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09ce5096-4c91-473a-8242-18907e98db00 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1513 microversion: 2.1 time: 0.171688 Oct 04 22:14:15.734625 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3476/6844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:15 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:16.758134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:16.758835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:16.766105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.769871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.769871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.769871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.769871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.769871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.921740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:16.930437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55741871-9256-41f0-a641-f5925caad19d tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1510 microversion: 2.1 time: 0.176835 Oct 04 22:14:16.931063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3369/6845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:16 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:16.954673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:16.955289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:16.962878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.963388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.963822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.964537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:16.965035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:16.965474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:16.997703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:14:17.126398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.compute.api [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 22:14:18.976735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "name": "network-vif-plugged", "status": "completed", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:18.989627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:18.990130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:18.990581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.004339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] Creating event network-vif-plugged:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h1-851029-13 Oct 04 22:14:19.012307 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-93881a60-88d1-4bbc-bbfc-d16b2b881aee req-96fb1605-395f-4348-947f-ecbb92b4f997 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Oct 04 22:14:19.013058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3370/6846] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:14:19.636674 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae630162-34b7-4715-bfec-68d0e9b4d7e1 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 204 len: 0 microversion: 2.1 time: 2.686216 Oct 04 22:14:19.637598 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3477/6847] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:14:16 2022] DELETE /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 0 bytes in 2688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:14:19.647369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:19.648088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:19.654952 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.655456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.655905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.656693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:19.657100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:19.657537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:19.859228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:19.867734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fecc190d-16b1-463b-9c7a-dd3fd4083015 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1502 microversion: 2.1 time: 0.225549 Oct 04 22:14:19.870091 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3371/6848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:19 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:20.892499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:20.893296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:20.901513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:20.902015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:20.902494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:20.903249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:20.903717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:20.904153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:21.135514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:21.146223 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7642bd8-fe6e-403c-a1c2-199decb97033 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1502 microversion: 2.1 time: 0.258212 Oct 04 22:14:21.146858 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3478/6849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:20 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:21.822462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d", "name": "network-vif-deleted", "tag": "6b11345b-7486-4264-a2ff-eecf747a65f4"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:21.833279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:21.833874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:21.834402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:21.855794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] Creating event network-vif-deleted:6b11345b-7486-4264-a2ff-eecf747a65f4 for instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d on n-h1-851029-13 Oct 04 22:14:21.861126 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7ff6e5b7-74d4-4d00-8197-8d2f93c43acf req-65d66850-176f-4a30-a42c-497792ed47a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133222 Oct 04 22:14:21.861776 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3372/6850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:14:22.170433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:22.171074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:22.177715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:22.186857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:22.186857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:22.186857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:22.186857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:22.186857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:22.214271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:22.214790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:22.215227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:22.215681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lazy-loading 'fault' on Instance uuid 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:14:22.260511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d096a5f66b47669cc3b99af81b5cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf6d3e466724d80b55ea633a470e151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:22.269150 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f716b57-e5bb-4ef6-848f-4a7a2effe1be tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 200 len: 1305 microversion: 2.1 time: 0.103465 Oct 04 22:14:22.269764 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3479/6851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:22 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:23.299421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:23.300648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:23.307178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.307676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.308247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.308961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.309431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.309870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.325098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] HTTP exception thrown: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Request method failure captured: Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d HTTP/1.1 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLAMjgxBx-xe3Zs296JY9UmnCU7FPeVF3QEGcmS16jEOycFRZQQ_LK8t53G5etdxbFLtvjpZzS3-pM_Fi0ul_aIzHmZ0fXnFUxBXgS9vI2IHdpplrgmoDPrRa2MYFtIsSCBMIhzaoYHLT__KALMdaCRievtNUu9dUOkzcy0zBzjvT9c Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 96d096a5f66b47669cc3b99af81b5cd1 Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d'} Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.326921 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Returning 404 to user: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59db68b9-4979-416a-bf86-7aae38a622a4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 404 len: 111 microversion: 2.1 time: 0.034554 Oct 04 22:14:23.336189 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3373/6852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:23 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:14:23.345461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:23.346147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:23.353269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.353851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.354327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.355207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.355867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.356360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.372068 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] HTTP exception thrown: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Request method failure captured: Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d HTTP/1.1 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLAMjgxBx-xe3Zs296JY9UmnCU7FPeVF3QEGcmS16jEOycFRZQQ_LK8t53G5etdxbFLtvjpZzS3-pM_Fi0ul_aIzHmZ0fXnFUxBXgS9vI2IHdpplrgmoDPrRa2MYFtIsSCBMIhzaoYHLT__KALMdaCRievtNUu9dUOkzcy0zBzjvT9c Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 96d096a5f66b47669cc3b99af81b5cd1 Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d'} Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:23.373793 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Returning 404 to user: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f99a446-c557-40d4-be84-878ecd70d838 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 404 len: 111 microversion: 2.1 time: 0.033928 Oct 04 22:14:23.382372 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3480/6853] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:14:23 2022] DELETE /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:14:23.386778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:23.387501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] [instance: 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:23.393906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.394408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.394901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.395686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:23.396158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:23.396605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:23.411477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] HTTP exception thrown: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Request method failure captured: Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d HTTP/1.1 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLAMjgxBx-xe3Zs296JY9UmnCU7FPeVF3QEGcmS16jEOycFRZQQ_LK8t53G5etdxbFLtvjpZzS3-pM_Fi0ul_aIzHmZ0fXnFUxBXgS9vI2IHdpplrgmoDPrRa2MYFtIsSCBMIhzaoYHLT__KALMdaCRievtNUu9dUOkzcy0zBzjvT9c Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eaf6d3e466724d80b55ea633a470e151"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: eaf6d3e466724d80b55ea633a470e151 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161564907 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 96d096a5f66b47669cc3b99af81b5cd1 Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-DeleteServersTestJSON-1161564907-project Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d'} Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:14:23.413043 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] Returning 404 to user: Instance 2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08cb834c-f68c-4e1d-9a82-a4951d261fb4 tempest-DeleteServersTestJSON-1161564907 tempest-DeleteServersTestJSON-1161564907-project] 10.222.0.36 "GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d" status: 404 len: 111 microversion: 2.1 time: 0.033003 Oct 04 22:14:23.419020 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3374/6854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:23 2022] GET /compute/v2.1/servers/2aa5cab3-ade7-468c-84c1-cf12ab8c7f4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:14:36.060290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:36.061316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:36.183578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-606767932", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "952a52fc-3556-4ea6-bf84-05408640f422"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:36.241680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] validate_networks() for [('952a52fc-3556-4ea6-bf84-05408640f422', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:14:36.693943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:14:36.694371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:14:36.694894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:14:36.695304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:14:36.695777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:14:36.705449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:36.706579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:36.707050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:36.707810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:36.708264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:36.708720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:36.729156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:14:36.734813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for user a21b7dea78a740719c07bbe261bb178b and project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:14:36.748109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:14:36.750458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:14:36.883508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bad01267-1328-4f9c-bd74-1c46a44a867f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828883 Oct 04 22:14:36.887080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3481/6855] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:14:36.897904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7cd2cefe-a761-40e9-bf03-eabd5573dcfa tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:36.898348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7cd2cefe-a761-40e9-bf03-eabd5573dcfa tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:36.919483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=19 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:36.920919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=47 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:36.983111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7cd2cefe-a761-40e9-bf03-eabd5573dcfa tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:36.991086 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7cd2cefe-a761-40e9-bf03-eabd5573dcfa tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1217 microversion: 2.1 time: 0.097239 Oct 04 22:14:36.991669 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3375/6856] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:36 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:38.015571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50097255-b18a-4f91-a4d6-34bd9c309a43 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:38.016219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50097255-b18a-4f91-a4d6-34bd9c309a43 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:38.073069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-50097255-b18a-4f91-a4d6-34bd9c309a43 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:38.077705 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50097255-b18a-4f91-a4d6-34bd9c309a43 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1217 microversion: 2.1 time: 0.067017 Oct 04 22:14:38.078293 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3482/6857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:38 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:39.107472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:39.108537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:39.122121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:39.123375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:39.124112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:39.125405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:39.126259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:39.127096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:39.214619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:39.223990 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb88b064-fe85-4e01-9ed9-767ad0a2f255 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1213 microversion: 2.1 time: 0.123285 Oct 04 22:14:39.224625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3376/6858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:39 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:40.248027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:40.248557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:40.256337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:40.256824 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:40.257274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:40.257996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:40.258460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:40.258918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:40.329128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:40.337294 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ad7c67a-6ed7-4883-a89c-91eea49941b9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1275 microversion: 2.1 time: 0.093374 Oct 04 22:14:40.337909 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3483/6859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:40 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:41.360982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:41.361616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:41.368529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:41.369035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:41.369488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:41.370231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:41.370716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:41.371156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:41.505058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:41.527968 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-986468ee-0825-4681-8610-b1f563520c70 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.155862 Oct 04 22:14:41.527968 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3377/6860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:41 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:41.829998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:41.841019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:41.841494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:41.841931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:41.856323 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] Creating event network-changed:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h1-851029-13 Oct 04 22:14:41.868680 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7b157e23-0077-4daa-bd8d-8d31ef658fff req-a9c64412-7f1f-4951-9a32-569dedfad03e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042335 Oct 04 22:14:41.869339 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3484/6861] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:14:42.537133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:42.537762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:42.545299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:42.546000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:42.546619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:42.547710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:42.548367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:42.548830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:42.688955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:42.697140 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8fde7634-d7c5-43d8-9990-9bafef7e3040 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.164584 Oct 04 22:14:42.697708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3378/6862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:42 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:43.721328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:43.721964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:43.728173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:43.728655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:43.729089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:43.729812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:43.730270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:43.730714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:43.877449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:43.885468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-425f5d73-668b-499e-9353-e6ddea20cc06 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.169248 Oct 04 22:14:43.886088 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3485/6863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:43 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:44.909832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:44.910503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:44.916828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:44.917616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:44.918079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:44.918863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:44.919337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:44.919777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:45.056853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:45.065428 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-caeb2a30-094d-466b-aa0a-ae542a6f853b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.159673 Oct 04 22:14:45.066001 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3379/6864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:44 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:46.088382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:46.089037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:46.096293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:46.096798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:46.097241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:46.097948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:46.098408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:46.098880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:46.561569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:46.569760 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5e010aa-5a9f-41a9-8d1d-98cbac3fd59a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.485514 Oct 04 22:14:46.570419 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3486/6865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:46 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:47.593496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:47.594150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:47.597666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:47.602534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:47.603088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:47.603558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:47.604268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:47.604734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:47.605168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:47.737505 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:47.745314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61ab74d5-7679-46c5-ad83-53c650ea0cfd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.155730 Oct 04 22:14:47.745914 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3380/6866] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:47 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:48.769335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:48.769955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:48.771969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.775559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:14:48.778538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.779055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.779493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.780204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.780651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.781077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.921433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:48.929562 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a0ed4bf-cf60-461f-a4ce-c141591e5dca tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.164809 Oct 04 22:14:48.930070 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3487/6867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:48 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:48.949500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "name": "network-vif-plugged", "status": "completed", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:48.961857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:48.962350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:48.962847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:48.977281 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] Creating event network-vif-plugged:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h1-851029-13 Oct 04 22:14:48.985816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7179e94c-37f9-4167-812c-dd91cd2e71c0 req-5e96dfc5-28c2-4d43-baaa-8aee2efa26fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039031 Oct 04 22:14:48.988479 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3381/6868] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:14:49.953194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:49.953749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:49.961296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.961778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.962214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:49.962941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:49.963402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:49.963836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:50.096971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:50.104847 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-950f7ef2-ea18-4ac7-94ce-25ac63efdb52 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1317 microversion: 2.1 time: 0.156044 Oct 04 22:14:50.105423 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3488/6869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:49 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:51.130029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.130648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.136981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.137473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.137923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.138626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.139119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.139551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.275517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:51.284501 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ada45a3-caae-421d-a384-91bdf4816cbc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1506 microversion: 2.1 time: 0.160166 Oct 04 22:14:51.285090 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3382/6870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:51.307475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.308093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.315239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.315723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.316165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.316862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.317320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.317771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.454573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:51.462585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1beb7b28-cb40-4994-a640-bb75d0ed9a10 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1506 microversion: 2.1 time: 0.159138 Oct 04 22:14:51.463229 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3489/6871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:51.484944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:51.487475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.493663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.494160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.494606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.495423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.495791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.496759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.651437 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9e8d3e7-8ec7-4b74-87d8-34054901a4f7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "PUT /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1078 microversion: 2.1 time: 0.170209 Oct 04 22:14:51.651994 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3383/6872] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 4 22:14:51 2022] PUT /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1078 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:51.671015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.671806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.678944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.679427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.679858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.680579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.681063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.681491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.819057 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:51.826963 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-833d43d2-c7a9-4b49-9443-4c1a556c2d0c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1504 microversion: 2.1 time: 0.160078 Oct 04 22:14:51.827546 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3490/6873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:51.848522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:51.849151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:51.855596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.856112 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.856565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.857308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:51.857778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:51.858223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:51.999593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:52.008096 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db92d245-765f-461c-bf62-883ff3988093 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1504 microversion: 2.1 time: 0.163522 Oct 04 22:14:52.008688 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3384/6874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:51 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:52.030882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:14:52.033732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:52.040631 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.041105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.041536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.042224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.042691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.043118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.074021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:52.079906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=123541) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:14:52.086423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:14:52.086944 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:14:52.087416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:14:52.087822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:14:52.088229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:14:52.376648 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21784573-8a7a-42b7-97b7-3ad2ffa36657 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2/action" status: 202 len: 0 microversion: 2.1 time: 0.349697 Oct 04 22:14:52.377373 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3491/6875] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:14:52 2022] POST /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:14:52.385444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:52.386101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:52.393932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.394429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.394909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.395626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:52.396090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:52.396526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:52.530361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:52.539060 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a06dffa2-cfcd-41da-b62a-2bcaa3b23850 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1515 microversion: 2.1 time: 0.157408 Oct 04 22:14:52.539637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3385/6876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:52 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:53.564253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:53.564945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:53.572086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.572583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.573021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.573721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:53.574178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:53.574602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:53.708908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:53.716988 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d393012-e373-4c67-897c-c0c9193fddd4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1515 microversion: 2.1 time: 0.157702 Oct 04 22:14:53.717576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3492/6877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:53 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:54.744058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:54.744675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:54.752754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.753294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.753743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.754447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:54.754947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:54.755386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:54.891179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:54.899305 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c3c9527-be3f-46b8-aa28-c142912b1d92 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1515 microversion: 2.1 time: 0.160248 Oct 04 22:14:54.899974 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3386/6878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:54 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:14:55.922650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:55.923304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:55.930840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.931328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.931770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:55.932469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:55.932926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:55.933359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:56.067473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:56.075353 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2949f931-fb16-44e7-a37c-b342e548576c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1515 microversion: 2.1 time: 0.156615 Oct 04 22:14:56.075936 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3493/6879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:55 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:57.100859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:57.102219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:57.108555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.109045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.109488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.110195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:57.110681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:57.111770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:57.249835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:57.257923 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f8e7097-9370-4b18-a331-979c2014e14b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.162598 Oct 04 22:14:57.266906 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3387/6880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:57 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:58.282525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:58.283149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:58.290280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:58.290779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:58.291218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:58.291909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:58.292360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:58.292781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:58.431392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:58.440222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c0b65e8-eb69-4d9b-8f0d-e464bcbe162e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.160971 Oct 04 22:14:58.440812 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3494/6881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:58 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:14:59.467305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:14:59.467864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:14:59.474907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:59.475430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:59.475881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:59.476591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:14:59.477058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:14:59.477497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:14:59.607281 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:14:59.615576 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-520c36b4-7ab9-4c06-8664-8f62f1f9a0c8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.152310 Oct 04 22:14:59.616153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3388/6882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:14:59 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:00.641035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:00.641926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:00.649544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:00.650032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:00.650477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:00.651213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:00.651666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:00.652098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:00.795838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:00.804033 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3cf19aa-0fb5-4f8c-8883-82c00c746283 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.166942 Oct 04 22:15:00.804623 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3495/6883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:00 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:01.828296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:01.828959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:01.836469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:01.836963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:01.837406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:01.838110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:01.838573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:01.839058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:01.971206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:01.979023 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d74c5490-e0f3-48d6-8ab7-26ea3128cadc tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.155107 Oct 04 22:15:01.979608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3389/6884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:01 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:03.002478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:03.003116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:03.010577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:03.011103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:03.011566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:03.012262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:03.012716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:03.013143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:03.149350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:03.157313 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-90a26bda-19c0-4629-ad8a-ac9ddb2673ea tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.159519 Oct 04 22:15:03.157958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3496/6885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:02 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:04.180574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:04.181252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:04.188429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.189512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.189972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.190709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:04.191179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:04.191638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:04.330495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:04.338411 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9932e6ec-acab-4e06-b523-3ee1fb6f378b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.161757 Oct 04 22:15:04.339130 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3390/6886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:04 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:05.361569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:05.362211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:05.369314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.369819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.370259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.370978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:05.371431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:05.371850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:05.511529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:05.519479 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2c24307b-ab75-4d09-8243-133ecf6426eb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.162551 Oct 04 22:15:05.520055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3497/6887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:05 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:06.543680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:06.544313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:06.551561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.552063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.552516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.553247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:06.553793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:06.554239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:06.693013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:06.700932 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48206289-40a9-4c70-9020-724ee5e07d8f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.161140 Oct 04 22:15:06.701507 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3391/6888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:06 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:07.724880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:07.725530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:07.728354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:07.733187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.733678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.734116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:07.734855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:07.735310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:07.735779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:07.738436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:07.870721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:07.879061 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f42942a-24f8-46b1-9fa9-9f4465dbc95a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.158353 Oct 04 22:15:07.879668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3498/6889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:07 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:08.902849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:08.903475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:08.906313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:08.912179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:08.912674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:08.913117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:08.913828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:08.914291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:08.914757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:08.933588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:09.048356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:09.056290 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd5b32cb-a0c4-4e5d-9669-b89a2ebb3fb6 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.157431 Oct 04 22:15:09.056867 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3392/6890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:08 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:10.079688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:10.080576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:10.088231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.088715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.089173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.089889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:10.090342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:10.090794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:10.227136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:10.235488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dfb0769b-6b3e-492d-b377-804b8e44ea88 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.159899 Oct 04 22:15:10.236082 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3499/6891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:10 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:11.258757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:11.259323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:11.266685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:11.267332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:11.267791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:11.268516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:11.268991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:11.269433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:11.409115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:11.416936 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e86b5237-2abe-45fc-bfbe-868c1cb2c118 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.162268 Oct 04 22:15:11.417510 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3393/6892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:11 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:12.440904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:12.441483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:12.448821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.449337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.449784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.450501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:12.450988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:12.451421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:12.591119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:12.600042 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6459b008-56e7-49d3-97dd-62e1b65b34a4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1520 microversion: 2.1 time: 0.163103 Oct 04 22:15:12.600674 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3500/6893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:12 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:13.625903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:13.626694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:13.632654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.633154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.633675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.634335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.634860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.635292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:13.858097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:13.866781 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5040322c-51e5-4d7c-9bc0-efc2d6f7c529 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1519 microversion: 2.1 time: 0.245231 Oct 04 22:15:13.867384 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3394/6894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:13 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:13.977616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "name": "network-vif-unplugged", "status": "completed", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:13.987787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:13.988270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:13.988707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:14.000535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Creating event network-vif-unplugged:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h2-851029-13 Oct 04 22:15:14.005947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:14.017352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f4b02a40-a497-4cd4-9f96-a76395ff7735 req-af5a002a-8b01-42f2-9176-24baf95a51c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042993 Oct 04 22:15:14.017959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3501/6895] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:14.899148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:14.900085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:14.907085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.907588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.908043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:14.908765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:14.909233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:14.909742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:15.106355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:15.115619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85bdca9e-dd2c-4316-81f0-086a60bf7f74 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1519 microversion: 2.1 time: 0.221476 Oct 04 22:15:15.116267 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3395/6896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:14 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:16.034041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:16.045111 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.045585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.046014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.058083 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Creating event network-changed:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h2-851029-13 Oct 04 22:15:16.064531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:15:16.075433 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9d94ff74-e7a4-4f03-be56-1b5cdf0163c6 req-8d520b23-a2ca-4a52-b7c9-b8f78c4c0fbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046674 Oct 04 22:15:16.076046 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3502/6897] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:16.138959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:16.139598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:16.147779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.148292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.148755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.149486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:16.150586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:16.151087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:16.295116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:16.305482 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79003fa2-0dcf-473f-8158-b36a05147545 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1517 microversion: 2.1 time: 0.170445 Oct 04 22:15:16.306152 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3396/6898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:16 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:17.331810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:17.332552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:17.339484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.339983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.340407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.341110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.341566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.341992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.490511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:17.498996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38647dc5-ebe5-4832-a2d2-12afd5ddb476 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1514 microversion: 2.1 time: 0.172681 Oct 04 22:15:17.499600 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3503/6899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:17 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:17.522473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:17.523122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:17.530411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.530946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.531395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.532613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.533077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.533513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.777435 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be42aa6b-58a0-43c1-8675-8d42b21136a2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2/action" status: 204 len: 0 microversion: 2.1 time: 0.258904 Oct 04 22:15:17.778235 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3397/6900] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:15:17 2022] POST /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2/action => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:17.788980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:17.792154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:17.796047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.796534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.796969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.797673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:17.798152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:17.798576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:17.941449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:17.949593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d7729a5-2413-456c-aa07-28a3c520921c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1514 microversion: 2.1 time: 0.164573 Oct 04 22:15:17.950201 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3504/6901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:17 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:18.975347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:18.976187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:18.982354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.982876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.983319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:18.984266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:18.984722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:18.986014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:19.121334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:19.129162 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-777abeac-f68e-480c-aaa8-526f95ea88de tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1514 microversion: 2.1 time: 0.159487 Oct 04 22:15:19.129736 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3398/6902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:18 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:20.152845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:20.153465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:20.160854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.161359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.161792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.162471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.162953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.163381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.294832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:20.303225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dae120ab-fa0f-4118-be5e-e2c95e320cb1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1506 microversion: 2.1 time: 0.154320 Oct 04 22:15:20.303804 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3505/6903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:20 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:20.326369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:20.327182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:20.334544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.335076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.335526 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.336250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.336713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.337150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.475268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:20.483264 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e376a6c-a466-4d5e-aa35-b461cbf450d7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1506 microversion: 2.1 time: 0.160770 Oct 04 22:15:20.483863 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3399/6904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:20 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:20.509336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0a8833a-e6c6-4dcc-b119-07343be7d795 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'create', calling method: .version_select at 0x7f54f61081f0>, body: {"keypair": {"name": "tempest-keypair-219858146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgA9h+qcDaceomElSBYz34D0IaqLAqBj5Kq4hxNu/RmkIdl96lIfXkb5LT+9xT1WfQrOgGe4IaP9Be+TIunPEz8wK8x1COVhIn+UHCSa1RiyhggTj2xlCs/Glb9uT3GPA=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:20.525482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b0a8833a-e6c6-4dcc-b119-07343be7d795 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:15:20.530761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b0a8833a-e6c6-4dcc-b119-07343be7d795 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for user a21b7dea78a740719c07bbe261bb178b and project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:15:20.654490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0a8833a-e6c6-4dcc-b119-07343be7d795 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149057 Oct 04 22:15:20.655141 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3506/6905] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:15:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:20.888003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "name": "network-vif-plugged", "status": "completed", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:20.909508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:20.909508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:20.909508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:20.912707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] Creating event network-vif-plugged:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h2-851029-13 Oct 04 22:15:20.918008 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5c22122f-edd9-4a73-bfe9-f6317f833e3c req-ec1c3c50-ea0d-4931-b735-9a37cede5eaa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034591 Oct 04 22:15:20.918709 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3400/6906] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:23.148912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:23.153193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:23.157916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.158400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.158881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.159580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.160052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.160459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.299339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:23.307344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0c81cde-a97d-4e03-b587-94c072cb97e7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 200 len: 1506 microversion: 2.1 time: 0.162416 Oct 04 22:15:23.307976 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3507/6907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:23 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:23.331264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:23.331870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:23.339276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.339783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.340240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.341011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:23.341493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:23.341959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:23.368879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:15:23.704587 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c184f98a-0c3a-4779-9dba-6321943e721f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "DELETE /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 204 len: 0 microversion: 2.1 time: 0.377882 Oct 04 22:15:23.705321 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3401/6908] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:15:23 2022] DELETE /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:15:23.761618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2134572691", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "952a52fc-3556-4ea6-bf84-05408640f422"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:23.815882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] validate_networks() for [('952a52fc-3556-4ea6-bf84-05408640f422', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:15:24.186516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:15:24.187168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:15:24.187433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:15:24.187853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:15:24.188831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:15:24.197992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.198471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.198939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.199654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:24.200103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:24.200525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:24.218178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:15:24.223752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Getting quotas for user a21b7dea78a740719c07bbe261bb178b and project 553cebcaea8247438b0a400e1d50d0ca. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:15:24.237121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:15:24.239511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:15:24.379839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51e7ee07-3ce7-413a-9527-9d772bae32fd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622105 Oct 04 22:15:24.380492 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3508/6909] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:15:24.392899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a28fe423-b6af-43ed-8638-bac758e30845 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:24.393612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a28fe423-b6af-43ed-8638-bac758e30845 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:24.450185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a28fe423-b6af-43ed-8638-bac758e30845 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:24.463992 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a28fe423-b6af-43ed-8638-bac758e30845 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1218 microversion: 2.1 time: 0.072531 Oct 04 22:15:24.463992 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3402/6910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:24 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:25.484178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecf35b2a-17d9-4cff-8145-b0af00d566ed tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:25.484800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ecf35b2a-17d9-4cff-8145-b0af00d566ed tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:25.539877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ecf35b2a-17d9-4cff-8145-b0af00d566ed tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:25.546990 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ecf35b2a-17d9-4cff-8145-b0af00d566ed tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1218 microversion: 2.1 time: 0.067617 Oct 04 22:15:25.548349 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3509/6911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:25 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:25.661211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a9ece1-26a9-446e-abf9-1dc4f29281a2", "name": "network-vif-deleted", "tag": "5ceeefd8-90e1-4db7-9d26-3f1adc2ff456"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:25.672294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:25.675209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:25.675209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:25.686588 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] Creating event network-vif-deleted:5ceeefd8-90e1-4db7-9d26-3f1adc2ff456 for instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 on n-h2-851029-13 Oct 04 22:15:25.692413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-60ddb91c-60e4-4a76-bffe-c3deb0cc77ec req-ebbed872-4e10-44ee-a62a-4eb234a8932c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035308 Oct 04 22:15:25.698058 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3403/6912] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:26.570580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:26.571305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:26.579639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:26.581459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:26.581459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:26.581459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:26.581958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:26.582503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:26.648888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:26.657472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b870395-8f44-4e69-aff7-dee75ebbe46c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1270 microversion: 2.1 time: 0.090230 Oct 04 22:15:26.658064 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3510/6913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:26 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:27.682745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:27.683584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:27.698868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:27.699382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:27.699840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.700581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:27.701091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:27.701541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:27.857197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:27.865976 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-380b2727-7a82-4216-a1d0-8feefcfbdd20 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.188210 Oct 04 22:15:27.869125 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3404/6914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:27 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:28.777550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:28.789233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.789713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.790142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:28.804611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] Creating event network-changed:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h2-851029-13 Oct 04 22:15:28.809790 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-dbd0af82-6b8d-4b6c-943c-9bdc11e3ab9e req-85b2ba1c-cc68-404a-9240-c10233cdb7f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036207 Oct 04 22:15:28.810403 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3511/6915] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:28.889495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:28.891980 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:28.900189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.900751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.901227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:28.901951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:28.902525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:28.903010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:29.433712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:29.442552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4499aba6-670b-4ba0-b6c6-a64cf59b4198 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.556980 Oct 04 22:15:29.443283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3405/6916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:28 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:30.470840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:30.471548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:30.477822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.478305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.478782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.479475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:30.479931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:30.480359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:30.615574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:30.623467 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a43720b-8675-4abf-8394-a0d2f8d6f3b2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.158423 Oct 04 22:15:30.624047 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3512/6917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:30 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:31.647233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:31.647918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:31.655032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.655524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.655977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:31.657215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:31.657677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:31.658107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:31.798186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:31.805863 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-299e872f-a559-4566-a21d-7acf46615814 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.162851 Oct 04 22:15:31.806469 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3406/6918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:31 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:32.838164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:32.839031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:32.848700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:32.849320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:32.849839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:32.850850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:32.851563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:32.852064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:33.001424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:33.010292 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95bc6c35-64ed-463c-9710-4d4ce4f1cf91 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.184605 Oct 04 22:15:33.010931 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3513/6919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:32 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:34.034151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:34.034804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:34.042592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:34.043129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:34.043580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:34.044313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:34.044774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:34.045208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:34.176957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:34.184781 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63d4fa74-4c74-4ec6-b431-aca4efc24ecf tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.155165 Oct 04 22:15:34.185359 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3407/6920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:34 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:35.039794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "name": "network-vif-plugged", "status": "completed", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:35.045888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:35.051742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.052221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.052662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.065570 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] Creating event network-vif-plugged:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h2-851029-13 Oct 04 22:15:35.071052 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-32132a23-9f52-447b-9eb2-65a3d1fbb631 req-633a1c57-d709-41fb-ba32-5ebdbe8d9097 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035176 Oct 04 22:15:35.071706 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3514/6921] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:15:35.212837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:35.212837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:35.215717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:35.222922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:35.362466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:35.366297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:35.374092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7e30fed-da97-4909-94cd-5b20b0b5ad4f tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.169322 Oct 04 22:15:35.374696 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3408/6922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:35 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:36.397660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:36.398388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:36.400795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:36.407548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.408049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.408524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.409249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:36.409716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:36.410151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:36.553780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:36.563952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-001d33ff-6f38-440c-982d-da0c8e1b59fb tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1318 microversion: 2.1 time: 0.170614 Oct 04 22:15:36.564546 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3515/6923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:36 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:37.587635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:37.588268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.597087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.597586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.598065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.598803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.599275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.599718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.732338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.740984 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4feaa94a-8105-4edd-b547-7be184d1990a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1506 microversion: 2.1 time: 0.157283 Oct 04 22:15:37.741565 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3409/6924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:37 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:37.763428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:37.764035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.770980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.771459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.771889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.772575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.773027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.773451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.903940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.912688 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-126cd905-7ffc-4efd-8e13-c4db46c5b7e0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1506 microversion: 2.1 time: 0.153040 Oct 04 22:15:37.913277 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3516/6925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:37 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:37.934828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:15:37.937471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:37.943545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.944036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.944485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.945199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:37.945666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:37.946102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:37.974953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:37.980761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:15:37.987317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:15:37.987746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:15:37.988238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:15:37.988657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:15:37.989081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:15:38.147552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-837e500d-e6e7-48de-b80a-9faf6c158636 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11/action" status: 202 len: 0 microversion: 2.1 time: 0.216520 Oct 04 22:15:38.148083 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3410/6926] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:15:37 2022] POST /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:15:38.156979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:38.157758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:38.159719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:38.165051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.165532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.165969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:38.166688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:38.167179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:38.167605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:38.297496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:38.305326 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd6c52dd-9f5f-4fea-9edc-0072bb29906b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1513 microversion: 2.1 time: 0.152812 Oct 04 22:15:38.305907 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3517/6927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:38 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:39.330278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:39.330930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:39.332804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:39.338423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:39.338955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:39.339404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:39.340270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:39.340579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:39.342030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:39.477331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:39.486801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a0d6430e-f982-439f-bc71-9d2ac2ab46be tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1513 microversion: 2.1 time: 0.161240 Oct 04 22:15:39.487389 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3411/6928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:39 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:40.509517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:40.510342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:40.517890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:40.527201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=92 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:15:40.747277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:40.755918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2e98d09-9d3e-4f4b-bc38-75eef3c70b58 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1513 microversion: 2.1 time: 0.250367 Oct 04 22:15:40.756631 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3518/6929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:40 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:41.780329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:41.780951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:41.788591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.789155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.789551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.790274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:41.790775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:41.791243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:41.925630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:41.933397 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc331720-92d2-4ab5-a21d-968e126d8671 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157337 Oct 04 22:15:41.933964 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3412/6930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:41 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:42.958133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:42.958775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:42.965690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.966195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.966654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:42.967375 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:42.967831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:42.968262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:43.100960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:43.108697 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c359109-e1f7-4b7a-8719-fac7195aea67 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.155185 Oct 04 22:15:43.109256 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3519/6931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:42 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:44.132225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:44.132835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:44.139115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.139613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.140059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.140767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:44.141231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:44.141669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:44.278462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:44.287487 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f408e580-6bc4-443b-88d9-6e9c53b54fa0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.159485 Oct 04 22:15:44.288088 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3413/6932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:44 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:45.312393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:45.313032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:45.319248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.319731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.320189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:45.320871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:45.321379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:45.321815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:45.458258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:45.466136 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dfd1451c-9737-48a2-a21b-3078823833ba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.158448 Oct 04 22:15:45.466732 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3520/6933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:45 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:46.490032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:46.490655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:46.497760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.498250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.498720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.499434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:46.500405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:46.500841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:46.647471 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:46.655632 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bf04979-a1a8-42f1-b2e0-f5ca474eaa54 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.169483 Oct 04 22:15:46.656266 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3414/6934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:46 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:47.679246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:47.679846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:47.687288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.687832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.688273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.688974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:47.689440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:47.689870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:47.825056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:47.833195 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f33e5a12-48d0-4e92-a05a-8c314c81ab69 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157874 Oct 04 22:15:47.833716 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3521/6935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:47 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:48.864110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:48.864110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:48.864835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.864835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.865092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:48.865785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:48.866249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:48.866700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:49.004687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:49.017677 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-149eed3a-6bf3-4407-9ad8-4b856ebc40ce tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.165252 Oct 04 22:15:49.018270 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3415/6936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:48 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:50.040704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:50.041486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:50.048922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:50.049416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:50.049865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:50.050574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:50.051064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:50.051500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:50.192219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:50.201871 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d35ad691-35c7-42a0-925d-89ff8384399b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.165031 Oct 04 22:15:50.202472 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3522/6937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:50 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:51.225036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:51.225819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:51.233202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:51.233749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:51.234263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:51.235595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:51.236067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:51.236520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:51.379977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:51.389234 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73635078-cef8-4975-95ce-e656b80b8be7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.168124 Oct 04 22:15:51.389837 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3416/6938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:51 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:52.412641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:52.413311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:52.420253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:52.420735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:52.421172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:52.422362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:52.422844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:52.423270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:52.557793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:52.566459 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdc43102-8d4e-46e9-93e8-ae7facbad071 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157645 Oct 04 22:15:52.567094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3523/6939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:52 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:53.589784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:53.590410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:53.597866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:53.598360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:53.598844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:53.599557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:53.600026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:53.600464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:53.738255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:53.746043 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d18ddf7-356e-4468-bb27-b2a261b86cb7 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.160172 Oct 04 22:15:53.746622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3417/6940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:53 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:54.768837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:54.769480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:54.776701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:54.777203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:54.777698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:54.778408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:54.778901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:54.779331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:54.923595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:54.932106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-488b995a-28b9-4984-81dd-f203f44c1ee8 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.167193 Oct 04 22:15:54.932699 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3524/6941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:54 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:55.956512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:55.957099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:55.964028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:55.964520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:55.964962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:55.965664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:55.966129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:55.966566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:56.103904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:56.112254 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af2ccd60-3b76-4623-aaa7-2d4ff0c74219 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.159721 Oct 04 22:15:56.112842 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3418/6942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:55 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:15:57.135635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:57.136428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:57.143501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.143988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.144421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.145133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:57.145593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:57.146020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:57.287229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:57.295473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3588c477-d905-4b2f-b08a-7adf02b79665 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.163694 Oct 04 22:15:57.297011 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3525/6943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:57 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:58.320095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:58.320740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:58.328347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.328912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.329364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.330085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:58.330559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:58.331100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:58.469390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:58.477188 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04fe46e7-77c5-42bd-b219-0685ca54da83 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.161117 Oct 04 22:15:58.477765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3419/6944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:58 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:15:59.500993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:15:59.501542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:15:59.508960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.509450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.509892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.510606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:15:59.511122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:15:59.511557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:15:59.646341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:15:59.654346 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-511bc7ca-0058-4048-afe6-8d0ec2288eae tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157850 Oct 04 22:15:59.654969 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3526/6945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:15:59 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:00.677675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:00.678300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:00.685292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.685782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.686474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.687290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:00.687755 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:00.688192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:00.825685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:00.834147 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d17b2c09-f909-41da-ab30-12601ab1b5f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.160475 Oct 04 22:16:00.834651 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3420/6946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:00 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:01.857740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:01.858316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:01.865291 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:01.865778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:01.866218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:01.866947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:01.867403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:01.867833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:02.037164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:02.045497 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94fc2769-5c95-4f2f-ba3f-245c1f866cba tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.191759 Oct 04 22:16:02.046573 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3527/6947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:01 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:03.069305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:03.069959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:03.076869 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.078034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.078487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.079226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:03.079696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:03.080139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:03.213272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:03.221612 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e57680f1-a777-4ed2-81fb-53843987a6f1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.156224 Oct 04 22:16:03.227237 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3421/6948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:03 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:04.248623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:04.249281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:04.256220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.256701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.257334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.258292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:04.258992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:04.259577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:04.393635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:04.402032 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3bd7507-1dff-4e53-a6c4-51bd5e078ea2 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157307 Oct 04 22:16:04.402624 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3528/6949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:04 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:05.426021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:05.426638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:05.433527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:05.434012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:05.434453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:05.435171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:05.435635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:05.436073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:05.569232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:05.577121 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-337debad-51e0-4f44-83c8-7efc1f213074 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.155468 Oct 04 22:16:05.577702 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3422/6950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:05 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:06.600731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:06.602438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:06.611227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.611710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.612147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.612842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:06.613296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:06.614110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:06.752872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:06.760889 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c38ef3d4-fa63-45e5-9919-f982473704db tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.164412 Oct 04 22:16:06.761395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3529/6951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:06 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:07.784892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:07.785514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:07.792487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.792969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.793413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.794110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:07.794572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:07.795031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:07.799556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:07.931103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:07.939113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39d50130-2daf-4737-b8e0-a0603fe879cd tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.158631 Oct 04 22:16:07.939680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3423/6952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:07 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:08.962240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:08.962897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:08.965572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=26 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:08.970395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:08.970912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:08.971347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:08.972043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:08.972493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:08.972970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:09.118498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:09.126322 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-44486f11-5ebf-4621-8c64-3a6e47ed2b8a tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.167982 Oct 04 22:16:09.126943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3530/6953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:08 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:10.149842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:10.150456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:10.157527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.158554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.159037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.159759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:10.160233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:10.160676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:10.295185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:10.303211 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-957390b2-799d-4749-83cd-46158d26be68 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157411 Oct 04 22:16:10.303806 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3424/6954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:10 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:11.326204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:11.326866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:11.334480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.335002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.335448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.336141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:11.336596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:11.337023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:11.339617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=78 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:11.475488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:11.483438 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7c337615-cd0e-4752-9548-bebf65ff257e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.161213 Oct 04 22:16:11.484021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3531/6955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:11 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:12.507681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:12.508253 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:12.511063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=28 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:12.516547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:12.517052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:12.517496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:12.518219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:12.518711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:12.519153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:12.652320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:12.661104 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80f8cd47-e5ad-4876-b43b-68b6e13a2112 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1518 microversion: 2.1 time: 0.157680 Oct 04 22:16:12.661705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3425/6956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:12 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:13.684509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:13.685170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:13.693842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:13.694384 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:13.694848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:13.695593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:13.696046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:13.696470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:13.832509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:13.840793 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c54ecb0e-aa56-4cd2-b607-6e9dcf0b9ed4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1517 microversion: 2.1 time: 0.160257 Oct 04 22:16:13.841399 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3532/6957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:13 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:14.205284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "name": "network-vif-unplugged", "status": "completed", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:14.215540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.216035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.216515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.229332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Creating event network-vif-unplugged:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h1-851029-13 Oct 04 22:16:14.235858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:16:14.247254 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-56605798-f19c-4e4e-a431-c387b8ac4d7e req-93b15a34-4a71-4e6a-93ef-b3191c5934c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046460 Oct 04 22:16:14.247882 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3426/6958] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:14.864703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:14.865324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:14.871385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.871877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.872322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:14.873025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:14.873479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:14.873938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:15.013021 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:15.022240 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33ceda6c-84ef-4277-8936-1d710e072cb3 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1517 microversion: 2.1 time: 0.161663 Oct 04 22:16:15.023060 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3533/6959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:14 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:16.047327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:16.048068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:16.056394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:16.056903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:16.057376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:16.058196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:16.058650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:16.059190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:16.197117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:16.205943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f35bbc3a-4636-4493-a84c-95d77af60df9 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1515 microversion: 2.1 time: 0.164057 Oct 04 22:16:16.206589 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3427/6960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:16 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:16.262785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:16.274081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:16.274553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:16.275009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:16.289011 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Creating event network-changed:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h1-851029-13 Oct 04 22:16:16.294647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:16:16.305757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-db12b562-f390-4489-b77e-b562ad461945 req-46b30979-53eb-4f2f-94bb-ec6b8d8ec6f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046606 Oct 04 22:16:16.306301 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3534/6961] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:17.237206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:17.237974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:17.245060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.259406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.259406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.259406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:17.259406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:17.259406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:17.391195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:17.399520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e5741c25-71d6-4acb-8df0-44d3adccb403 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1515 microversion: 2.1 time: 0.166201 Oct 04 22:16:17.400115 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3428/6962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:17 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:18.425097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:18.425927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:18.432487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:18.435463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:18.435463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:18.435463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:18.435463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:18.435463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:18.581848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:18.590442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1eaf8b1d-210b-449a-8ffe-474f7f18d348 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1515 microversion: 2.1 time: 0.171279 Oct 04 22:16:18.591116 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3535/6963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:18 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:19.615455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:19.616068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:19.623116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.623612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.624058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.624767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.625227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.625658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.764907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:19.773125 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-435ad507-6e4a-48d5-af9c-baf150ccb39b tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1512 microversion: 2.1 time: 0.161528 Oct 04 22:16:19.773737 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3429/6964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:19 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:19.797571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:19.798395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:19.805271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.805909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.806357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:19.807165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:19.807629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:19.808069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.023096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-faf6b4cb-471b-4527-ba70-e8ce8ec2a63c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "POST /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11/action" status: 204 len: 0 microversion: 2.1 time: 0.229464 Oct 04 22:16:20.023977 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3536/6965] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:16:19 2022] POST /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11/action => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:16:20.033010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:20.033639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:20.039829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.040327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.040772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.041488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:20.041946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:20.042378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:20.204610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:20.212596 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf4cac15-fbe0-426e-b74a-2b623e1331f4 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1512 microversion: 2.1 time: 0.184103 Oct 04 22:16:20.213547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3430/6966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:20 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:21.238894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:21.239591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:21.246953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.247452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.247893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.248649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.249176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.249613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.287489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "name": "network-vif-plugged", "status": "completed", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:21.301130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:21.301634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:21.302082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:21.318583 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Creating event network-vif-plugged:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h1-851029-13 Oct 04 22:16:21.325033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:16:21.337186 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4b366877-33b2-47ca-9bba-a4477097d8a6 req-1e93dfaa-805e-406c-8bdf-32e683d7716d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053668 Oct 04 22:16:21.337621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3431/6967] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:21.392366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:21.401176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7254062-b327-41bc-a3bf-1f6747cdb278 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1512 microversion: 2.1 time: 0.166876 Oct 04 22:16:21.401704 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3537/6968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:21 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:22.428655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.429317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.435727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.437035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.437489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.438198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.438691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.439132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.571489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:22.579410 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b94e242b-6ad8-4722-9260-98daafc11a01 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1504 microversion: 2.1 time: 0.156022 Oct 04 22:16:22.580033 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3432/6969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:22 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:22.602408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.609125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.610917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.611528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.612071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.612788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.613242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.613664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.747006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:22.755347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8cca96ec-8d9e-46ba-b061-4a2ca07ebac1 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1504 microversion: 2.1 time: 0.156858 Oct 04 22:16:22.755929 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3538/6970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:22 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:22.777914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.778596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.784535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.785027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.785481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.786185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.786653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.787119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.914185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:22.922826 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee873a64-c4fe-40a3-9589-fbb0e0292190 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1504 microversion: 2.1 time: 0.148633 Oct 04 22:16:22.923607 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3433/6971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:22 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:22.945661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:22.946101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:22.952287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.952765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.953200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.953894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:22.954346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:22.954807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:22.980985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:23.405946 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d324b8a6-022a-4986-9412-a6b6217ad82d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 204 len: 0 microversion: 2.1 time: 0.463991 Oct 04 22:16:23.406605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3539/6972] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:22 2022] DELETE /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:16:23.425092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:23.425635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:23.432539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.433121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.433461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:23.434185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.434647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.435113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:23.461593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:16:23.506072 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.compute.api [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Instance is already in deleting state, ignoring this request Oct 04 22:16:23.506975 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ecc418b1-cfa6-480b-9002-f17f01f17a4d tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 204 len: 0 microversion: 2.1 time: 0.086378 Oct 04 22:16:23.507544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3434/6973] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:23 2022] DELETE /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:16:23.516315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:23.518744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:23.523035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.523515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.523955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:23.524641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:23.525095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:23.525522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:23.662122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:23.669930 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c08774a7-4d05-4dad-bb72-58f5d3ffb62e tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1510 microversion: 2.1 time: 0.158071 Oct 04 22:16:23.670508 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3540/6974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:23 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:24.693177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:24.693785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:24.700930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.701422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.702399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.703085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:24.703575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:24.704013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:24.837193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:24.845218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-181f9ab7-f803-4ae8-8997-478e4e32aaac tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1510 microversion: 2.1 time: 0.155975 Oct 04 22:16:24.845787 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3435/6975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:24 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:25.544884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e381a76b-0bff-46b0-bd11-2cdde08c7e11", "name": "network-vif-deleted", "tag": "1002ff92-9b95-4f70-8721-2019e6b0f97a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:25.556124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.556613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.557055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.570124 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] Creating event network-vif-deleted:1002ff92-9b95-4f70-8721-2019e6b0f97a for instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 on n-h1-851029-13 Oct 04 22:16:25.575628 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-26ca92d3-c73a-49e2-bd77-2c0e2e19d13a req-603d2be1-767b-4dc4-9aad-ad5df38a51d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Oct 04 22:16:25.577781 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3541/6976] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:25.867554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:25.868135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:25.875452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.875951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.876400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.877118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.877589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.878029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.910554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:25.911088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:25.911529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:25.912227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lazy-loading 'fault' on Instance uuid e381a76b-0bff-46b0-bd11-2cdde08c7e11 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:16:25.953611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21b7dea78a740719c07bbe261bb178b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553cebcaea8247438b0a400e1d50d0ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:25.961325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6cc2c25f-13f4-4d5a-85c2-ebfba3e96de0 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 200 len: 1306 microversion: 2.1 time: 0.097821 Oct 04 22:16:25.961895 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3436/6977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:25 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:26.986071 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:26.986809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: e381a76b-0bff-46b0-bd11-2cdde08c7e11] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:26.993044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.993527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.993963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:26.994674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:26.995142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:26.995568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:27.009555 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] HTTP exception thrown: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Request method failure captured: Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 HTTP/1.1 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLBLh0EprSyWc0r4SN2Rfx1hzZHZfqqqhPr4DrObBQd7HZ2bdtx0eBW6uk_iefXhRsHDqlfxLr4vAJTBxDNBlRLdBqlIrYy0ONPcJb9iN49W2pHyeQVa9McdX_ZbbpbYT2aiCxqY9-iuR4q04hFhlZDb6AQ_-uMXIyJhOJ0m3mH06dc Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a21b7dea78a740719c07bbe261bb178b Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'e381a76b-0bff-46b0-bd11-2cdde08c7e11'} Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:27.011228 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Returning 404 to user: Instance e381a76b-0bff-46b0-bd11-2cdde08c7e11 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-127c5a33-72b5-4b56-8a71-0d508fe0443c tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11" status: 404 len: 111 microversion: 2.1 time: 0.031956 Oct 04 22:16:27.016794 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3542/6978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:26 2022] GET /compute/v2.1/servers/e381a76b-0bff-46b0-bd11-2cdde08c7e11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:27.022197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61b11bd6-79d7-4903-b827-c238ee6f9680 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '.version_select at 0x7f54fa4f1280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:27.155919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61b11bd6-79d7-4903-b827-c238ee6f9680 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219858146" status: 202 len: 0 microversion: 2.1 time: 0.137432 Oct 04 22:16:27.156524 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3437/6979] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 4 22:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219858146 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:16:28.313576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:28.314114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:28.320946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.321457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.321890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.322573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.323053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.323475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.338309 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] HTTP exception thrown: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Request method failure captured: Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 HTTP/1.1 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLBLh0EprSyWc0r4SN2Rfx1hzZHZfqqqhPr4DrObBQd7HZ2bdtx0eBW6uk_iefXhRsHDqlfxLr4vAJTBxDNBlRLdBqlIrYy0ONPcJb9iN49W2pHyeQVa9McdX_ZbbpbYT2aiCxqY9-iuR4q04hFhlZDb6AQ_-uMXIyJhOJ0m3mH06dc Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a21b7dea78a740719c07bbe261bb178b Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '33a9ece1-26a9-446e-abf9-1dc4f29281a2'} Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:28.341833 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Returning 404 to user: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b6ae31a0-a366-4afc-b118-9b564b1702ab tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "DELETE /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 404 len: 111 microversion: 2.1 time: 0.032033 Oct 04 22:16:28.346802 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3543/6980] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:16:28 2022] DELETE /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:28.353782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:28.355098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] [instance: 33a9ece1-26a9-446e-abf9-1dc4f29281a2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:28.361641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.362136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.362586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.363329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:28.363795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:28.364238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:28.381301 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] HTTP exception thrown: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Request method failure captured: Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 HTTP/1.1 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLBLh0EprSyWc0r4SN2Rfx1hzZHZfqqqhPr4DrObBQd7HZ2bdtx0eBW6uk_iefXhRsHDqlfxLr4vAJTBxDNBlRLdBqlIrYy0ONPcJb9iN49W2pHyeQVa9McdX_ZbbpbYT2aiCxqY9-iuR4q04hFhlZDb6AQ_-uMXIyJhOJ0m3mH06dc Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_553cebcaea8247438b0a400e1d50d0ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 553cebcaea8247438b0a400e1d50d0ca Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914168262 Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: a21b7dea78a740719c07bbe261bb178b Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914168262-project Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '33a9ece1-26a9-446e-abf9-1dc4f29281a2'} Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:16:28.383012 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] Returning 404 to user: Instance 33a9ece1-26a9-446e-abf9-1dc4f29281a2 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2266705d-289a-4c60-b3ed-05396e249326 tempest-ServerDiskConfigTestJSON-1914168262 tempest-ServerDiskConfigTestJSON-1914168262-project] 10.222.0.36 "GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2" status: 404 len: 111 microversion: 2.1 time: 0.035691 Oct 04 22:16:28.388052 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3438/6981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:28 2022] GET /compute/v2.1/servers/33a9ece1-26a9-446e-abf9-1dc4f29281a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:16:41.324555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:41.325363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:41.444659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-658d6889-d6f0-4eb2-a17b-f7c6814f32b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: .version_select at 0x7f54f5e1fc10>, body: {"keypair": {"name": "tempest-keypair-1098758715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwYn0mU920ZBZRY7fVLLOXCfp5Mn+oFufIlNM6Z59PwJ/pKIrCWFcLyUEPzPqZzNeYAg43e7YyGg4RRCbgEJ6nB9zEBJFhXZScM8WRRx+3SmFO51s66ynjKcInnEGg3yQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:41.462458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-658d6889-d6f0-4eb2-a17b-f7c6814f32b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:16:41.469489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-658d6889-d6f0-4eb2-a17b-f7c6814f32b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:16:41.617937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-658d6889-d6f0-4eb2-a17b-f7c6814f32b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299247 Oct 04 22:16:41.618791 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3544/6982] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:16:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:44.416895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-653053802", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0d3f422-b3d4-46a6-9749-28d4d805e163"}], "security_groups": [{"name": "tempest-securitygroup--1177214885"}], "key_name": "tempest-keypair-1098758715", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:44.426474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:44.427373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:44.542593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] validate_networks() for [('a0d3f422-b3d4-46a6-9749-28d4d805e163', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:16:45.042139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:16:45.042642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:16:45.043158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:16:45.043723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:16:45.044354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:16:45.056641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:45.057421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:45.057828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:45.058723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:45.059835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:45.062483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:45.083881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:16:45.091033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:16:45.105800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:16:45.108753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:16:45.261005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa33b9fd-2ecb-46fe-9376-7766fec98460 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.848623 Oct 04 22:16:45.266707 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3439/6983] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:16:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:16:45.275188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81077267-29b4-4c01-bff6-be3a90f90966 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:45.275890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81077267-29b4-4c01-bff6-be3a90f90966 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:45.354250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81077267-29b4-4c01-bff6-be3a90f90966 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:45.361973 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81077267-29b4-4c01-bff6-be3a90f90966 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1238 microversion: 2.1 time: 0.091675 Oct 04 22:16:45.378023 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3545/6984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:45 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:46.385614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3cdb9d16-3bd4-4425-9a07-08974ff38c76 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:46.386953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3cdb9d16-3bd4-4425-9a07-08974ff38c76 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:46.443930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3cdb9d16-3bd4-4425-9a07-08974ff38c76 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:46.453035 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3cdb9d16-3bd4-4425-9a07-08974ff38c76 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1238 microversion: 2.1 time: 0.071412 Oct 04 22:16:46.453625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3440/6985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:46 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:16:47.476925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:47.477485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:47.485913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:47.486410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:47.486896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:47.487605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:47.488064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:47.488621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:47.553816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:47.563266 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e977c30b-0666-4235-8508-de79ffc66e00 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1242 microversion: 2.1 time: 0.090529 Oct 04 22:16:47.563885 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3546/6986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:47 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:48.587524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:48.588774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:48.608582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.609625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.610484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.611923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:48.613477 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:48.614422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:48.692441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:48.701355 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-256fb594-4cf4-4e3b-98bc-fafbc8bf9ac3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1298 microversion: 2.1 time: 0.118831 Oct 04 22:16:48.701955 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3441/6987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:48 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:49.726377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:49.731029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:49.739161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.739657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.740101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:49.740892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:49.741377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:49.741805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:49.901575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:49.909616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a380ef7c-ff70-47a9-8dcb-c3eb3020d126 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.187994 Oct 04 22:16:49.910218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3547/6988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:49 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:50.647288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:50.664309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.665028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.665618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.694335 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] Creating event network-changed:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h1-851029-13 Oct 04 22:16:50.694335 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-dd2597ae-8bf2-4f44-91e5-1b3320cd3570 req-d5feada6-5a08-4512-a445-f7098ec0d364 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049852 Oct 04 22:16:50.694335 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3442/6989] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:50.934159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:50.935359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:50.943060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.943564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.944143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:50.944774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:50.945269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:50.945710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:51.090610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:51.098977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe5db713-4c35-4978-b925-70fc5cb3ae11 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.169006 Oct 04 22:16:51.099561 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3548/6990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:50 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:52.123763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:52.124427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:52.130763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.131259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.131703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.132412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:52.132876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:52.133315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:52.272692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:52.281031 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34a4911d-2e16-44d4-ba69-1f82ef90415a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.163078 Oct 04 22:16:52.281636 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3443/6991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:52 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:53.304962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:53.305601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:53.313462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:53.313953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:53.314425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:53.315151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:53.315602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:53.316031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:53.451488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:53.460034 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f274cef-3627-4f2c-a340-d01cc64f22f8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.159002 Oct 04 22:16:53.460635 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3549/6992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:53 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:54.483602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:54.484236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:54.491304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.491810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.492267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.492981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:54.493511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:54.493929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:54.633271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:54.644686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edd57dec-5fc8-40c9-8526-cb086df0e7ac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.161667 Oct 04 22:16:54.644686 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3444/6993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:54 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:55.664414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:55.665053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:55.668445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:55.674243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.674775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.675207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.675899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:55.676351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:55.676772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:55.816687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:55.824660 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a1cfc374-de91-48a6-bcbe-00aeb14b8def tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.164166 Oct 04 22:16:55.825249 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3550/6994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:55 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:56.848058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:56.849144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:56.851901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:56.853582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:16:56.859579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:56.860088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:56.860539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:56.861267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:56.861738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:56.862176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.003517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:57.011857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ffa05bd-d4e4-46dd-8ead-bfbeb4e037ee tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.167846 Oct 04 22:16:57.037088 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3445/6995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:56 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:57.649953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "name": "network-vif-plugged", "status": "completed", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:16:57.649953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:57.649953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:57.649953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:57.649953 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] Creating event network-vif-plugged:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h1-851029-13 Oct 04 22:16:57.656330 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f25e1462-cd7f-420c-9fd9-0b2ece863e2a req-8d35ae6f-1280-4803-a235-c530d8c80995 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Oct 04 22:16:57.657152 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3551/6996] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:16:58.036460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:58.037090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:58.044408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:58.044914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:58.045360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:58.046077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:58.046554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:58.047021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:58.191774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:58.200143 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e7cb95-0302-4b58-8b10-f479e5e8fb18 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.168270 Oct 04 22:16:58.201824 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3446/6997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:58 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:16:59.224686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:16:59.225293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:16:59.233811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:59.234387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:59.235033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:59.236033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:16:59.236603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:16:59.237175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:16:59.382583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:16:59.391896 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9610ccf-edba-4f7f-8cd4-6fb6905d3244 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1364 microversion: 2.1 time: 0.171536 Oct 04 22:16:59.392485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3552/6998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:16:59 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:00.415970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:00.416584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:00.423957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:00.424461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:00.424906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:00.425628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:00.426095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:00.426531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:00.575609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:17:00.584647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93767d59-49a8-41c9-a96a-626b28609cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1551 microversion: 2.1 time: 0.172570 Oct 04 22:17:00.585230 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3447/6999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:17:00 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:17:00.607667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:17:00.608263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:17:00.616224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:00.620335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:00.620335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:00.620335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:00.620335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:00.620335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:00.714624 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d05d202-0914-4d9c-b65c-b4dc4e0e6d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110948 Oct 04 22:17:00.715305 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3553/7000] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:17:00 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:17:02.224803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:17:02.236308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:17:02.239252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:17:02.239252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:17:02.249311 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] Creating event network-changed:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h1-851029-13 Oct 04 22:17:02.254859 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7d8a367a-961c-42bd-9182-1764f35530a1 req-32762ab8-d612-4587-a275-7d3c596eb930 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033598 Oct 04 22:17:02.255664 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3448/7001] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:06.764127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:06.764965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:06.765956 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:18:06.766095 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 (ip 10.222.0.36) !!! Oct 04 22:18:06.773303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:06.773920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:06.781989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.782478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.782946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.783661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.784118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.784596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.929546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:06.938002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-88324a91-1ec1-414f-817a-c46538558d91 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.177202 Oct 04 22:18:06.938592 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3554/7002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:06 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:06.959422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:06.960204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=42 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:06.965862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:06.966836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:06.973388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.980459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.980459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:06.980459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:06.980459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:06.980459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.122031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.129842 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97b84086-b800-4a2e-8914-45ac030c52f7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.173147 Oct 04 22:18:07.130416 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3449/7003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:06 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:07.152851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:07.153489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:07.159775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.160256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.160686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.161366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.161812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.162237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.291462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.299743 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0da1c2fe-8cb7-4eb8-98a9-5cf931f2981b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.151334 Oct 04 22:18:07.300539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3555/7004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:07 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:07.322600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:07.325475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:07.331500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.331993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.332441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.333142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.333604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.334035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.363034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.368734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:18:07.376194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:18:07.376564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:18:07.377046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:18:07.377467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:18:07.377891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:18:07.722477 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-12b2262f-ce84-48d7-ac9e-54ef7afb70cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.403613 Oct 04 22:18:07.723040 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3450/7005] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:07 2022] POST /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:18:07.731431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:07.732098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:07.738155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.738681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.739142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.739826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:07.740443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:07.740697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:07.875406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:07.883096 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-164fc569-54d1-47d1-a559-a1d74413ce4a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1677 microversion: 2.1 time: 0.155520 Oct 04 22:18:07.883681 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3556/7006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:07 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:08.906782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:08.907401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:08.914262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.914787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.915235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:08.915937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:08.916402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:08.916846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:09.048817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:09.056790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-962cafb9-35f1-4cc8-9bb0-b13bdca2f368 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1677 microversion: 2.1 time: 0.155255 Oct 04 22:18:09.057374 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3451/7007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:08 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:10.081267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:10.081933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:10.089777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:10.090260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:10.090722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:10.091421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:10.091882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:10.092319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:10.229344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:10.238388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c787a47c-ef78-4c92-91ee-7ebb725f9467 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1677 microversion: 2.1 time: 0.160969 Oct 04 22:18:10.238943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3557/7008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:10 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:11.262920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:11.263507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:11.270296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.270816 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.271265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.271968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:11.272434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:11.272872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:11.408674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:11.417539 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3485bab5-386c-4139-a371-e00782993920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.158616 Oct 04 22:18:11.418106 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3452/7009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:11 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:12.441804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:12.442360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:12.449554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.450047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.450485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.451224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:12.451685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:12.452115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:12.587179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:12.595744 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfa64998-f3b9-4c43-aadf-dc300f0b99e2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.158231 Oct 04 22:18:12.596322 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3558/7010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:12 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:13.619178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:13.620386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:13.626634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.627158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.627611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.628315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:13.628787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:13.629228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:13.756620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:13.764930 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1443ec7b-990c-4369-b0f1-efda41d5b8bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.149729 Oct 04 22:18:13.765504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3453/7011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:13 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:14.788132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:14.788792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:14.795955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.796550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.796989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.797861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:14.798508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:14.798968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:14.936821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:14.945399 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80087bc0-85b7-4a9c-b6eb-8ca853735a49 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.161376 Oct 04 22:18:14.946241 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3559/7012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:14 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:15.968361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:15.968966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:15.975784 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.976272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.976718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:15.977418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:15.977879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:15.978314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:16.112598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:16.121050 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bbb2bae7-a028-41de-bca4-df614b6f5568 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.156622 Oct 04 22:18:16.121703 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3454/7013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:15 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:17.145216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:17.145748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:17.153304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.153777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.154210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.154933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:17.155457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:17.155882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:17.291079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:17.299596 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3aeee6c4-937e-4789-95f7-c88f21bd6f5a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.158713 Oct 04 22:18:17.300176 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3560/7014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:17 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:18.324458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:18.325093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:18.332368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:18.332891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:18.333345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:18.334059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:18.334583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:18.335058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:18.472408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:18.480228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bdc757c1-849b-4bb6-a0e1-dd60232b44f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.160709 Oct 04 22:18:18.480802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3455/7015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:18 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:19.503394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:19.503939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:19.510829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:19.511337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:19.511778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:19.512475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:19.512933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:19.513362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:19.645436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:19.653262 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5b20ad4-9367-4f91-97ec-bd0d89621981 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.153869 Oct 04 22:18:19.653837 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3561/7016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:19 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:20.675601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:20.676214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:20.683420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:20.683926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:20.684381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:20.685096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:20.685567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:20.686005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:20.823428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:20.831944 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54881f8c-f482-482c-ade8-81eef0b11dfb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.160265 Oct 04 22:18:20.832454 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3456/7017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:20 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:21.855141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:21.855792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:21.862700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.863183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.863613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.864304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:21.864753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:21.865176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:21.997418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:22.005256 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81c444f4-cea8-4ec3-9e5b-b86008d7fe37 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.154166 Oct 04 22:18:22.005852 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3562/7018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:21 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:23.028992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:23.029674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:23.036855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.037358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.037872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.038530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:23.039088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:23.039538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:23.169110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:23.177043 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20e82658-6b2c-4f69-9c89-78ca5ac736de tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.152514 Oct 04 22:18:23.177621 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3457/7019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:23 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:24.201225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:24.201838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:24.208765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.209248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.209682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:24.210373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:24.210878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:24.211303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:24.344319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:24.352230 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e76fccb-a97c-4d45-97da-77ef56df04fc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.155513 Oct 04 22:18:24.352800 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3563/7020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:24 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:25.376507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:25.377133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:25.384286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:25.384780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:25.385234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.385977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:25.387009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:25.387452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:25.518905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:25.526833 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8966d9d8-50d3-4017-aab3-cad50da1b873 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.154247 Oct 04 22:18:25.527418 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3458/7021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:25 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:26.549371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:26.549989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:26.557184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.557663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.558803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:26.559511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:26.559966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:26.560395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:26.694796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:26.702481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8e70a35-fe9e-4378-99b2-a9a692bda95a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.157021 Oct 04 22:18:26.703083 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3564/7022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:26 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:27.726722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:27.727354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:27.734280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:27.734810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:27.735269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:27.735982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:27.736451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:27.736888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:27.869067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:27.877598 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-de87ac24-bfed-44f6-8aff-1779ebc33b06 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1682 microversion: 2.1 time: 0.154910 Oct 04 22:18:27.881855 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3459/7023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:27 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:28.902385 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:28.903114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:28.910248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.910763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.911208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:28.911913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:28.912422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:28.912830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.005958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "name": "network-vif-unplugged", "status": "completed", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:29.016355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:29.016841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:29.017288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:29.030328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Creating event network-vif-unplugged:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h2-851029-13 Oct 04 22:18:29.035976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:18:29.047556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-035b82d6-a097-4aaf-821a-4f8a28e2bc11 req-e30f95d8-9e31-41f3-b272-93b370fced97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114496 Oct 04 22:18:29.048173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3460/7024] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:29.066830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:29.072723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d71aad61-a694-4cee-b553-9e82adba56a3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1681 microversion: 2.1 time: 0.175122 Oct 04 22:18:29.073892 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3565/7025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:28 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:30.102029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:30.102809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:30.110499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.111032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.111953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.112390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:30.112689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:30.113130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:30.621978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:30.630532 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1fb6260f-10a5-4bb2-a7e5-b477cf4753f6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1681 microversion: 2.1 time: 0.535994 Oct 04 22:18:30.631142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3461/7026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:30 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1681 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:31.065138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:31.076024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.076500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.076934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.092017 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Creating event network-changed:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h2-851029-13 Oct 04 22:18:31.097504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:18:31.108471 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d3c5d9e9-b83e-4c76-9d8e-b539702e7b9b req-745a2ad6-b0aa-4660-ace8-edcd7013cc06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047251 Oct 04 22:18:31.109114 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3566/7027] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:31.654649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:31.655323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:31.662226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.662752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.663207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.663912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:31.664385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:31.664826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:31.794903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:31.802815 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c427aa90-1db9-4242-85ea-ec102c40c421 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1679 microversion: 2.1 time: 0.152567 Oct 04 22:18:31.803386 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3462/7028] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:31 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:32.827502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:32.828191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:32.834750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.835242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.835677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.836364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:32.836817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:32.837239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:32.979923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:32.988839 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d64f00b7-d116-4054-9a6b-a301e47ed83d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1676 microversion: 2.1 time: 0.167013 Oct 04 22:18:32.989539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3567/7029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:32 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:33.012556 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:33.013127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:33.020146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.020646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.021102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.021820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.022293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.022752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.062195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:33.409415 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70833239-0ad7-448c-bedf-69016fa1c254 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/action" status: 204 len: 0 microversion: 2.1 time: 0.401011 Oct 04 22:18:33.410125 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3463/7030] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:18:33 2022] POST /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7/action => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:18:33.420208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:33.420862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:33.427706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.428257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.428706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.429400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:33.429856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:33.430396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:33.583075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:33.591664 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b0993ca-5c49-4430-8af5-cd0e26f9fae9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1676 microversion: 2.1 time: 0.177051 Oct 04 22:18:33.592516 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3568/7031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:33 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:34.617062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:34.617813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:34.625576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:34.625680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:34.626098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:34.626837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:34.627313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:34.627756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:34.767096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:34.774967 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a40e2688-57d0-4394-abc1-653aa34422c9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1676 microversion: 2.1 time: 0.162940 Oct 04 22:18:34.775554 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3464/7032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:34 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:35.798919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:35.799621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:35.807162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.807653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.808223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.809526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.809983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.810420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.885937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "name": "network-vif-plugged", "status": "completed", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:35.896500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.896996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.897436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.910191 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] Creating event network-vif-plugged:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h2-851029-13 Oct 04 22:18:35.915846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-493d5605-3af5-45d1-88fa-e2cb394fbc1e req-3868a878-fea2-4c26-9bad-5af63df4eb30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094931 Oct 04 22:18:35.916729 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3465/7033] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:35.955672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:35.964074 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-906115fa-df8c-4c12-b6c5-8fee060965f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.169751 Oct 04 22:18:35.964657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3569/7034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:35 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:35.988685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:35.989434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:35.996109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.996624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.997080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:35.997818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:35.998384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:35.998865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.138211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:36.146227 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46265f48-8654-45b0-8bd4-8e4e6cfe355c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.161870 Oct 04 22:18:36.146833 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3466/7035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:35 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:36.169501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.182083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.316636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:36.320241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=100 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:36.325502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a77f41b8-b670-4243-a01e-a25d06c112c1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1668 microversion: 2.1 time: 0.160683 Oct 04 22:18:36.326080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3570/7036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:36 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:36.354214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:36.354640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:36.360870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.361441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.361888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.362600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.363099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.363539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.390469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:18:36.815520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b05ebe7-acee-4641-b6ba-8aaa161327e7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 204 len: 0 microversion: 2.1 time: 0.465087 Oct 04 22:18:36.816127 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3467/7037] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:18:36 2022] DELETE /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:18:36.825517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:36.826124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:36.834479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.840885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.840885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.840885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:36.840885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:36.840885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:36.970816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:36.979064 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdde3970-d8e8-4c9b-83d3-4febfff5054a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1674 microversion: 2.1 time: 0.158500 Oct 04 22:18:36.980400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3571/7038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:36 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:38.004279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:38.005012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:38.007894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:38.012900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:38.013400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:38.013861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:38.014575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:38.015068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:38.015501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:38.150372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:38.158863 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d0782ce3-76ac-4ca9-8df4-c22705c7cdd3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1674 microversion: 2.1 time: 0.158958 Oct 04 22:18:38.159432 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3468/7039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:37 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:39.171045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1160eb86-d337-4413-8506-40ece4ea7bc7", "name": "network-vif-deleted", "tag": "50c46002-795a-4162-838b-5323b530f474"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:39.179222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=37 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:39.187528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:39.187528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:39.188397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:39.188397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:39.188397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:39.198251 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] Creating event network-vif-deleted:50c46002-795a-4162-838b-5323b530f474 for instance 1160eb86-d337-4413-8506-40ece4ea7bc7 on n-h2-851029-13 Oct 04 22:18:39.198468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:39.199088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:39.200182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:39.201016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:39.201537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:39.202911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:39.204221 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0e0820af-7095-4ea7-abca-2d3bd3896c10 req-b906ccb0-5400-45bf-a2c3-0ed2bead04c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037385 Oct 04 22:18:39.209055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3572/7040] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:39.269821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:39.277986 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e1bbf8f-c163-450b-af27-528f0749b80d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 200 len: 1606 microversion: 2.1 time: 0.099360 Oct 04 22:18:39.278567 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3469/7041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:39 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:18:40.303148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:40.303938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:40.310376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.310887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.311321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.312007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.312463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.313145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.329866 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 HTTP/1.1 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1160eb86-d337-4413-8506-40ece4ea7bc7'} Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:40.331546 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e55c92cc-8138-4e4f-86cb-045c40b50f64 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 404 len: 111 microversion: 2.1 time: 0.035350 Oct 04 22:18:40.339122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3573/7042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:40 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:18:40.348330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:40.348954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:40.356179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.356675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.357144 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.357837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.358376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.358846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.372822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 HTTP/1.1 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1160eb86-d337-4413-8506-40ece4ea7bc7'} Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:18:40.374597 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:18:40.379296 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd183675-1e41-478a-b211-a7f44c8822ab tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 404 len: 111 microversion: 2.1 time: 0.031590 Oct 04 22:18:40.380306 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3470/7043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:40 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:18:40.426098 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1460875215", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a0d3f422-b3d4-46a6-9749-28d4d805e163"}], "security_groups": [{"name": "tempest-securitygroup--1177214885"}], "key_name": "tempest-keypair-1098758715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:40.544450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] validate_networks() for [('a0d3f422-b3d4-46a6-9749-28d4d805e163', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:18:40.912527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:18:40.912984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:18:40.913459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:18:40.913872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:18:40.914286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:18:40.923437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.924225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.924354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.925068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:40.925529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:40.925955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:40.943210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:18:40.948629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:18:40.961657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:18:40.964049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:18:41.109552 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91ea6a74-efa3-4b4b-aaad-a83144c645da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.687227 Oct 04 22:18:41.110120 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3574/7044] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:18:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:18:41.122091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e401975-f492-4b85-bfc9-c2a598fb92b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:41.122779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e401975-f492-4b85-bfc9-c2a598fb92b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:41.177178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e401975-f492-4b85-bfc9-c2a598fb92b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:41.184712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e401975-f492-4b85-bfc9-c2a598fb92b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1239 microversion: 2.1 time: 0.067075 Oct 04 22:18:41.185274 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3471/7045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:41 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:42.209521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:42.210132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:42.218263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:42.218770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:42.219207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:42.219905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:42.220360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:42.220781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:42.286781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:42.294534 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9bf25e1c-b881-4c54-b1df-24c23a259995 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1243 microversion: 2.1 time: 0.089827 Oct 04 22:18:42.295138 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3575/7046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:42 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:43.318063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:43.327101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:43.328631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:43.329129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:43.329579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:43.330317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:43.330797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:43.331236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:43.392924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:43.400630 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe5e47ae-9d14-4f58-9bc6-9cfab3f8b30d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1291 microversion: 2.1 time: 0.086719 Oct 04 22:18:43.401196 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3472/7047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:43 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:44.425617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:44.426235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:44.432683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.433262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.433709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.434423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:44.434910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:44.435347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:44.668794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:44.668794 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75b54c84-fad8-46c0-be0b-7e7043dbfe12 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.245223 Oct 04 22:18:44.668794 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3576/7048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:44 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:45.439320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:45.451056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:45.454427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:45.454427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:45.465983 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] Creating event network-changed:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h2-851029-13 Oct 04 22:18:45.471400 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b9cf732c-c5dd-4ac6-9057-9acdbea223db req-64510f60-48c0-4c74-9dae-a2aac58887c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035995 Oct 04 22:18:45.472047 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3473/7049] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:45.689927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:45.690540 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:45.697777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:45.698217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:45.698681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:45.699381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:45.699838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:45.700259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:45.908024 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:45.915985 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d44eb0da-cd1a-429e-a6ce-c536485c88ef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.230288 Oct 04 22:18:45.916636 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3577/7050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:45 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:46.941862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:46.942568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:46.948796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.949321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.949770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:46.950472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:46.950966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:46.951400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:47.090914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:47.098606 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98f868b3-6bee-4cc2-b89f-859a52b31bdb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.162087 Oct 04 22:18:47.099210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3474/7051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:46 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:48.123726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:48.124322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:48.130993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:48.131478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:48.131924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:48.132613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:48.133076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:48.133503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:48.262993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:48.270685 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd900bd4-bf78-4164-ac22-034b0d494f03 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.151673 Oct 04 22:18:48.271266 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3578/7052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:48 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:49.293413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:49.294067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:49.301967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:49.302578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:49.303072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:49.303775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:49.304237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:49.304673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:49.436919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:49.445039 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff4436cc-b274-425f-b9b3-75776c8df03c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.155471 Oct 04 22:18:49.445619 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3475/7053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:49 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:50.469130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:50.469748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:50.476953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:50.477434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:50.477865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:50.478559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:50.479035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:50.479459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:50.609708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:50.618141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-503890c9-75fb-4488-9bed-3a14b8b125b7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.153341 Oct 04 22:18:50.618757 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3579/7054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:50 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:51.641578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:51.642356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:51.645261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:51.650201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.654687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.654687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.654687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.654687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.654687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.787915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:51.795899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58595257-d0aa-4bd8-adb8-576d6489a34d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.158237 Oct 04 22:18:51.796488 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3476/7055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:51 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:51.884661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "name": "network-vif-plugged", "status": "completed", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:51.890203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:51.891713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:18:51.897074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:51.897528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:51.898118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:51.909729 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] Creating event network-vif-plugged:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h2-851029-13 Oct 04 22:18:51.914854 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-911e7e93-68c5-4e48-bfea-f02194e0fc32 req-4a7d3d35-7419-4e9f-9309-191591ae9f72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033986 Oct 04 22:18:51.915443 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3580/7056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:18:52.819262 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:52.819897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:52.826912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:52.827340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:52.828276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:52.828982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:52.829447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:52.829884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:52.957263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:52.965007 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f79b1126-54f7-420f-8c2f-285247b77867 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1365 microversion: 2.1 time: 0.149609 Oct 04 22:18:52.965599 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3477/7057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:52 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:53.989625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:53.990272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:53.997965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:53.998441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:53.998911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.000104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:54.000552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:54.000976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.137369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:18:54.145069 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9eb34d52-fef4-4b5d-bcc1-55f354140697 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1551 microversion: 2.1 time: 0.160284 Oct 04 22:18:54.145657 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3581/7058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:18:53 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:18:54.167497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:18:54.168060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:18:54.175645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:54.176152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:54.176608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.177337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:54.177804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:54.178243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:54.262130 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55f2a799-9ed8-4432-a704-118ac5fe64e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098525 Oct 04 22:18:54.262792 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3478/7059] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:18:54 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:18:55.614581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:18:55.625332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:18:55.625910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:18:55.626234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:18:55.637440 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] Creating event network-changed:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h2-851029-13 Oct 04 22:18:55.643218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7384c182-c151-467a-aae7-fee523e3632c req-3f948cb5-28e1-4568-960f-87b9870fe713 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032183 Oct 04 22:18:55.643810 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3582/7060] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:30.556913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=23 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.557807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=79,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.562431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:30.568603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:30.569125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:30.569574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:30.593508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Going to try to stop instance {{(pid=123542) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:19:30.984412 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-89c246d6-b2d5-4332-8fbc-d6102d21ed23 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action" status: 202 len: 0 microversion: 2.1 time: 0.429225 Oct 04 22:19:30.984958 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3479/7061] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:19:30 2022] POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:19:30.991906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.992867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=52 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:30.997150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:30.997862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:31.004204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:31.004693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:31.005134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:31.005843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:31.006690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:31.006885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:31.218900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:31.227218 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a3ab6389-0917-4b11-9f19-66756680b7bf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.237145 Oct 04 22:19:31.227852 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3583/7062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:30 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:32.252491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:32.253206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:32.260695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.261255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.261656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.262373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:32.262879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:32.263370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:32.454847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:32.462750 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-03203276-aa23-4959-bf9d-67facdf82d3a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.214932 Oct 04 22:19:32.463356 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3480/7063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:32 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:33.489298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:33.489918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:33.498115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:33.498596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:33.499059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:33.499757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:33.500208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:33.500635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:33.635297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:33.643166 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9891ac3-a405-4d58-997c-b03fce317264 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.157786 Oct 04 22:19:33.643762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3584/7064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:33 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:34.666881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:34.667587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:34.674874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:34.675373 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:34.675823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:34.676538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:34.677006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:34.677444 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:34.808149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:34.816683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b44187d-bbc6-4db0-bca7-733c637dfc81 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.153760 Oct 04 22:19:34.817261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3481/7065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:34 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:35.841042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:35.841604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:35.848361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:35.848835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:35.849271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:35.849953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:35.850404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:35.850859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:35.997130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:35.998992 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-354e8caf-3118-4eb7-b5f1-10863ecab797 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.162551 Oct 04 22:19:35.999583 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3585/7066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:35 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:37.025589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:37.026217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:37.034026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:37.034524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:37.035008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:37.035722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:37.036192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:37.036634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:37.168442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:37.176269 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e26f92ed-2f73-44cf-87a9-b837be77da60 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.154678 Oct 04 22:19:37.176838 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3482/7067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:37 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:38.200962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:38.201595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:38.208571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:38.209064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:38.209509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:38.210216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:38.210709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:38.211151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:38.352575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:38.360593 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8fa8957-7746-4f2e-9f82-d7da39c5fb2b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.164098 Oct 04 22:19:38.361169 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3586/7068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:38 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:39.383454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:39.384219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:39.391097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:39.391645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:39.392105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:39.392812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:39.393280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:39.393723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:39.525916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:39.534417 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8efe504-4727-47ed-8ef1-4bb95d2931e5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.154886 Oct 04 22:19:39.535046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3483/7069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:39 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:40.557573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:40.558263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:40.566008 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:40.566488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:40.566943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:40.567635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:40.568087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:40.568505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:40.703812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:40.712084 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d687dcd-b5f9-4a3e-b82c-b0be0eafe45c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.158551 Oct 04 22:19:40.712683 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3587/7070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:40 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:41.736448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:41.737105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:41.744186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.744681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.745130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:41.745843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:41.746313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:41.746783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:41.884813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:41.890054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3255b4f0-09ed-494f-b062-0b51e03bd471 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.158127 Oct 04 22:19:41.890642 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3484/7071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:41 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:42.913557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:42.914083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:42.921656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:42.922133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:42.922568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:42.923283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:42.923735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:42.924156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:43.052737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:43.060616 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e544089-250f-49ef-9b12-4a829c9a72c2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.151051 Oct 04 22:19:43.061196 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3588/7072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:42 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:44.084159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:44.084794 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:44.090859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:44.091352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:44.091795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:44.092496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:44.092957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:44.093398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:44.225028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:44.233650 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7526ba3a-6b23-440d-8339-e6a54ce85158 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.153608 Oct 04 22:19:44.234350 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3485/7073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:44 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:45.258241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:45.258879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:45.265261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.265738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.266171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.266885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:45.267337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:45.267765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:45.401228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:45.409789 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a195e96d-0cf4-4fa1-9063-67f033427de2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.155987 Oct 04 22:19:45.410499 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3589/7074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:45 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:46.433403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:46.434054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:46.442004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:46.442502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:46.442975 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:46.443691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:46.444156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:46.444597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:46.583483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:46.587797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-642183b1-49d9-4a60-9395-189838c450d4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.158310 Oct 04 22:19:46.588385 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3486/7075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:46 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:47.611489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:47.612103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:47.614918 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:19:47.615066 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c (ip 10.222.0.36) !!! Oct 04 22:19:47.621373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.621851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.622286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.623049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.623482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.624617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.763810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:47.772164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f28ff2c3-2dae-47f1-89de-268a1538e663 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1655 microversion: 2.1 time: 0.164641 Oct 04 22:19:47.772741 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3590/7076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:47 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:47.794919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:47.797224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:47.799730 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:19:47.799875 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action (ip 10.222.0.36) !!! Oct 04 22:19:47.808070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.808568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.809015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.809729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:47.810195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:47.810631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:47.839573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:47.845542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:19:47.852031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:19:47.852456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:19:47.852937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:19:47.853355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:19:47.853776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:19:48.052178 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02acf436-94e1-4155-bbb4-a0d59b9446a4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action" status: 202 len: 0 microversion: 2.1 time: 0.261066 Oct 04 22:19:48.052809 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3487/7077] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:19:47 2022] POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:19:48.061150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:48.061797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:48.068266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:48.068761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:48.069254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:48.069995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:48.070449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:48.070906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:48.206044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:48.214065 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ade6fde9-7325-4d32-8ad2-54fc46f7f4e0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.156839 Oct 04 22:19:48.220873 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3591/7078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:48 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:49.239029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:49.239706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:49.246779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:49.247286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:49.247732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:49.248454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:49.248934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:49.249372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:49.381938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:49.390897 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-99b069e8-531a-42ed-b57b-e025134bbe89 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.157192 Oct 04 22:19:49.391604 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3488/7079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:49 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:50.415284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:50.415914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:50.423841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:50.424328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:50.424768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:50.425474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:50.425931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:50.426388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:50.568148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:50.576732 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c7e08b1-cca1-4f1c-8c4b-f90dd0db43db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1678 microversion: 2.1 time: 0.165040 Oct 04 22:19:50.576978 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3592/7080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:50 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:51.600298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:51.600924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:51.608238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:51.608741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:51.609225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:51.609955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:51.610455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:51.610926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:51.739817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:51.747739 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aeb8a344-3379-43ce-b2e6-52d580f8b386 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1683 microversion: 2.1 time: 0.151391 Oct 04 22:19:51.748310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3489/7081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:51 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:52.771298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:52.771953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:52.778908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:52.779397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:52.779845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:52.780548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:52.781003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:52.785588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:52.918614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:52.927324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3657e525-640d-4c21-b4ff-c67a99154847 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1683 microversion: 2.1 time: 0.159929 Oct 04 22:19:52.927917 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3593/7082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:52 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:53.950765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:53.951379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:53.958598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:53.964866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:53.964866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:53.964866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:53.964866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:53.964866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:54.096427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:54.104408 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb6c3749-700f-48af-aad1-57f6a705aca6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1682 microversion: 2.1 time: 0.157591 Oct 04 22:19:54.105010 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3490/7083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:53 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:54.219479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "name": "network-vif-unplugged", "status": "completed", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:54.229038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:54.229508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:54.229937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:54.242630 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Creating event network-vif-unplugged:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h1-851029-13 Oct 04 22:19:54.247947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:19:54.259639 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f9d33a9a-6241-42fc-bad3-2b68a65736fc req-9b05bac0-1e08-4b54-85ed-9f8ec2f46a1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100381 Oct 04 22:19:54.260269 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3594/7084] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:55.129074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:55.133687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:55.136737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:55.137294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:55.137746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:55.138457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:55.138949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:55.139462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:55.277895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:55.286704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bf1c4f5-6b97-4669-bd2d-f79694b74bf9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1682 microversion: 2.1 time: 0.161572 Oct 04 22:19:55.287310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3491/7085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:55 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:56.276816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:56.286875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:56.287349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:56.287780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:56.302710 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Creating event network-changed:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h1-851029-13 Oct 04 22:19:56.308672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:19:56.310416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:56.311068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:56.317944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:56.318438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:56.319156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:56.319822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:56.320211 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d628a37d-fa1b-4dc8-9831-0ec21e320a08 req-321e3802-01a3-4d63-8749-c6e59951c5a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048273 Oct 04 22:19:56.320331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:56.320713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:56.320863 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3595/7086] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:19:56.530845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:56.539169 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2621e174-7cad-49f9-965d-dbc95efd5e14 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1680 microversion: 2.1 time: 0.233400 Oct 04 22:19:56.539755 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3492/7087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:56 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:19:57.565154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:57.565893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:57.572809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:57.573234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:57.573677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:57.574380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:57.574873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:57.575774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:57.711527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:57.720039 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a322891-da9c-4205-812e-7dce0a133802 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1680 microversion: 2.1 time: 0.160305 Oct 04 22:19:57.720627 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3596/7088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:57 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:58.742478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:58.743124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:58.750083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:58.750570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:58.751043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:58.751782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:58.752245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:58.752730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:58.756705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:19:58.888411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:58.896839 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f9f2294-4104-4d40-9b7d-7eac358741da tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1676 microversion: 2.1 time: 0.158410 Oct 04 22:19:58.897406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3493/7089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:58 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:19:58.920382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:19:58.920958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:58.928526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:58.929002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:58.929433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:58.930124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:58.930603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:58.931413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:59.173432 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c462e3a-ddca-4c7a-aaf2-07a59ced0076 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action" status: 204 len: 0 microversion: 2.1 time: 0.256914 Oct 04 22:19:59.174265 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3597/7090] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:19:58 2022] POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:19:59.182956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:19:59.188174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:19:59.190242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:59.190783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:59.191230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:59.191943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:19:59.192409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:19:59.192841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:19:59.342094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:19:59.351021 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-242696f0-5162-445c-a25e-053f762f2146 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1676 microversion: 2.1 time: 0.172269 Oct 04 22:19:59.355513 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3494/7091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:19:59 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:00.376374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:00.377121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:00.384173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:00.384705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:00.385154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:00.385851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:00.386315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:00.386772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:00.532020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:00.540235 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de1e6c19-ee10-4add-b82d-ac7bc70b2f6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1676 microversion: 2.1 time: 0.168165 Oct 04 22:20:00.544985 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3598/7092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:00 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:01.566326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:01.572756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:01.572756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:01.574802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:01.575310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:01.575759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.576487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:01.577426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:01.577548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.716194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:01.724592 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac554740-5a82-4aab-88f3-13f9e77a2fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1655 microversion: 2.1 time: 0.162895 Oct 04 22:20:01.725275 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3495/7093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:01 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:01.747128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:01.747744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:01.755147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:01.755634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:01.756072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.756795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:01.757248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:01.757667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.760511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:01.889230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:01.897806 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18081bd8-3086-4545-901f-57919d71444b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1655 microversion: 2.1 time: 0.154527 Oct 04 22:20:01.898497 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3599/7094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:01 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:01.920141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:01.926315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:01.926928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:01.932349 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:01.950012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Going to try to start instance {{(pid=123542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:20:02.131740 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d79d70b4-bfa7-4e21-9300-216e91319bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action" status: 202 len: 0 microversion: 2.1 time: 0.215326 Oct 04 22:20:02.132394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3496/7095] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:20:01 2022] POST /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:20:02.140658 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.150123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.150754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.289381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:02.298766 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-81c7da3d-0742-449b-8578-4c28bedd0aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1664 microversion: 2.1 time: 0.161799 Oct 04 22:20:02.304613 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3600/7096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:02 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:02.448362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "name": "network-vif-plugged", "status": "completed", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:02.459385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:02.459723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:02.460269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:02.472561 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] Creating event network-vif-plugged:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h1-851029-13 Oct 04 22:20:02.477671 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c9906551-8e78-4767-82b4-39f725446bb8 req-65444461-98ba-4a40-8259-38e0f7ea7d60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Oct 04 22:20:02.478288 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3497/7097] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:03.323308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:03.323921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:03.331618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:03.332095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:03.332601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:03.333327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:03.333777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:03.334204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:03.467398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:03.475924 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80bffd9f-0573-459b-b0bf-151bbf4ffb0a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1664 microversion: 2.1 time: 0.156461 Oct 04 22:20:03.476528 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3601/7098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:03 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:04.499810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:04.501054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:04.508114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.510835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.510835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.510835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.510835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.510835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.647001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:04.655098 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bca863b6-4f00-4510-bb60-e6b152d5a784 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1668 microversion: 2.1 time: 0.159581 Oct 04 22:20:04.655683 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3498/7099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:04 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:04.678706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:04.679243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:04.681856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:04.686760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.687283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.687744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.688438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:04.689149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:04.689575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:04.715145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:20:05.065973 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83227fec-f4a6-4de6-8e1d-a690fbd87955 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 204 len: 0 microversion: 2.1 time: 0.390905 Oct 04 22:20:05.066585 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3602/7100] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:20:04 2022] DELETE /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:20:05.074870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:05.075493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:05.082428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:05.082981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:05.083436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:05.084154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:05.084627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:05.085073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:05.214393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:05.228636 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40494d0c-24ef-4c83-a72e-d138f1f83978 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1674 microversion: 2.1 time: 0.157338 Oct 04 22:20:05.229866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3499/7101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:05 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:06.253786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:06.254600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:06.262185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:06.262645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:06.263146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:06.263832 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:06.264283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:06.264707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:06.400771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:06.409655 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9386c540-856e-41bc-ac48-c8c152baaa16 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1674 microversion: 2.1 time: 0.160858 Oct 04 22:20:06.410348 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3603/7102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:06 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:07.263045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16b5aa7-1797-4aae-b115-ebb0c41f972c", "name": "network-vif-deleted", "tag": "9bfc49d4-222b-4d45-9c2e-a51b9caef5d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:07.273533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:07.274089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:07.274536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:07.286578 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] Creating event network-vif-deleted:9bfc49d4-222b-4d45-9c2e-a51b9caef5d5 for instance b16b5aa7-1797-4aae-b115-ebb0c41f972c on n-h1-851029-13 Oct 04 22:20:07.291852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-bda7e1fc-9a2c-45fa-8ea4-a6745f4ca0d4 req-a8a90f7d-1cb5-42e7-9a64-40d1a7163fe2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032476 Oct 04 22:20:07.292468 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3500/7103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:07.434077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:07.434776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:07.454483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:07.455093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:07.455541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:07.456256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:07.456720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:07.457154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:07.536080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:07.544580 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3e1b6d1-75a9-4931-a28d-0348a1cd5ee8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 200 len: 1324 microversion: 2.1 time: 0.114483 Oct 04 22:20:07.545171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3604/7104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:07 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 1324 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:08.570266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:08.571002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:08.577332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:08.577830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:08.578284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:08.579028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:08.579490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:08.579927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:08.593895 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c HTTP/1.1 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b16b5aa7-1797-4aae-b115-ebb0c41f972c'} Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:08.595580 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7a37ed6-875b-4f84-92d4-838657a860d6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 404 len: 111 microversion: 2.1 time: 0.031868 Oct 04 22:20:08.600695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3501/7105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:08 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:20:08.615957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:08.616621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:08.623581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:08.624066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:08.624524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:08.625201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:08.625706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:08.626082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:08.639799 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c HTTP/1.1 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b16b5aa7-1797-4aae-b115-ebb0c41f972c'} Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:20:08.641452 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:20:08.646380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f358768d-1c8f-410e-b882-ac3f5e096833 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 404 len: 111 microversion: 2.1 time: 0.030910 Oct 04 22:20:08.647280 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3605/7106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:08 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:20:08.691587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2047863711", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a0d3f422-b3d4-46a6-9749-28d4d805e163"}], "security_groups": [{"name": "tempest-securitygroup--1177214885"}], "key_name": "tempest-keypair-1098758715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:08.795809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] validate_networks() for [('a0d3f422-b3d4-46a6-9749-28d4d805e163', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:20:09.221166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:20:09.221638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:20:09.222124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:20:09.222547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:20:09.223008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:20:09.231886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:09.235409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:09.235409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:09.235409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:09.235409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:09.235409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:09.251842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:20:09.257181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:20:09.270083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:20:09.272447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:20:09.405157 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-641d617a-c80b-457c-86ff-57505374a0e4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717586 Oct 04 22:20:09.405818 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3502/7107] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:20:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:20:09.417729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9264e5c-d9bd-4533-b7cf-8aba5d71566c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:09.418415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9264e5c-d9bd-4533-b7cf-8aba5d71566c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:09.474286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9264e5c-d9bd-4533-b7cf-8aba5d71566c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:09.481182 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9264e5c-d9bd-4533-b7cf-8aba5d71566c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1239 microversion: 2.1 time: 0.067422 Oct 04 22:20:09.481778 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3606/7108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:09 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:10.505733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba62fe16-e7ff-4c37-bf66-ce71de5d82f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:10.506300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ba62fe16-e7ff-4c37-bf66-ce71de5d82f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:10.568757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba62fe16-e7ff-4c37-bf66-ce71de5d82f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:10.576677 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba62fe16-e7ff-4c37-bf66-ce71de5d82f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1239 microversion: 2.1 time: 0.075681 Oct 04 22:20:10.577043 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3503/7109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:10 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:11.600740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:11.601359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:11.609164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:11.615591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:11.615591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:11.615591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:11.615591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:11.615591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:11.673966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:11.681898 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0d80428-9222-43e6-8838-8d6f782a4aea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1291 microversion: 2.1 time: 0.085060 Oct 04 22:20:11.682475 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3607/7110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:11 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1291 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:12.706035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:12.706700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:12.714872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:12.714872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:12.714872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:12.715524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:12.715732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:12.716068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:12.906390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:12.914349 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-136da16c-f4e8-4179-a295-1d99d2b51ee2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.212850 Oct 04 22:20:12.914963 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3504/7111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:12 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:13.689460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:13.700546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.701039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.701472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:13.712922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] Creating event network-changed:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:20:13.717962 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-be01e6d0-5cea-422b-8142-532546bcea42 req-9d00c239-240c-4f24-901d-e60e7d081d9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033291 Oct 04 22:20:13.719156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3608/7112] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:13.942759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:13.943850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:13.950442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.950981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.951442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:13.952175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:13.953186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:13.953634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:14.160604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:14.168452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-102b4479-a9a5-4611-a600-c4bbecc0af98 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.232153 Oct 04 22:20:14.169045 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3505/7113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:13 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:15.194376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:15.195086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:15.201284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:15.201761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:15.202193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:15.203613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:15.204069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:15.204496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:15.338845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:15.346816 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99e5bf4c-04f9-41b3-973a-fd7ff7bd4a27 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.158311 Oct 04 22:20:15.347442 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3609/7114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:15 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:16.369879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:16.370509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:16.377367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:16.377859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:16.378310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:16.379039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:16.379501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:16.379936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:16.516939 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:16.524846 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c85d8225-74d8-4581-8343-dc2cf90f346f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.158993 Oct 04 22:20:16.525424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3506/7115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:16 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:17.549025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:17.549670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:17.557200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:17.557701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:17.558170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:17.559117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:17.559597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:17.559942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:17.695729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:17.704060 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49acdfdc-c8f0-4d14-b7c8-1fd6832bebc1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.159160 Oct 04 22:20:17.704637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3610/7116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:17 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:18.727650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:18.728279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:18.735615 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.743311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.743311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.743311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:18.743311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:18.743311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:18.869954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:18.877769 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb449d4a-930b-404e-bf3f-5c7431bd2bad tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.153940 Oct 04 22:20:18.878356 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3507/7117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:18 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:19.901839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:19.902469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:19.905339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:19.910193 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:19.910703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:19.911129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:19.911811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:19.912261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:19.912679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:20.051272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:20.059289 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-486860ec-0ead-46ca-8288-2e65abbd8ff8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.161644 Oct 04 22:20:20.059872 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3611/7118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:19 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:20.400517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-plugged", "status": "completed", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:20.405806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:20.412652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:20.413154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:20.413654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:20.425923 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] Creating event network-vif-plugged:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:20:20.431063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-db95c042-902b-408a-9b84-bbd323e16312 req-73635762-50e2-4253-bc6b-47bada1f1c56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034363 Oct 04 22:20:20.431667 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3508/7119] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:21.083999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:21.084612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:21.091485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:21.091969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:21.092410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:21.093101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:21.093554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:21.094066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:21.227761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:21.237869 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22d64fcf-413e-4e27-b915-7e921a0a68a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1365 microversion: 2.1 time: 0.155564 Oct 04 22:20:21.237869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3612/7120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:21 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:22.256783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:22.262083 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.266877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:22.269118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.269617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.270071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.270812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.271286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.271730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.404160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:22.410816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1cda1c6-74c2-4c47-98a0-650d54ffae1f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1552 microversion: 2.1 time: 0.154978 Oct 04 22:20:22.411406 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3509/7121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:22 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:22.440499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:22.441103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:22.448272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.448753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.449190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.449883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:22.450336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:22.450785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:22.527750 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-259a7f0e-055a-47df-a821-29fe69ac158e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091966 Oct 04 22:20:22.528397 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3613/7122] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:20:22 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:23.517978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:23.528437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:23.528924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:23.529365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:23.540850 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] Creating event network-changed:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:20:23.546543 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0dbc3af1-1ccd-45c9-82ab-36debc2dc21e req-32887a8b-cb89-4700-9082-7c073e33e8c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032845 Oct 04 22:20:23.547291 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3510/7123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:20:56.425372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:56.426150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:56.430214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:20:56.432565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:56.438796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.445212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.445212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.445212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.445212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.445212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.473046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:56.481216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Old instance type m1.heat2, new instance type m1.heat {{(pid=123541) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:20:56.489528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:20:56.490572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:20:56.491154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:20:56.491574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:20:56.491991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:20:56.770332 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d2f9c89b-c651-4426-8bd6-3a4db72ef898 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/action" status: 202 len: 0 microversion: 2.1 time: 0.346898 Oct 04 22:20:56.771007 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3614/7124] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:20:56 2022] POST /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:20:56.778269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:56.780867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:20:56.783598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:56.784487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:56.791027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.791514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.791959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.792749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:56.793214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:56.793704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:56.929744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:56.937671 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-544de92d-63a5-4367-bde1-43e1c3e53beb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1678 microversion: 2.1 time: 0.161951 Oct 04 22:20:56.941402 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3511/7125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:56 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:57.962772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:57.963325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:57.973980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:57.974518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:57.975007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:57.975716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:57.976182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:57.976621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:58.124549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:58.133475 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-585232a8-dedd-4786-a683-5c061caa5319 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1678 microversion: 2.1 time: 0.176122 Oct 04 22:20:58.134089 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3615/7126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:57 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:20:59.159180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:20:59.159761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:20:59.167677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:59.168181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:59.168630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:59.169383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:20:59.169850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:20:59.170291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:20:59.308981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:20:59.317385 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-087db363-5985-4d9b-a4fa-5efa7aff5a66 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1678 microversion: 2.1 time: 0.162966 Oct 04 22:20:59.318475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3512/7127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:20:59 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:00.341480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:00.342089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:00.349105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:00.350136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:00.350570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:00.351288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:00.351744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:00.352170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:00.493470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:00.502036 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3f2e927e-86f0-4d00-97c1-6491c7bdccbe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.164392 Oct 04 22:21:00.502637 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3616/7128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:00 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:01.525943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:01.526592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:01.533489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:01.533974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:01.534418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:01.535140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:01.535600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:01.536030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:01.672768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:01.680796 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-200dc754-c36f-4a1c-820a-0eb5be5f972d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.158726 Oct 04 22:21:01.681376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3513/7129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:01 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:02.704791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:02.705432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:02.714152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:02.714656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:02.715141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:02.715856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:02.716310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:02.716738 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:02.853668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:02.861775 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5712bddc-e3e5-434e-a39a-d9b48cc4154d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.161104 Oct 04 22:21:02.862357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3617/7130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:02 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:03.884974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:03.885595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:03.892609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:03.893106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:03.893554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:03.894268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:03.894778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:03.895222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:04.028732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:04.039160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8713068-75e4-4280-a210-90e7a9d39059 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.158085 Oct 04 22:21:04.039758 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3514/7131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:03 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:05.062498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:05.067588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:05.071148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.071634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.072070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.072764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:05.073219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:05.073644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:05.209159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:05.216254 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e747a06d-569d-4952-8930-ccf6b36c7b99 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.157621 Oct 04 22:21:05.216844 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3618/7132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:05 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:06.239183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:06.240301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:06.247619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:06.248116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:06.248564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:06.249272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:06.249743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:06.250211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:06.384047 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:06.392467 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3e6105b-3926-4a60-bea3-79f2df96d4b2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.157207 Oct 04 22:21:06.393086 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3515/7133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:06 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:07.415937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:07.416471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:07.423434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:07.423913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:07.424374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:07.425046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:07.425504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:07.426006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:07.563395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:07.572693 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8bb0ffd-d0f5-430d-bf51-075c8077b7e1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.160748 Oct 04 22:21:07.573288 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3619/7134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:07 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:08.597018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:08.597649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:08.604810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:08.605304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:08.605760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:08.606466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:08.606964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:08.607406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:08.741716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:08.749635 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a3fe96ac-58aa-4367-a67a-974550e6a12b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.156618 Oct 04 22:21:08.750207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3516/7135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:08 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:09.774075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:09.774709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:09.781603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:09.782083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:09.782513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:09.783230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:09.783686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:09.784107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:09.917569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:09.925493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee52c20f-1305-4292-bd01-2f344279e739 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.155941 Oct 04 22:21:09.926144 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3620/7136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:09 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:10.949540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:10.950103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:10.957061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:10.957554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:10.957999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:10.958761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:10.959228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:10.959664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:11.103016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:11.111340 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cca91a3-6981-4da3-bb7b-2a15b19598ff tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.165751 Oct 04 22:21:11.111940 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3517/7137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:10 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:12.137672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:12.138501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:12.146114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.146628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.147115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.147819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:12.148280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:12.148715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:12.291990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:12.299925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1684fa70-916f-4147-97e2-1b9138e02de3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.167287 Oct 04 22:21:12.300517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3621/7138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:12 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:13.324322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:13.324861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:13.331445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:13.331944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:13.332394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:13.333117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:13.333586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:13.334027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:13.476049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:13.484653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aee1264c-c8f3-4ef6-86a4-faa7ec4f1e31 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.164356 Oct 04 22:21:13.485234 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3518/7139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:13 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:14.511863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:14.517202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:14.520039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:14.520937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:14.521715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:14.522994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:14.523717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:14.524199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:14.671624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:14.680865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b46728fc-87e1-4a65-8ef9-933c2e10d54f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.172958 Oct 04 22:21:14.681460 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3622/7140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:14 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:15.718449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:15.719296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:15.726752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:15.727257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:15.727703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:15.728425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:15.728885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:15.729318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:15.873565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:15.881841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9dc76447-b1cf-4536-b529-0abf5fbffff5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.167449 Oct 04 22:21:15.882447 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3519/7141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:15 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:17.009961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:17.130910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:17.139418 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e716bf7-418e-4ec2-a71c-c39e9f843670 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1683 microversion: 2.1 time: 0.237730 Oct 04 22:21:17.140024 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3623/7142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:16 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:18.164673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:18.165422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:18.173229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.173745 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.174268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.175111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.175681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.176141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.325838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-unplugged", "status": "completed", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:18.332208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:18.343065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:18.346772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:18.346772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:18.347156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad525f8f-ec97-42ed-866f-90c89d897af9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1682 microversion: 2.1 time: 0.184270 Oct 04 22:21:18.347156 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3520/7143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:18 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:18.368714 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Creating event network-vif-unplugged:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h1-851029-13 Oct 04 22:21:18.377985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] Instance 8db4883d-42fa-425e-ad30-46c0346a722a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:21:18.390004 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2092fecc-fb80-43ab-b30b-ed540c055631 req-be1b4e0a-2cf2-4012-b89f-44481be8eaab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068956 Oct 04 22:21:18.390689 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3624/7144] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:19.370453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:19.376260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:19.379764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.380313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.380941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.381640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:19.382162 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:19.382620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:19.535284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:19.544433 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5234c4bd-d549-41a3-9acf-c4f312bb5ce4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1682 microversion: 2.1 time: 0.178143 Oct 04 22:21:19.545023 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3521/7145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:19 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:20.406916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:20.416951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:20.417455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:20.417896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:20.430865 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Creating event network-changed:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h1-851029-13 Oct 04 22:21:20.436663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] Instance 8db4883d-42fa-425e-ad30-46c0346a722a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:21:20.448952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a7c6bcab-4701-46b6-a255-4c133c210266 req-d5eba3ee-430e-430e-a913-21ec3e1d6252 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047052 Oct 04 22:21:20.449610 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3625/7146] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:20.568723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:20.569346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:20.580430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:20.580430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:20.580430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:20.580430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:20.580430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:20.581128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:20.815419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:20.823613 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48dd21fd-3a9b-48a5-ba95-96508b080ebc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1680 microversion: 2.1 time: 0.259086 Oct 04 22:21:20.824210 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3522/7147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:20 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:21.848957 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:21.849703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:21.855675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:21.856154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:21.856597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:21.857295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:21.857750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:21.858180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:21.999361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:22.008144 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3da96dc4-b598-49de-86ae-53d8cdda4bc2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1680 microversion: 2.1 time: 0.164814 Oct 04 22:21:22.008735 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3626/7148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:21 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:23.031598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:23.032233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:23.040343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.041060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.041547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.042327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.042848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.043318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.178899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:23.186991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0bd48cd1-9aed-4025-ab64-27fcef5cd30e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1677 microversion: 2.1 time: 0.159266 Oct 04 22:21:23.187504 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3523/7149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:23 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:23.210730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:23.211302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:23.218144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.218618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.219084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.219781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.220475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.220655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.259146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.259627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.260067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.260789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.261241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.261666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.282441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:21:23.287786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:21:23.459530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:23.795020 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6cb4cf95-5c06-4b77-81e2-afb4861d0a09 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/action" status: 202 len: 0 microversion: 2.1 time: 0.588613 Oct 04 22:21:23.795716 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3627/7150] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:21:23 2022] POST /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:21:23.804152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:23.804917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:23.811430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.811928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.812385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.813125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:23.813597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:23.814037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:23.954822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:23.962744 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e259ef64-0f26-4050-ac11-11626b6f6f5b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.162573 Oct 04 22:21:23.963329 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3524/7151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:23 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:24.986819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:24.987611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:24.998173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:24.998614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:24.999106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:24.999809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:25.000262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:25.000684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:25.133688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:25.141398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b778478-e056-4b6e-858e-35ebf2ebac52 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.159780 Oct 04 22:21:25.141980 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3628/7152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:24 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:26.164500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:26.165186 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:26.172185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.172676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.173132 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.173833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.174309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.174767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.311127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:26.320174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b46a8d79-b351-413a-bdda-c5395a81c491 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.158844 Oct 04 22:21:26.320775 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3525/7153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:26 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:26.897354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-plugged", "status": "completed", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:26.903797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:26.909040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:26.909521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:26.909958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:26.922430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Creating event network-vif-plugged:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h1-851029-13 Oct 04 22:21:26.927696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] Instance 8db4883d-42fa-425e-ad30-46c0346a722a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:21:26.938433 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-77d4bd25-dc15-472f-95d8-475ac180d30f req-24c7a074-f025-4d55-81f6-792c21f268d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044821 Oct 04 22:21:26.939063 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3629/7154] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:27.345468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:27.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:27.498001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:27.506022 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6955e6f5-9de9-42c2-adbe-917eee922d45 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.164550 Oct 04 22:21:27.506610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3526/7155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:27 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:27.990930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-unplugged", "status": "completed", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:28.001579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:28.002055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:28.002482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:28.015005 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Creating event network-vif-unplugged:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:21:28.020242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] Instance 8db4883d-42fa-425e-ad30-46c0346a722a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:21:28.031403 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-e3f7fb78-36c8-4b23-b539-cc42a63149cf req-ce2d0909-7c82-4fe3-926c-f68760c50c4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046500 Oct 04 22:21:28.032003 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3630/7156] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:28.531382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:28.536748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:28.540017 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:28.540519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:28.540967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:28.541689 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:28.542148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:28.542581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:28.565200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:28.679875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:28.687830 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-351e4292-f79c-4b21-9b5d-5317838df728 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.160389 Oct 04 22:21:28.688417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3527/7157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:28 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:29.715242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:29.716062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:29.723628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.724194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.724754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.725544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:29.726043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:29.726628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:29.873900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:29.888884 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01549e27-ea5c-4762-b76c-e42cf638738f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.179792 Oct 04 22:21:29.889879 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3631/7158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:29 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:30.046273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:30.052738 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=35 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:30.059063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:30.059560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:30.060005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:30.075663 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Creating event network-changed:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:21:30.082786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] Instance 8db4883d-42fa-425e-ad30-46c0346a722a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:21:30.094522 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e57049ba-a0b3-453e-b053-7a64e5d1e9b1 req-f97553ff-9734-4cce-b311-3ff47245cd2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052008 Oct 04 22:21:30.095160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3528/7159] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:21:30.929626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:30.931713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:30.941054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:30.941599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:30.942287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:30.943313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:30.944020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:30.945084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:31.184751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:31.199516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9410af18-9183-41c5-be66-e9a21dd4bdbb tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1676 microversion: 2.1 time: 0.276517 Oct 04 22:21:31.200436 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3632/7160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:30 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1676 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:32.226546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:32.227302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:32.234449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.234940 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.235386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.236119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.236586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.237023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.790006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:32.798316 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47b52da0-1751-4d17-ad1a-369480d6e3d9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1669 microversion: 2.1 time: 0.577492 Oct 04 22:21:32.798954 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3529/7161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:32 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1669 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:32.822793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:32.823611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:32.830389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.830914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.831563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.832523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:32.833171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:32.833788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:32.987524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:32.996033 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f70241c5-ce04-488c-ab8b-3bfb96a04b80 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1669 microversion: 2.1 time: 0.177700 Oct 04 22:21:32.999238 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3633/7162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:32 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:33.019110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.019778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.026348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.026896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.027353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.028089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.028562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.029004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.200973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:33.210868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd795dc6-528c-4e65-a69d-c838d6603bea tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1669 microversion: 2.1 time: 0.195605 Oct 04 22:21:33.211786 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3530/7163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:33 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:33.234225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.234884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.241903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.242393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.242890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.243597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.244055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.244488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.270550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:21:33.273656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:33.641753 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-adf34e90-a936-4a1d-a81e-b17749fb7d13 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 204 len: 0 microversion: 2.1 time: 0.411097 Oct 04 22:21:33.642226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3634/7164] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:21:33 2022] DELETE /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:21:33.651985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:33.652928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:33.659674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.660172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.660624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.661338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:33.661799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:33.662278 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:33.809037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:33.818564 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8d51a74d-78b4-499a-85bc-7578f2034d24 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1675 microversion: 2.1 time: 0.171047 Oct 04 22:21:33.824078 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3531/7165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:33 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:34.760390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-plugged", "status": "completed", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:34.780843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.781372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.781884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.796811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] Creating event network-vif-plugged:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:21:34.802431 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f8f50c18-ae25-472c-ba06-63b2c928b381 req-b4862085-4627-4e09-badc-4b4381871cb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050660 Oct 04 22:21:34.803346 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3635/7166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:34.843411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:34.844048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:34.852348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.852850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.853306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:34.854053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:34.854525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:34.855012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:35.083567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:35.094123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6052ca01-992f-43ac-b024-dea45b17fd3c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1675 microversion: 2.1 time: 0.254377 Oct 04 22:21:35.095165 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3532/7167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:34 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:36.060729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db4883d-42fa-425e-ad30-46c0346a722a", "name": "network-vif-deleted", "tag": "70346470-c88b-47b3-b138-3291d6a5922b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:36.071972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.076924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.076924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.086082 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] Creating event network-vif-deleted:70346470-c88b-47b3-b138-3291d6a5922b for instance 8db4883d-42fa-425e-ad30-46c0346a722a on n-h2-851029-13 Oct 04 22:21:36.091767 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-09c12da1-337e-47ab-94ae-e4b251264292 req-d9b2a482-b2d0-478b-ba38-c9d603d43ed3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036444 Oct 04 22:21:36.092509 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3636/7168] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:36.124666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:36.125966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:36.136723 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.137437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.138003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.139110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:36.139512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:36.140023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:36.222170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:36.236230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f26fa063-5796-401c-95e1-68ba6981a2f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 200 len: 1607 microversion: 2.1 time: 0.115094 Oct 04 22:21:36.236230 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3533/7169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:36 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 1607 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:37.258760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:37.259461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:37.266723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.267211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.267645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.268373 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.268823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.269263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a HTTP/1.1 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '8db4883d-42fa-425e-ad30-46c0346a722a'} Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:21:37.288667 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-94bc742c-b778-46cf-a5ff-b549de4940a1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 04 22:21:37.293615 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3637/7170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:37 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:21:37.304092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:37.304718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:37.311725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.312221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.312667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.313460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.313925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.314606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a HTTP/1.1 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8db4883d-42fa-425e-ad30-46c0346a722a'} Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:21:37.335182 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6374e8d9-b86b-4272-bdfc-f1d115eefbe5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 404 len: 111 microversion: 2.1 time: 0.033540 Oct 04 22:21:37.340161 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3534/7171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:37 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:21:37.387034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1995521777", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a0d3f422-b3d4-46a6-9749-28d4d805e163"}], "security_groups": [{"name": "tempest-securitygroup--1177214885"}], "key_name": "tempest-keypair-1098758715", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:37.499780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] validate_networks() for [('a0d3f422-b3d4-46a6-9749-28d4d805e163', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:21:37.931392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:21:37.931827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:21:37.932342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:21:37.932734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:21:37.933154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:21:37.942302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.942856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.943309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.944042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:37.944504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:37.944938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:37.961784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:21:37.967096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:21:37.980006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:21:37.982342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:21:38.102304 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f56c0bce-7de0-4d15-a016-3af69424e22c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719561 Oct 04 22:21:38.103002 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3638/7172] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:21:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:21:38.114533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d43493e2-6c45-4bcf-b4f6-89f74a7361b9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:38.115356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d43493e2-6c45-4bcf-b4f6-89f74a7361b9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:38.171419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d43493e2-6c45-4bcf-b4f6-89f74a7361b9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:38.178469 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d43493e2-6c45-4bcf-b4f6-89f74a7361b9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1239 microversion: 2.1 time: 0.067727 Oct 04 22:21:38.179019 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3535/7173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:38 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:39.201913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:39.202536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:39.210425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.210960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.211401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.212097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:39.212556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:39.212987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:39.274854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:39.285402 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1cf17a97-9e0b-4fde-9335-afd71c6129f3 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1243 microversion: 2.1 time: 0.084889 Oct 04 22:21:39.285402 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3639/7174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:39 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:40.308233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:40.308873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:40.317923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:40.318323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:40.318804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:40.319536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:40.320038 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:40.320450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:40.388214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:40.396686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-197c4862-3412-40e8-8254-69bf5d1e58db tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1291 microversion: 2.1 time: 0.093394 Oct 04 22:21:40.397264 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3536/7175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:40 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1291 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:41.472442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:41.473074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:41.479889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:41.479889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:41.480296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:41.481006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:41.481470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:41.481902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:41.549966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:41.561351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62c01695-1ed9-4e77-acc3-5cfd1cdb8ebe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1297 microversion: 2.1 time: 0.145530 Oct 04 22:21:41.561959 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3640/7176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:41 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:42.585391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:42.586029 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:42.593193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.593694 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.594288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.594896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.595369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.595814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.726446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:42.734161 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0804dd8-1d2f-4bbd-88f4-5c0e3b0ea1fe tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.152663 Oct 04 22:21:42.734759 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3537/7177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:42 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:42.795862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:42.807123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:42.807606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:42.808044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:42.819461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] Creating event network-changed:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:21:42.824968 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5fc0db08-c6ab-4cc6-9364-52e273d63a2c req-a27859eb-e0b1-4c18-bd26-28bc092f4aed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033277 Oct 04 22:21:42.825582 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3641/7178] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:43.757744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:43.758485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:43.764546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.765043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.765488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.766200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:43.766730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:43.767195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:43.900350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:43.908177 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e29da401-2564-4b14-8368-34312b5c3a43 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.154670 Oct 04 22:21:43.908743 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3538/7179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:43 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:44.933062 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:44.933679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:44.940437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:44.940913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:44.941346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:44.942033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:44.942484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:44.942943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:45.075189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:45.083373 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b83d3fd5-d760-40be-b98f-57340895f837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.155227 Oct 04 22:21:45.084308 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3642/7180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:44 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:21:46.105894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:46.106558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:46.113572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.114068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.114528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:46.115279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:46.115752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:46.116194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:46.256480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:46.265830 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-845c3d79-dcde-44f8-988f-27917014dc8f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.163816 Oct 04 22:21:46.266424 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3539/7181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:46 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:47.289576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:47.290934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:47.298023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:47.298507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:47.298968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:47.299673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:47.300130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:47.300575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:47.442938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:47.451732 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b39b55c2-1478-4922-ba92-835668344db5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.165975 Oct 04 22:21:47.452355 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3643/7182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:47 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:48.475436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:48.476086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:48.478915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:48.484183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.484673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.485119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:48.485829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:48.486292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:48.486750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:48.618445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:48.626220 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e01697f-0a42-4eef-9e5d-baf929589659 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.154652 Oct 04 22:21:48.626896 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3540/7183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:48 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:49.046936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-plugged", "status": "completed", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:49.060711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:49.060711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:21:49.060711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:49.060711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:49.060711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.070897 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] Creating event network-vif-plugged:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:21:49.076305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3130e354-c32e-4e63-b7a5-f9a1f118c3ea req-f7d75989-534e-4f89-a2c4-0ba14daa66be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Oct 04 22:21:49.076908 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3644/7184] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:49.649454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:49.650084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:49.657398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:49.657900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:49.658348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.659119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:49.659587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:49.660028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:49.797910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:49.805973 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2e6121e6-912e-4feb-8bf1-7c8ea1586eb1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1365 microversion: 2.1 time: 0.160337 Oct 04 22:21:49.813230 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3541/7185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:49 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:50.832938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:50.833587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:50.840401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.840886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.841323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.842029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:50.842494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:50.842949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:50.984857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:21:50.993354 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c22974e-b43d-4c3d-8163-7d6fbf26535a tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1551 microversion: 2.1 time: 0.166212 Oct 04 22:21:50.993952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3645/7186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:21:50 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:21:51.017465 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:21:51.018267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:21:51.025439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.025953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.026513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:51.027274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:51.027752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:51.028197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:51.108998 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47167fa3-28f5-422f-93a7-97869c1a9b8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095417 Oct 04 22:21:51.109605 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3542/7187] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:21:51 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:21:52.188557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:21:52.199802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:21:52.200505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:21:52.200943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:21:52.212025 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] Creating event network-changed:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:21:52.217590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-16b579c1-8ded-4145-b558-8b58a0b03e4a req-c55672a6-f3b7-4542-a644-2f81e138e355 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032780 Oct 04 22:21:52.218197 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3646/7188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:22:56.703196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:56.703948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=78 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:56.708160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:22:56.708785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:56.714737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.715233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.715682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:56.716389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.716890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.717331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:56.849682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:22:56.857519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f1d2d8a-7036-4e49-bb59-b98bd8c138f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1668 microversion: 2.1 time: 0.157287 Oct 04 22:22:56.858096 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3543/7189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:22:56 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:22:56.878772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:56.879552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:22:56.884131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7226ee81-7d0c-4b30-9b2a-83c15eea9ddf"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:22:56.886532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:22:56.893126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.895479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.895479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:56.895479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:22:56.895479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:22:56.895953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:22:57.862284 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9ef17a3-52e9-45be-9058-2e2622798a3e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985924 Oct 04 22:22:57.862948 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3647/7190] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:22:56 2022] POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:23:09.662337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:09.664664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:09.667514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:09.668191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:09.669204 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:23:09.669370 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action (ip 10.222.0.36) !!! Oct 04 22:23:09.670390 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:23:09.671144 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action (ip 10.222.0.36) !!! Oct 04 22:23:09.678644 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.679541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.679713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:09.680340 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.680810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.681273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:09.712702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:09.718841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Old instance type m1.heat2, new instance type m1.heat {{(pid=123542) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:23:09.726008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:23:09.726445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:23:09.726990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:23:09.727417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:23:09.727847 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:23:09.959353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-73a58a9f-e70d-4f59-b072-89b62dc12aec tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action" status: 202 len: 0 microversion: 2.1 time: 0.300757 Oct 04 22:23:09.959910 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3544/7191] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:23:09 2022] POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:23:09.966265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:09.967210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:09.968579 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:23:09.968715 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 (ip 10.222.0.36) !!! Oct 04 22:23:09.973718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:09.974455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:09.984506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.984989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.985434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:09.986204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:09.986683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:09.987115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:10.125902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:10.134398 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2d7d3ce-4d16-4123-b83a-4a616d8b8920 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1723 microversion: 2.1 time: 0.170028 Oct 04 22:23:10.135009 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3648/7192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:09 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:11.159059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:11.161527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:11.168026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:11.168568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:11.168981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:11.169690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:11.170163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:11.170620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:11.315866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:11.324432 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19ffd106-14bf-465a-9333-e126b16a788e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1723 microversion: 2.1 time: 0.170851 Oct 04 22:23:11.325013 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3545/7193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:11 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:12.350312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:12.350872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:12.358999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.359217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.359525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.360226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:12.360724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:12.361089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:12.495215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:12.503618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e68afc8-b70a-4e75-8ac5-d8dc41fc662d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1723 microversion: 2.1 time: 0.157555 Oct 04 22:23:12.504204 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3649/7194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:12 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:13.527555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:13.528188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:13.534878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.535486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.535947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:13.536670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:13.537146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:13.537590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:13.669441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:13.677759 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a71fb1c-3f98-4fed-be02-444eb080de7e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.154243 Oct 04 22:23:13.678343 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3546/7195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:13 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:14.703541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:14.704186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:14.710811 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.711298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.711737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.712428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:14.712888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:14.713314 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:14.846396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:14.854537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d9c169ba-18c7-4692-b3d9-78cb99b0192c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.155606 Oct 04 22:23:14.855164 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3650/7196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:14 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:15.877533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:15.878156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:15.885108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:15.885598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:15.886039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:15.886764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:15.887229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:15.887663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:16.016996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:16.025244 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-485ca6a4-60ad-4ee5-867d-c26c4fa40cb9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.151694 Oct 04 22:23:16.025857 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3547/7197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:15 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:17.049524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:17.050136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:17.056962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:17.057438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:17.057871 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:17.058557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:17.059036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:17.059460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:17.195652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:17.204313 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ef9b9cc-b735-4d88-8f0f-3e66e87c0c61 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.159210 Oct 04 22:23:17.204932 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3651/7198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:17 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:18.229443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:18.230071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:18.237613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.238098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.238542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:18.239287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:18.239746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:18.240180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:18.369121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:18.377342 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7e09630-b237-444d-9694-676cac741717 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.151800 Oct 04 22:23:18.377920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3548/7199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:18 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:19.400927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:19.401504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:19.408801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.409281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.409742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.410433 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:19.410908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:19.411333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:19.545077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:19.553367 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83ad8e89-dace-4c77-8c0e-82fa3b7a6fa4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.156473 Oct 04 22:23:19.553949 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3652/7200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:19 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:20.577640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:20.578172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:20.585235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:20.585736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:20.586183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.586919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:20.587390 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:20.587829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:20.723710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:20.732372 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfed0fed-97be-40a0-bc3a-9e7b1f929bef tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.159453 Oct 04 22:23:20.733449 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3549/7201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:20 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:21.757050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:21.757919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:21.764989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.765473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.765935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.766632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:21.767102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:21.767528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:21.903805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:21.912704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c82dd8a9-1507-486e-8fb3-6cf42ae81ea2 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.159587 Oct 04 22:23:21.913300 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3653/7202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:21 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:22.936863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:22.937409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:22.944503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.945001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.945451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:22.946158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:22.946625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:22.947093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:23.076437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:23.085241 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db09881f-526a-41b4-a020-7a012291028d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.152387 Oct 04 22:23:23.085815 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3550/7203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:22 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:24.108946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:24.109597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:24.116551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:24.117047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:24.117492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:24.118191 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:24.118651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:24.119110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:24.249664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:24.258391 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e5c7862-e785-4712-9c7a-d90d3a155974 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.153314 Oct 04 22:23:24.259030 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3654/7204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:24 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:25.282289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:25.282969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:25.289719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:25.290206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:25.290652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:25.291376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:25.291842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:25.292275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:25.430293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:25.439520 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8998f1ab-2219-427b-8c33-0e24b6943837 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.160980 Oct 04 22:23:25.440376 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3551/7205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:25 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:26.463797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:26.464589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:26.472267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:26.472756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:26.473196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:26.473901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:26.474353 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:26.474804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:26.613699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:26.622191 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aae9c60c-43b4-474f-8ef1-e2605ff55297 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.162374 Oct 04 22:23:26.622789 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3655/7206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:26 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:27.645604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:27.646443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:27.653317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:27.653820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:27.654276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:27.655019 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:27.655494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:27.655936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:27.792316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:27.800659 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-222f52a6-1ebf-4317-adbd-a6b74a35a5cd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1728 microversion: 2.1 time: 0.159091 Oct 04 22:23:27.801229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3552/7207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:27 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:28.825214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:28.827559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:28.836163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.836804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.837357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.838369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.838909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.839590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.852179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-unplugged", "status": "completed", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:28.863737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:28.864351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:28.864833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:28.883053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Creating event network-vif-unplugged:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h2-851029-13 Oct 04 22:23:28.890691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] Instance f9d0f536-4039-475e-aac9-edcacfe28312 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:23:28.902129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6ef44479-f29f-4735-84eb-fb8cd34e0152 req-d88bc96f-3705-4554-af2b-60e66f8e6dce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134523 Oct 04 22:23:28.902832 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3656/7208] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:28.978351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:28.986733 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7e0cad5-5d0d-4500-9ae8-ad29fef9a20f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1727 microversion: 2.1 time: 0.166164 Oct 04 22:23:28.987304 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3553/7209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:28 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:30.020396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:30.021097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:30.027668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.028214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.028669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.029416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.030090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.030669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.571289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:30.588986 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-076eb5d0-f2a3-4d06-a58c-0e4aadf261a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1727 microversion: 2.1 time: 0.566548 Oct 04 22:23:30.588986 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3657/7210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:30 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1727 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:30.918883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:30.930033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:30.930519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:30.930983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:30.943113 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Creating event network-changed:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h2-851029-13 Oct 04 22:23:30.948510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] Instance f9d0f536-4039-475e-aac9-edcacfe28312 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:23:30.959374 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-85f59c9e-c64d-4397-ac1e-b34beebed598 req-0df54bf1-baf4-4cca-933a-dc61b0c7a255 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 Oct 04 22:23:30.959965 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3554/7211] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:31.610164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:31.611478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:31.618364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.618885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.619329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.620022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:31.620480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:31.620909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:31.757870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:31.766974 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22469873-c9d2-4f0b-911f-c4a3c1938da9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.160630 Oct 04 22:23:31.767581 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3658/7212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:31 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:32.792848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:32.794442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:32.801533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.802045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.802525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.803276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:32.803749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:32.804225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:32.949511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:32.958208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58a8be7d-f6f0-4ec8-9cae-03797af1fa2f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.170876 Oct 04 22:23:32.958819 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3555/7213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:32 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:33.981536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:33.982176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:33.989685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.990166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.990600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:33.991315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:33.991766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:33.992189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:34.128164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:34.140219 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d131ab09-606e-49ff-af29-87820e6107cc tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.162267 Oct 04 22:23:34.141218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3659/7214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:33 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:35.163698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:35.164415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:35.171853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.172630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.173079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.173789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:35.174252 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:35.174774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:35.311194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:35.319753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-38340590-fa99-4d0d-acae-8c0785544723 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.159956 Oct 04 22:23:35.320328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3556/7215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:35 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:36.344464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:36.345077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:36.351983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.352456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.352888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.353575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:36.354025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:36.354450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:36.487751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:36.496224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4790bbfe-eaf5-4a4e-893c-fbf43306275d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.155603 Oct 04 22:23:36.496807 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3660/7216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:36 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:37.520511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:37.521141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:37.527998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.528486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.528931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.535901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:37.535901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:37.535901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:37.662108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:37.670375 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95fd1306-a051-4486-b489-ed4674046e2c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.153735 Oct 04 22:23:37.670994 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3557/7217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:37 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:38.693752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:38.696292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:38.701213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.701689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.702120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.702837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:38.703290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:38.703714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:38.839145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:38.847347 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-218269ea-797d-445e-a2a6-39b6e89c0d93 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.157754 Oct 04 22:23:38.847937 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3661/7218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:38 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:39.871524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:39.872072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:39.874949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:39.879854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.880350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.880809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.881546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:39.882012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:39.882454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:39.885109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:40.020726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:40.025871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-beb6db47-b5f7-4906-84e7-8f5bf08bf735 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.158291 Oct 04 22:23:40.026448 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3558/7219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:39 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:41.049407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:41.050006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:41.052867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=29 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:41.057630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.058106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.058536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.059264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:41.059744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:41.063212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:41.198335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:41.207509 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7f6261b-8d78-4d6e-b857-7c96d7585b85 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.161997 Oct 04 22:23:41.208109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3662/7220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:41 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:42.230424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:42.231113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:42.238613 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.239125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.239567 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:42.240269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:42.240731 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:42.241167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:42.371773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:42.380609 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5bb5fb45-6bb3-41e9-bfca-6e72f49b5f8e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.154075 Oct 04 22:23:42.381186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3559/7221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:42 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:43.404523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:43.405075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:43.411989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:43.412468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:43.412920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:43.413630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:43.414076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:43.414500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:43.417106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=89 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:43.551934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:43.561146 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89e37685-9c3a-4a63-b5cc-a90e350e18b6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1725 microversion: 2.1 time: 0.161233 Oct 04 22:23:43.561722 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3663/7222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:43 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:44.585058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:44.585686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:44.592103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.592592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.593039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.593739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.594212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.594643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.730578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:44.739888 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22c681c4-8c1d-4eaa-83c2-f1f7ccbecd6b tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1722 microversion: 2.1 time: 0.158811 Oct 04 22:23:44.740467 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3560/7223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:44 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:44.819119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:44.819690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:44.826578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.827095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.827538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.828230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.828687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.829115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.866306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.866804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.867247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.867971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:44.868431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:44.868855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:44.889272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:23:44.894403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Getting quotas for user dc51b68e4e714e43b62020fb1562839e and project 2a1bf810e69547a8b1bbe8c593ca3d5d. Resources: {'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:23:45.307129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e111ab6f-456d-4e9c-accf-0b20487d15cf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action" status: 202 len: 0 microversion: 2.1 time: 0.492642 Oct 04 22:23:45.307864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3664/7224] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:23:44 2022] POST /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:23:45.318065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:45.320490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:45.325216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:45.326269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:45.326790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:45.327534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:45.328004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:45.328504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:45.510950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:45.519576 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a2ba03d-7036-423e-84cf-50de38cc4fde tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.206822 Oct 04 22:23:45.521009 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3561/7225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:45 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:46.544520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:46.545259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:46.551519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.552005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.552443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.553150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:46.553608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:46.554042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:46.686687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:46.695164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-322cff43-884a-4587-8273-3a4dc3f33bc5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.155992 Oct 04 22:23:46.703125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3665/7226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:46 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:47.722835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:47.723512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:47.730248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.730759 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.731196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.732018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.732653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.733078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.742194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-plugged", "status": "completed", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:47.758978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:47.758978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:47.758978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:47.766475 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Creating event network-vif-plugged:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h2-851029-13 Oct 04 22:23:47.772428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] Instance f9d0f536-4039-475e-aac9-edcacfe28312 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:23:47.787424 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c965ba93-e758-448d-92da-ef5120e97730 req-4e9c2493-d959-408d-a744-6f5ac07f5b01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101184 Oct 04 22:23:47.788395 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3562/7227] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:47.875114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:47.882137 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-200aad20-66b0-4d99-9015-54606e670502 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.163277 Oct 04 22:23:47.882741 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3666/7228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:47 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:23:48.908207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:48.909247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:48.915896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.916394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.916837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:48.917551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:48.918016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:48.918453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:49.052748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:49.061252 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c8db37f7-9aab-4058-bc2d-254b780ab0f4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.159201 Oct 04 22:23:49.061827 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3563/7229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:48 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:50.085367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:50.086151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:50.093357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.093903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.094343 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.095576 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:50.096114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:50.096529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:50.238531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:50.248241 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1aaaa4cb-7123-4349-bcc2-1790926946a7 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.166738 Oct 04 22:23:50.249226 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3667/7230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:50 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:51.272498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:51.273130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:51.280127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.280624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.281075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.281795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.282368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.282870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.426757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:51.435638 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee3f0e05-90f9-45c0-8d96-1904965990b1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.167054 Oct 04 22:23:51.436529 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3564/7231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:51 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:51.537869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-unplugged", "status": "completed", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:51.550242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:51.555632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:51.555632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:51.564636 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Creating event network-vif-unplugged:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:23:51.570883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] Instance f9d0f536-4039-475e-aac9-edcacfe28312 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:23:51.582086 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-566d220a-5aee-47fd-a20b-08032a4c6f44 req-8a89c936-292d-4a89-9215-b0bff36c8086 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048171 Oct 04 22:23:51.582719 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3668/7232] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:52.468683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:52.469306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:52.476283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.476777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.477220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.477915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:52.478385 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:52.478839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:52.612535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:52.620957 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1b388368-21fb-4fbd-a8c4-bb18db04b945 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.156080 Oct 04 22:23:52.621548 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3565/7233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:52 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:53.048688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:23:53.060230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:53.060714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:53.061150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:53.076658 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Creating event network-changed:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:23:53.082568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] Instance f9d0f536-4039-475e-aac9-edcacfe28312 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:23:53.093357 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4496add8-0e0d-4f07-a84e-2f3bc09b5084 req-081d39ba-73c4-417e-b231-84046f898f4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048886 Oct 04 22:23:53.093983 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3669/7234] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:23:53.646584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:53.647265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:53.656088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:53.656706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:53.657095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:53.658030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:53.658509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:53.658978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:53.805176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:53.814640 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b00597f-a6b7-4460-84f0-2311845c4838 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.172873 Oct 04 22:23:53.816233 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3566/7235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:53 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:54.840107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:54.840820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:54.847091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:54.847572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:54.848004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:54.848685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:54.849142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:54.849563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:54.881999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:23:54.984449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:54.993965 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34ad8397-78a7-4f6b-b2b3-7c8e6f9643a9 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.159062 Oct 04 22:23:54.994580 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3670/7236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:54 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:56.018153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:56.018818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:56.025960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.026460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.027230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.027950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:56.028420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:56.028925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:56.168129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:56.177531 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5eaff123-552f-4f36-b18c-107768e39135 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.163337 Oct 04 22:23:56.178290 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3567/7237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:56 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:57.201313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:57.202164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:57.209453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:57.209947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:57.210394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:57.211198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:57.211713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:57.212149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:57.346776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:57.363875 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61634718-0bab-448c-a6c1-31aaefe28299 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.158353 Oct 04 22:23:57.363875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3671/7238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:57 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:58.380504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:58.381173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:58.388557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:58.389066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:58.389525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:58.390259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:58.390756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:58.391201 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:58.530654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:58.539291 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bec0a4d-6b2c-4684-acf4-3609a912c441 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.163314 Oct 04 22:23:58.539889 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3568/7239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:58 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:23:59.566204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:23:59.567027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:23:59.576002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.577177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.577732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.578718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:23:59.579345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:23:59.579990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:23:59.716817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:23:59.726030 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-098e4911-6100-404f-ac6b-3895c09ad13e tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.165093 Oct 04 22:23:59.726618 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3672/7240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:23:59 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:00.749623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:00.750266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:00.760024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.761899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.761899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.761899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:00.762216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:00.762643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:00.894409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:00.903329 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-455b241f-61d5-4bc6-b86c-ddbe0db9181c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.157670 Oct 04 22:24:00.903911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3569/7241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:00 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:01.927444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:01.927990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:01.934793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.935281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.935714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:01.936420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:01.936874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:01.937302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:02.070420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:02.078649 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d0bb945-f1db-4419-8f0a-bee272043daf tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.155766 Oct 04 22:24:02.079236 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3673/7242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:01 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:03.102397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:03.103050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:03.110612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.111127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.111572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.112269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:03.112733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:03.113165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:03.251098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:03.259924 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e8da3642-2b91-440e-998f-b817b53ce9b0 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.161385 Oct 04 22:24:03.260495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3570/7243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:03 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:04.283449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:04.284093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:04.291421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.291903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.292339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.293033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:04.293487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:04.293933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:04.430858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:04.439468 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62ebdaa3-033f-44c5-9dce-2a7b9a17b987 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.159936 Oct 04 22:24:04.440077 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3674/7244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:04 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:05.464237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:05.464782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:05.472181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.472960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.473406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.474108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:05.474574 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:05.475036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:05.610927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:05.619813 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e07a0aba-518e-452d-9177-ea65f90163d5 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.159510 Oct 04 22:24:05.620384 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3571/7245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:05 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:06.644038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:06.644649 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:06.652198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.652679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.653118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.653803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:06.654255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:06.654700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:06.788294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:06.796701 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a7c30ec-d3f0-44fd-89a7-0fe295539a07 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1721 microversion: 2.1 time: 0.156628 Oct 04 22:24:06.797289 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3675/7246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:06 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:07.820777 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:07.821406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:07.828296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.828791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.829244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.829956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:07.830422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:07.830894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:07.966950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:07.975745 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9040eb3-a762-4eac-b802-6d16aa37066c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1714 microversion: 2.1 time: 0.159520 Oct 04 22:24:07.976324 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3572/7247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:07 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:08.003776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.004390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.011407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.011903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.012344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.013048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.013537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.013974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.147991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.156329 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-faa98f94-f3ea-4c4f-b482-4cb5e6b3b405 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1714 microversion: 2.1 time: 0.156433 Oct 04 22:24:08.156904 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3676/7248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:07 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:08.179275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.191336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.322067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.330512 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-047f6a89-c28c-46c0-87ae-90e72e4649fd tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1714 microversion: 2.1 time: 0.155713 Oct 04 22:24:08.331153 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3573/7249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:08 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:08.353916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.354438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.360565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.361053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.361496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.362196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.362654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.363112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.377970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:08.388753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:24:08.736092 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-66d848ff-0e07-4253-9533-f5443e8ee03d tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 204 len: 0 microversion: 2.1 time: 0.386421 Oct 04 22:24:08.736696 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3677/7250] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:08 2022] DELETE /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:24:08.758948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:08.759577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:08.765805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.766303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.766795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.767510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:08.768010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:08.768470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:08.900480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:08.910239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb113704-b098-4abe-a308-727855b34efa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1720 microversion: 2.1 time: 0.155839 Oct 04 22:24:08.911084 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3574/7251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:08 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:09.882504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-plugged", "status": "completed", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:09.892781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.893264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.893705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.904855 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] Creating event network-vif-plugged:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:24:09.909720 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7b3f7db5-c809-4abc-aa57-aa8d19913251 req-ae4eba59-0d0c-41c9-9b62-df34cc901db7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032052 Oct 04 22:24:09.910316 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3678/7252] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:09.933994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:09.934648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:09.938302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=34 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:09.943941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.944452 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.944907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.945614 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:09.946090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:09.946629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:09.949174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=100 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:10.090434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:10.098760 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed93c5de-c546-44fe-933e-288ee37af9a8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1720 microversion: 2.1 time: 0.168643 Oct 04 22:24:10.099310 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3575/7253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:09 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:11.123986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:11.124817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:11.126856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:11.132379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:11.132848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:11.133287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:11.133994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:11.134453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:11.134911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:11.272668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:11.281143 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e16d6317-fced-4638-b37c-c85f313cd133 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1720 microversion: 2.1 time: 0.162409 Oct 04 22:24:11.281731 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3679/7254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:11 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:11.736631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d0f536-4039-475e-aac9-edcacfe28312", "name": "network-vif-deleted", "tag": "289aab47-d977-477f-b560-a1c64a478917"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:11.748929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:11.749421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:11.749860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:11.761511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] Creating event network-vif-deleted:289aab47-d977-477f-b560-a1c64a478917 for instance f9d0f536-4039-475e-aac9-edcacfe28312 on n-h1-851029-13 Oct 04 22:24:11.766644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3bb931ba-cef0-460a-a25a-b4d2648794c1 req-94f4de81-0073-406e-858e-8b651167f0eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Oct 04 22:24:11.767285 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3576/7255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:24:12.305190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:12.306450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:12.313569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.314293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.314761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.315721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:12.316349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:12.316945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:12.383296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:12.392719 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61ac6e18-6905-483d-95e2-232bcce0d492 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1370 microversion: 2.1 time: 0.091420 Oct 04 22:24:12.394918 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3680/7256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:12 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:13.416881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:13.417533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:13.425519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.431101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.431101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:13.431101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:13.431101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:13.431101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:13.498301 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:13.507361 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd616a54-078f-4116-9de0-dbe4df9db712 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1370 microversion: 2.1 time: 0.095261 Oct 04 22:24:13.510922 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3577/7257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:13 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:14.531237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:14.531858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:14.539453 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:14.539934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:14.540366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:14.541065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:14.541515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:14.541935 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:14.618216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:14.627595 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2234d2b2-0fef-45a5-bfef-7222511b9c53 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1370 microversion: 2.1 time: 0.100438 Oct 04 22:24:14.628819 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3681/7258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:14 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:15.658074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:15.659599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:15.668000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.668593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.669182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.670223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:15.670817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:15.671347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:15.755063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:15.765153 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-536b006c-bff5-4da1-813e-51077f0353d8 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1370 microversion: 2.1 time: 0.111408 Oct 04 22:24:15.765751 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3578/7259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:15 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:16.788058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:16.788669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:16.796049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.796614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.796958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.801035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.801035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.801035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.832611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:16.833084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:16.833520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:16.833972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lazy-loading 'fault' on Instance uuid f9d0f536-4039-475e-aac9-edcacfe28312 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:24:16.875627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc51b68e4e714e43b62020fb1562839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1bf810e69547a8b1bbe8c593ca3d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:16.884707 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0e353e8-89e8-45e6-acab-011096011651 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 200 len: 1375 microversion: 2.1 time: 0.100519 Oct 04 22:24:16.885282 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3682/7260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:16 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 1375 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:17.908240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:17.908820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:17.915602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.916101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.916550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.917257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:17.917727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:17.918167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:17.931794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 HTTP/1.1 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'f9d0f536-4039-475e-aac9-edcacfe28312'} Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:17.933461 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3dc77b7f-c860-4766-ab37-3b676c80722c tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 404 len: 111 microversion: 2.1 time: 0.030699 Oct 04 22:24:17.938649 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3579/7261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:17 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:17.998972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:18.001302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:18.008659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:18.009701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:18.010158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:18.011080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:18.011622 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:18.012330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:18.025888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-volume_attachments HTTP/1.1 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': 'f9d0f536-4039-475e-aac9-edcacfe28312'} Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:18.027617 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-188579df-71cf-4d69-8d1f-96a102230fac tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034201 Oct 04 22:24:18.032461 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3683/7262] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:24:17 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.570762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.571330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.580194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.580194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.580194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.581054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.581054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.581433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.597481 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 HTTP/1.1 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'f9d0f536-4039-475e-aac9-edcacfe28312'} Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.599177 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4232e6b7-2e4e-4fce-a88f-9cdaea0727aa tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 404 len: 111 microversion: 2.1 time: 0.034357 Oct 04 22:24:21.604216 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3580/7263] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:21 2022] DELETE /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.609534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.610293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: f9d0f536-4039-475e-aac9-edcacfe28312] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.618003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.618501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.618976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.619706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.620164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.620599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.636466 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 HTTP/1.1 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'f9d0f536-4039-475e-aac9-edcacfe28312'} Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.638061 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance f9d0f536-4039-475e-aac9-edcacfe28312 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b11ac72a-f317-4d5e-813c-c3b20aec3362 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312" status: 404 len: 111 microversion: 2.1 time: 0.034601 Oct 04 22:24:21.643484 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3684/7264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:21 2022] GET /compute/v2.1/servers/f9d0f536-4039-475e-aac9-edcacfe28312 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.650718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.651326 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.658043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.658765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.659224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.660035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.660570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.661101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.686088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a HTTP/1.1 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '8db4883d-42fa-425e-ad30-46c0346a722a'} Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.687707 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61fd0185-51fd-445c-952c-e0861510c15f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 404 len: 111 microversion: 2.1 time: 0.043178 Oct 04 22:24:21.694551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3581/7265] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:21 2022] DELETE /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.701131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.702268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 8db4883d-42fa-425e-ad30-46c0346a722a] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.709790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.713522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.713522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.713522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.713522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.713522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.729821 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a HTTP/1.1 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '8db4883d-42fa-425e-ad30-46c0346a722a'} Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.732598 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 8db4883d-42fa-425e-ad30-46c0346a722a could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c7fe0e0-bcef-4b98-b11a-d910a9aaaca4 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a" status: 404 len: 111 microversion: 2.1 time: 0.037134 Oct 04 22:24:21.738127 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3685/7266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:21 2022] GET /compute/v2.1/servers/8db4883d-42fa-425e-ad30-46c0346a722a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.745690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.745690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.752181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.752802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.753345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.754188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.754768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.755272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.771881 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c HTTP/1.1 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b16b5aa7-1797-4aae-b115-ebb0c41f972c'} Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.773577 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca972293-f4f5-49b5-87d3-1cea3a0971f1 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 404 len: 111 microversion: 2.1 time: 0.035403 Oct 04 22:24:21.778795 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3582/7267] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:21 2022] DELETE /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.784870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: b16b5aa7-1797-4aae-b115-ebb0c41f972c] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.804783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.809026 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c HTTP/1.1 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b16b5aa7-1797-4aae-b115-ebb0c41f972c'} Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.810688 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance b16b5aa7-1797-4aae-b115-ebb0c41f972c could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f0e68fe-611e-4fc3-9b25-1a4b2ecdd0a6 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c" status: 404 len: 111 microversion: 2.1 time: 0.031301 Oct 04 22:24:21.815755 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3686/7268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:21 2022] GET /compute/v2.1/servers/b16b5aa7-1797-4aae-b115-ebb0c41f972c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:24:21.822139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.822678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.829122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.829632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.830091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.830846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.831319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.831789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.847372 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 HTTP/1.1 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1160eb86-d337-4413-8506-40ece4ea7bc7'} Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.848996 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4adce10-a3da-48d0-8172-95c52022f826 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 404 len: 111 microversion: 2.1 time: 0.032772 Oct 04 22:24:21.858092 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3583/7269] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:24:21 2022] DELETE /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:24:21.859336 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.859920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] [instance: 1160eb86-d337-4413-8506-40ece4ea7bc7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:21.867047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.867536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.867981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.868730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:21.869143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:21.869574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:21.884615 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] HTTP exception thrown: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Request method failure captured: Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 HTTP/1.1 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLDJyq7uhmjYLH4qsGECBt7bcXwWoE5WO-V9ONU_LK7iS3doItpK2OVBkDKVPlDtkA2iSZFrEahn2RJ0911l_1-h0P59xko9TzlvUV_6RHLnvDaMW0ENTjm0occ3f3njtS3WeWN1qscpjpU-A1sPijP9pUtrFtWU9reA1mHmPw_YotE Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2a1bf810e69547a8b1bbe8c593ca3d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2a1bf810e69547a8b1bbe8c593ca3d5d Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServerActionsTestJSON-1532426376 Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: dc51b68e4e714e43b62020fb1562839e Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServerActionsTestJSON-1532426376-project Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '1160eb86-d337-4413-8506-40ece4ea7bc7'} Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:24:21.886181 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Returning 404 to user: Instance 1160eb86-d337-4413-8506-40ece4ea7bc7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77655965-c18a-47ca-9abb-043eae0ddc9f tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7" status: 404 len: 111 microversion: 2.1 time: 0.032220 Oct 04 22:24:21.894493 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3687/7270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:21 2022] GET /compute/v2.1/servers/1160eb86-d337-4413-8506-40ece4ea7bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:24:21.896851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f28f10f9-8825-41aa-915f-091e152eb752 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] Calling method '.version_select at 0x7f54f640cee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:21.992698 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f28f10f9-8825-41aa-915f-091e152eb752 tempest-ServerActionsTestJSON-1532426376 tempest-ServerActionsTestJSON-1532426376-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098758715" status: 202 len: 0 microversion: 2.1 time: 0.099843 Oct 04 22:24:21.993493 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3584/7271] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 4 22:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098758715 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:24:34.889450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=19 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:34.890209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:35.038258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1881115006", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "9d4047f3-aea5-4dfd-b3e5-1239f74a8bf6"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:35.340977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] validate_networks() for [('9d4047f3-aea5-4dfd-b3e5-1239f74a8bf6', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:24:35.766318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:35.766792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:35.767308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:35.767725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:35.768141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:35.779282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:35.792446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:35.792446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:35.792446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:35.792446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:35.792446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:35.800617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Getting quotas for project 541e1d001565498c871b92016479da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:35.806324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Getting quotas for user 8be6a88eb20d40d69bcc617d68533d6c and project 541e1d001565498c871b92016479da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:35.820357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:24:35.822722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:24:36.035456 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:24:37.045127 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47734. Oct 04 22:24:37.049814 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dee6e910-7380-48be-99d9-528e11f2594c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162799 Oct 04 22:24:37.050494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3688/7272] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:24:37.062243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=29 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:37.063191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:37.067749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2d21b652-5ce9-49f6-a5fc-78c587773e43 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:37.068383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2d21b652-5ce9-49f6-a5fc-78c587773e43 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:37.220346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2d21b652-5ce9-49f6-a5fc-78c587773e43 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:37.233250 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2d21b652-5ce9-49f6-a5fc-78c587773e43 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1217 microversion: 2.1 time: 0.172763 Oct 04 22:24:37.239802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3585/7273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:37 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:38.257800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7cd2e430-adda-4c38-8649-8172eb02b5d0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:38.258714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7cd2e430-adda-4c38-8649-8172eb02b5d0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:38.325720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7cd2e430-adda-4c38-8649-8172eb02b5d0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:38.331400 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7cd2e430-adda-4c38-8649-8172eb02b5d0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1217 microversion: 2.1 time: 0.078577 Oct 04 22:24:38.331994 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3689/7274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:38 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:39.356460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:39.357079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:39.364565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.365589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.366036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.366782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:39.367261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:39.367746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:39.444616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:39.453401 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d4c967f-9bd9-46e8-9e1c-fa5dbf9a7b3b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1213 microversion: 2.1 time: 0.100836 Oct 04 22:24:39.454961 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3586/7275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:39 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:40.482530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:40.483185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:40.491203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.491688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.492120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.492829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:40.493349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:40.493776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:40.910017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:40.918515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a08bc1f4-c9b4-4189-bdf9-9c53c6249554 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1287 microversion: 2.1 time: 0.439911 Oct 04 22:24:40.919221 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3690/7276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:40 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1287 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:41.947470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:41.948092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:41.955725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:41.959720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:41.959720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:41.959720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:41.959720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:41.959720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.178207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:42.186332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f80a8c9-0405-466e-92f5-93b2f1a71b25 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.242736 Oct 04 22:24:42.187186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3587/7277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:41 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:42.510454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9173f24-1db5-461c-ac09-0218d17933df", "tag": "3b20aaec-d7e8-4206-9efd-10795bae1a88"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:42.521321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:42.521803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:42.522268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:42.537351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] Creating event network-changed:3b20aaec-d7e8-4206-9efd-10795bae1a88 for instance b9173f24-1db5-461c-ac09-0218d17933df on n-h2-851029-13 Oct 04 22:24:42.542768 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b6d1b703-54e0-406e-a886-b2eda0404663 req-3a286133-41c5-4026-98d4-d4e8ff0b8edd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036788 Oct 04 22:24:42.543529 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3691/7278] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:43.209998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:43.210715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:43.217439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:43.217951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:43.218399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.219167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:43.219637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:43.220079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:43.360716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:43.369228 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf38aab4-1ec7-4c7f-bbea-739a60e7db27 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.163360 Oct 04 22:24:43.369813 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3588/7279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:43 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:44.394192 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:44.394950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:44.401315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.401799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.402233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.402962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:44.403418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:44.403841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:44.542484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:44.551159 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-832866aa-e348-43aa-b393-0ab46ca34c7e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.162028 Oct 04 22:24:44.551759 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3692/7280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:44 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:45.576109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:45.577158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:45.582943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.583448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.583900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.584620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:45.585089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:45.585529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:45.729353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:45.738181 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9280e717-af4f-4942-b9a4-bb5e1461cb55 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.167267 Oct 04 22:24:45.748610 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3589/7281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:45 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:46.762416 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:46.763142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:46.766032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:46.771079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.771569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.772011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:46.780372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:46.780372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:46.780372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:46.906141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:46.913889 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-317cdd01-6be7-4510-b5bd-17c0e37450d6 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.156133 Oct 04 22:24:46.914464 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3693/7282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:46 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:47.939155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:47.939819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:47.942963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:47.948345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:47.948840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:47.949285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:47.949997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:47.950461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:47.950986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.017081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9173f24-1db5-461c-ac09-0218d17933df", "name": "network-vif-plugged", "status": "completed", "tag": "3b20aaec-d7e8-4206-9efd-10795bae1a88"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:48.029261 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:48.029754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:48.030175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:48.042853 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] Creating event network-vif-plugged:3b20aaec-d7e8-4206-9efd-10795bae1a88 for instance b9173f24-1db5-461c-ac09-0218d17933df on n-h2-851029-13 Oct 04 22:24:48.048224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-824a64c9-da26-4afe-a7e9-b048cd76397b req-d5c978d5-bf9d-4d1b-9999-91401224dc21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034782 Oct 04 22:24:48.049021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3694/7283] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:48.093245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:48.102483 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec793271-c7b4-44f7-9d77-d95675f9fb9a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.168062 Oct 04 22:24:48.103701 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3590/7284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:47 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:49.124104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:24:49.129158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:49.129864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:49.136248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.136760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.144587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.144587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:49.144587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:49.144587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:49.282331 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:49.290871 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-209bfd60-fe76-49fc-bd7d-1bef63e0c043 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1317 microversion: 2.1 time: 0.167669 Oct 04 22:24:49.291453 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3695/7285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:49 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:50.314501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:50.315419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:50.324235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.324732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.325177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.325902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:50.326424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:50.326929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:50.464457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:50.472390 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0299554f-5fb5-4a21-89ae-0ac55b661d0e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.162009 Oct 04 22:24:50.472980 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3591/7286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:50 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:50.535316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1885870528", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "9d4047f3-aea5-4dfd-b3e5-1239f74a8bf6"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:50.591501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] validate_networks() for [('9d4047f3-aea5-4dfd-b3e5-1239f74a8bf6', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:24:50.992558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:24:50.992986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:24:50.994107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:24:50.994553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:24:50.995028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:24:51.004308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.004792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.005231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:51.005965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:51.006421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:51.006882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:51.025984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Getting quotas for project 541e1d001565498c871b92016479da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:24:51.031273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Getting quotas for user 8be6a88eb20d40d69bcc617d68533d6c and project 541e1d001565498c871b92016479da8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:24:51.044448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:24:51.046914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:24:51.187657 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04e4e764-581a-4f67-9df5-328b80299112 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656127 Oct 04 22:24:51.188320 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3696/7287] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:24:51.200597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b75668d-68df-48a6-b4d2-c52f6b80fb6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:51.201237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b75668d-68df-48a6-b4d2-c52f6b80fb6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:51.257154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b75668d-68df-48a6-b4d2-c52f6b80fb6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:51.266284 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b75668d-68df-48a6-b4d2-c52f6b80fb6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1217 microversion: 2.1 time: 0.070155 Oct 04 22:24:51.266931 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3592/7288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:51 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:24:52.292277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:52.292990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:52.299488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.299978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.300418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.301128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:52.301583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:52.302047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:52.372099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:52.380516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2bcab0a9-107f-4e33-88a7-ea678a002456 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1221 microversion: 2.1 time: 0.094644 Oct 04 22:24:52.381130 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3697/7289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:52 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:53.405276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:53.405842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:53.413911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.414416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.414902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.416260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:53.416729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:53.417168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:53.491931 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:53.501933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0e94efb-5907-47c9-8128-d836a4882e4b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1269 microversion: 2.1 time: 0.100758 Oct 04 22:24:53.502551 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3593/7290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:53 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:54.526956 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:54.528479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:54.535698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.536216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.536652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.537355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:54.537810 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:54.538264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:54.753106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:54.768352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5f932a2-3794-4e28-86a8-d49ca78eda02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.246144 Oct 04 22:24:54.769757 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3698/7291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:54 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:55.802224 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:55.803823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:55.813471 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.814113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.814991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.816391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.817088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.817736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.876113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e57dc3d-d6bd-462e-9215-6e5a783e57ec", "tag": "1bad38e3-5efe-4077-ae94-b485768cb3ea"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:24:55.886877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:55.887377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:55.887844 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:55.900938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] Creating event network-changed:1bad38e3-5efe-4077-ae94-b485768cb3ea for instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec on n-h1-851029-13 Oct 04 22:24:55.906919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f2ce405f-b42e-442f-9f36-41637922512f req-f99da7c8-7e76-4d67-b005-4c5b51c41d76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139046 Oct 04 22:24:55.907937 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3594/7292] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:24:55.993112 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:56.003061 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34c050d0-3c89-436a-b0ea-fc5eae8aca6e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.205627 Oct 04 22:24:56.003583 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3699/7293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:55 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:57.032360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:57.033091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:57.039630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.040128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.040572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.041289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:57.041763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:57.042195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:57.187763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:57.196208 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76499f9a-b600-49e7-9658-00adcb801c16 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.168950 Oct 04 22:24:57.197357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3595/7294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:57 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:58.220791 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:58.221430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:58.228493 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:58.228984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:58.229419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:58.230121 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:58.230574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:58.231065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:58.382129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:58.390918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fb009d4-51f8-4ea3-8777-f6988b3f314b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.174409 Oct 04 22:24:58.391513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3700/7295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:58 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:24:59.415672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:24:59.416342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:24:59.424058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.424572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.425033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.425764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:24:59.427675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:24:59.427675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:24:59.573448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:24:59.581422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75b9118e-7064-478f-bbf1-9898a7f328f5 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.170501 Oct 04 22:24:59.582048 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3596/7296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:24:59 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:00.607823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:00.608874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:00.617626 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.618258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.618566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.619549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:00.620020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:00.620455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:00.781911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:00.790515 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a68cc6a-92ec-4854-a44f-bccb05acb025 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.188457 Oct 04 22:25:00.791144 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3701/7297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:00 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:01.814976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:01.815881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:01.818699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:01.823621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.824133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.824586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.825290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:01.828955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:01.828955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:01.970854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:01.980079 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0813b0ba-9e88-492f-94f3-ed74f2340c0b tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.169434 Oct 04 22:25:01.980753 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3597/7298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:01 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:02.092573 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e57dc3d-d6bd-462e-9215-6e5a783e57ec", "name": "network-vif-plugged", "status": "completed", "tag": "1bad38e3-5efe-4077-ae94-b485768cb3ea"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:02.093274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:02.093689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:02.100830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:02.101328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:02.101750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:02.112965 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] Creating event network-vif-plugged:1bad38e3-5efe-4077-ae94-b485768cb3ea for instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec on n-h1-851029-13 Oct 04 22:25:02.118238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-65260dc0-4195-429a-9ce0-9201d797b391 req-1e7f8e77-800b-415e-a868-6437581c6e72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035428 Oct 04 22:25:02.118894 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3702/7299] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:03.003211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:03.003809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:03.011428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.011928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.012377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.013084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:03.013553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:03.013996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:03.143406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:03.151262 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43aa43bd-b8bd-4538-82bd-73a299e99e98 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1317 microversion: 2.1 time: 0.152226 Oct 04 22:25:03.151834 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3598/7300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:02 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:04.175401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:04.176114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:04.183964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.184454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.184890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.185581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.186043 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.186470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.321683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.329536 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-967519a6-2dc2-47c8-852d-3efa239864ec tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1507 microversion: 2.1 time: 0.159305 Oct 04 22:25:04.330120 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3703/7301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:04 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:04.351228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:04.351762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:04.359113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.359609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.360060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.360760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.361229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.361667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.387134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:25:04.704005 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1d80084-9dc2-4e89-b158-76c1f1a1e7f4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 204 len: 0 microversion: 2.1 time: 0.356324 Oct 04 22:25:04.704601 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3599/7302] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:04 2022] DELETE /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:25:04.713822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:04.716875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:04.720751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.721255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.721670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.722364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:04.722852 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:04.723275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:04.862840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:04.871525 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1716a84c-91d0-4be8-9b87-31baa3e027d3 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1513 microversion: 2.1 time: 0.162530 Oct 04 22:25:04.872119 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3704/7303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:04 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:05.896657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:05.897383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:05.905251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.905875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.906451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:05.907264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:05.907740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:05.908254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.050965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:06.058885 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e470973-533f-4285-95c2-06108e9d578f tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1513 microversion: 2.1 time: 0.166669 Oct 04 22:25:06.059473 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3600/7304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:05 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:06.756204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e57dc3d-d6bd-462e-9215-6e5a783e57ec", "name": "network-vif-deleted", "tag": "1bad38e3-5efe-4077-ae94-b485768cb3ea"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:06.766001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:06.768507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:06.768987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:06.769459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:06.773812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=77 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:06.782060 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] Creating event network-vif-deleted:1bad38e3-5efe-4077-ae94-b485768cb3ea for instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec on n-h1-851029-13 Oct 04 22:25:06.787636 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f21c98f0-dc01-4714-ab0e-88da642e39f3 req-cddf3b9e-ceca-4471-8852-7738197a3cd0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035129 Oct 04 22:25:06.788539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3705/7305] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:07.083754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:07.084542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:07.091726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.092219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.092677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.093409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:07.093876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:07.094315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:07.164248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:07.167233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:07.173690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25e4409d-3f00-4975-a681-e40dd1124597 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 200 len: 1302 microversion: 2.1 time: 0.093970 Oct 04 22:25:07.177520 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3601/7306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:07 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:08.199101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.199716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.207270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.210000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.210000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.210000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.210000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.210000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.224395 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec HTTP/1.1 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9e57dc3d-d6bd-462e-9215-6e5a783e57ec'} Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.226060 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 404 to user: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b56dc3d7-6d3a-43f4-99ee-b27497e40c6d tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 404 len: 111 microversion: 2.1 time: 0.034336 Oct 04 22:25:08.232262 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3706/7307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:08.238729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.239358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.246075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.246600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.247090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.248046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.248459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.248896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.390921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.400915 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f28ba0be-0d16-4b55-9aa4-4806b5ca1bf0 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.167183 Oct 04 22:25:08.401546 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3602/7308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:08.424460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:08.426774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 8758bba6-f804-4369-9af8-f6ba2e07b3ca] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.432286 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/8758bba6-f804-4369-9af8-f6ba2e07b3ca/action HTTP/1.1 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 32 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: {"resize": {"flavorRef": "452"}} Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '8758bba6-f804-4369-9af8-f6ba2e07b3ca', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:08.433843 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 404 to user: Instance 8758bba6-f804-4369-9af8-f6ba2e07b3ca could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07b127ca-71fe-4a9c-bbc9-49fbd1d41bf7 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "POST /compute/v2.1/servers/8758bba6-f804-4369-9af8-f6ba2e07b3ca/action" status: 404 len: 111 microversion: 2.1 time: 0.015190 Oct 04 22:25:08.438785 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3707/7309] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:25:08 2022] POST /compute/v2.1/servers/8758bba6-f804-4369-9af8-f6ba2e07b3ca/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:08.445813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.446563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.453406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.453810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.454261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.455026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.455502 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.455973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.598857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.603182 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-619083e6-d36f-4e31-8748-8e31ca883249 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.161361 Oct 04 22:25:08.603772 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3603/7310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:25:08.627702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.628322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.636146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.636635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.637074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.644652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.644652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.644652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.778701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.786904 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9cdbe347-6864-41bf-ad64-30e541abae03 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.163083 Oct 04 22:25:08.787485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3708/7311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:08.808958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "fd95b136-4f7b-4167-8668-f3a08341fa13"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:08.811318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.817561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.818050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.818492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.819225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.819690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.820125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.860067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:08.865465 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: request: POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action HTTP/1.1 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 65 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: {"resize": {"flavorRef": "fd95b136-4f7b-4167-8668-f3a08341fa13"}} Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: exception: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b9173f24-1db5-461c-ac09-0218d17933df', 'body': {'resize': {'flavorRef': 'fd95b136-4f7b-4167-8668-f3a08341fa13'}}} Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:08.871202 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 400 to user: Flavor fd95b136-4f7b-4167-8668-f3a08341fa13 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1bc3b2fc-0ca4-4e10-bc69-bdb4946825bd tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action" status: 400 len: 107 microversion: 2.1 time: 0.067668 Oct 04 22:25:08.876325 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3604/7312] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:25:08 2022] POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action => generated 107 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 22:25:08.882046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:08.882685 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:08.889401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.889889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.890329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:08.891085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:08.891545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:08.891976 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.026096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.034056 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ffdaa143-9a33-443e-85a0-1b61a7b9f2ba tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.156049 Oct 04 22:25:09.034647 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3709/7313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:08 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:09.057659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.058294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.064422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.064928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.065381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.066353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.066863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.067304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.208190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.216524 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13458ae5-fda7-43ef-a209-0e5719e01b2e tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.163182 Oct 04 22:25:09.217104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3605/7314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:09.239338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ab64aff-3934-4baf-b15f-79357736bb02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ab64aff-3934-4baf-b15f-79357736bb02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: request: POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action HTTP/1.1 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 29 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: {"resize": {"flavorRef": ""}} Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b9173f24-1db5-461c-ac09-0218d17933df', 'body': {'resize': {'flavorRef': ''}}} Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise error Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi '' Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.243475 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ab64aff-3934-4baf-b15f-79357736bb02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ab64aff-3934-4baf-b15f-79357736bb02 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action" status: 400 len: 113 microversion: 2.1 time: 0.009814 Oct 04 22:25:09.249080 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3710/7315] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:25:09 2022] POST /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 22:25:09.254076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.254743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.262516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.263123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.263581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.264309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.264781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.265222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.405959 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:09.414246 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3574402e-8aba-4338-b6c8-8dce51b0eb50 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1506 microversion: 2.1 time: 0.164035 Oct 04 22:25:09.415375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3606/7316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:09.442116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.442620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.451530 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.451749 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.452087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.452804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.453389 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.453701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.468872 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec HTTP/1.1 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9e57dc3d-d6bd-462e-9215-6e5a783e57ec'} Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:09.470481 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 404 to user: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b08a215d-5e16-4d13-a6df-02943c632811 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 404 len: 111 microversion: 2.1 time: 0.035039 Oct 04 22:25:09.475591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3711/7317] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:09 2022] DELETE /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:25:09.480783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.481686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: 9e57dc3d-d6bd-462e-9215-6e5a783e57ec] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.483763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:25:09.488749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.489254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.489759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.490434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.490934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.491371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.505935 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec HTTP/1.1 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '9e57dc3d-d6bd-462e-9215-6e5a783e57ec'} Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:09.507558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 404 to user: Instance 9e57dc3d-d6bd-462e-9215-6e5a783e57ec could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4615743b-fdbc-47b9-9a42-f68e9cb570c4 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec" status: 404 len: 111 microversion: 2.1 time: 0.032724 Oct 04 22:25:09.513231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3607/7318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/9e57dc3d-d6bd-462e-9215-6e5a783e57ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:25:09.519075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.519584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.526366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.526916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.527356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.528065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.528528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.528960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.555579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:25:09.952847 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5551b9c6-405c-4486-a6e9-e056fcdb0637 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 204 len: 0 microversion: 2.1 time: 0.437282 Oct 04 22:25:09.953571 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3712/7319] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:25:09 2022] DELETE /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:25:09.966106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:09.967093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:09.979388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.980235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.981056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:09.982362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:09.983384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:09.984168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:10.145997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:10.154503 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3ad5c3ff-54b8-48eb-ae2b-ea273345e82c tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1512 microversion: 2.1 time: 0.195884 Oct 04 22:25:10.155124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3608/7320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:09 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:11.181665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:11.182378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:11.189761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.189990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.190422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.191462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:11.191917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:11.192383 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:11.340545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:11.348480 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-79b1f1b0-0c87-4264-9d31-b74d36d72185 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1512 microversion: 2.1 time: 0.172741 Oct 04 22:25:11.349074 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3713/7321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:11 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:11.995396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9173f24-1db5-461c-ac09-0218d17933df", "name": "network-vif-deleted", "tag": "3b20aaec-d7e8-4206-9efd-10795bae1a88"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:25:12.008218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.008741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.012900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.021852 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] Creating event network-vif-deleted:3b20aaec-d7e8-4206-9efd-10795bae1a88 for instance b9173f24-1db5-461c-ac09-0218d17933df on n-h2-851029-13 Oct 04 22:25:12.027759 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d6aeb540-7e69-4be2-ba93-2f3b40ba8762 req-de353eac-3cc0-47fc-aec8-504b57863b11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Oct 04 22:25:12.028448 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3609/7322] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:25:12.371638 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:12.372231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:12.379215 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.382449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.382449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.382449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.382449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.382449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.413357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:12.413829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:12.414263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:12.414760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lazy-loading 'fault' on Instance uuid b9173f24-1db5-461c-ac09-0218d17933df {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:25:12.456827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be6a88eb20d40d69bcc617d68533d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541e1d001565498c871b92016479da8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:25:12.465582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38fff6f7-3d01-478d-9d69-83abdf6a6431 tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 200 len: 1307 microversion: 2.1 time: 0.097779 Oct 04 22:25:12.466156 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3714/7323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:12 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:25:13.490148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:25:13.490888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] [instance: b9173f24-1db5-461c-ac09-0218d17933df] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:25:13.497646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.498141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.498589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.499328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:25:13.499797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:25:13.500234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:25:13.514398 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] HTTP exception thrown: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Request method failure captured: Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df HTTP/1.1 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLKiiMuYuwczsFJFNxqtG7H00hN-lwmCK5kZ2d_4yQWGkwgNpH5xA0i0gIEXERfwqQ5J8DZPyt-EXnNWQj2uTcoF0EslQegEIvB50ercKKa_koIeXHN2CyiMVmLsiJhUIthc9Bl2Kh-M3YLn7Lv8SOlkXgkndO9iEODZ4J5vXiSiM1M Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/541e1d001565498c871b92016479da8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/541e1d001565498c871b92016479da8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_541e1d001565498c871b92016479da8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 541e1d001565498c871b92016479da8c Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-ServersNegativeTestJSON-821183917 Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 8be6a88eb20d40d69bcc617d68533d6c Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-ServersNegativeTestJSON-821183917-project Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'b9173f24-1db5-461c-ac09-0218d17933df'} Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:25:13.516130 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] Returning 404 to user: Instance b9173f24-1db5-461c-ac09-0218d17933df could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06d658ee-8014-449e-99b8-be27618d711a tempest-ServersNegativeTestJSON-821183917 tempest-ServersNegativeTestJSON-821183917-project] 10.222.0.36 "GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df" status: 404 len: 111 microversion: 2.1 time: 0.032723 Oct 04 22:25:13.524938 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3610/7324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:25:13 2022] GET /compute/v2.1/servers/b9173f24-1db5-461c-ac09-0218d17933df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:26:02.125711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:02.126473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:02.344918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5973363d-4d58-4fea-8798-8d86750c67be tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: .version_select at 0x7f54f5579ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-343654894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsmBDOjY2CoMYqwLvQO3zGgQAua31/jZt8uiEgbglYp8eCpow9nXCF0LXowq4326AwvMseM3jOpK0NmlRGras2VSgvyjuFgcVkQ+6CiNFBu3NVx4exaBBLBm9rZ4pq9lQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:02.375837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5973363d-4d58-4fea-8798-8d86750c67be tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:02.382526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-5973363d-4d58-4fea-8798-8d86750c67be tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:02.616442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5973363d-4d58-4fea-8798-8d86750c67be tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.496030 Oct 04 22:26:02.617214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3715/7325] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:26:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:02.674863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-59886899", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-343654894", "networks": [{"uuid": "553624a5-f6a3-4dd8-b6e3-d70500a0a723"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:02.684409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=7 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:02.685095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=41 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:02.752320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] validate_networks() for [('553624a5-f6a3-4dd8-b6e3-d70500a0a723', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:26:03.284996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:26:03.285435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:26:03.286141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:26:03.286571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:26:03.287154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:26:03.298564 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:03.299087 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:03.299545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:03.300283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:03.300757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:03.301220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:03.321472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:03.327754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:03.343013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:26:03.345513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:26:03.461814 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-76e79e21-796a-49c9-b8e8-65eaf6c4df4d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791142 Oct 04 22:26:03.462518 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3611/7326] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:26:03.475223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60fa6126-a7c2-4873-a83c-70d17cb1d7a2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:03.476674 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60fa6126-a7c2-4873-a83c-70d17cb1d7a2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:03.530768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-60fa6126-a7c2-4873-a83c-70d17cb1d7a2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:03.539134 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60fa6126-a7c2-4873-a83c-70d17cb1d7a2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1260 microversion: 2.1 time: 0.068854 Oct 04 22:26:03.540292 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3716/7327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:03 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1260 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:04.562565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26d5a8ed-bd42-4b67-9804-9200621bea83 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:04.563250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26d5a8ed-bd42-4b67-9804-9200621bea83 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:04.620415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-26d5a8ed-bd42-4b67-9804-9200621bea83 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:04.627599 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26d5a8ed-bd42-4b67-9804-9200621bea83 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1260 microversion: 2.1 time: 0.070072 Oct 04 22:26:04.628181 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3612/7328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:04 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1260 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:05.651182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:05.651801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:05.659179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:05.659667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:05.660104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:05.661334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:05.661796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:05.662903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:05.733134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:05.743601 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e54cffed-3bd5-4970-9a09-221364816e8c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1312 microversion: 2.1 time: 0.096273 Oct 04 22:26:05.745401 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3717/7329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:05 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:06.769772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:06.770510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:06.777988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:06.778491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:06.778970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:06.779685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:06.780153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:06.780592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:06.844442 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:06.852914 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0817caed-6798-4d73-888e-90ace5c4aaec tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1318 microversion: 2.1 time: 0.087228 Oct 04 22:26:06.853485 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3613/7330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:06 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:07.881617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:07.882987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:07.890589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:07.891122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:07.891566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:07.892315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:07.892774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:07.893205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:08.047996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:08.057908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8654b9d9-b421-4d2d-9905-7534eaa8dad2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.180136 Oct 04 22:26:08.058519 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3718/7331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:07 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:08.435626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09557065-6cc2-4f24-9d3a-8812ce798da5", "tag": "065672ac-599a-4fb0-834e-98fd19c26d45"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:08.446578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:08.447116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:08.447566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:08.460822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] Creating event network-changed:065672ac-599a-4fb0-834e-98fd19c26d45 for instance 09557065-6cc2-4f24-9d3a-8812ce798da5 on n-h2-851029-13 Oct 04 22:26:08.466765 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b65d4ef2-49c8-400b-8535-e0220014fa9c req-b3920be3-4ce1-4b0d-930c-4645a0b3fe98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035815 Oct 04 22:26:08.467402 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3614/7332] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:26:09.089836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:09.091220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:09.100620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.101130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.101584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.102328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:09.102868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:09.103347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:09.345075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:09.366507 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40f35411-6d18-4f95-b256-7b214b5826cf tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.280882 Oct 04 22:26:09.367520 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3719/7333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:09 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:10.397902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:10.398534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:10.405264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:10.405761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:10.406209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:10.406955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:10.407435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:10.407867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:10.549617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:10.558653 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9227505a-1955-4593-9db0-ae586185d30a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.166576 Oct 04 22:26:10.559283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3615/7334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:10 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:11.583288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:11.584444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:11.591853 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:11.592342 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:11.592788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:11.593516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:11.593973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:11.594401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:11.746618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:11.755560 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bc0e5af-ef31-4fa3-bde5-8ed67d913fce tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.176388 Oct 04 22:26:11.756663 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3720/7335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:11 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:12.780851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:12.781438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:12.787656 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:12.788155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:12.788601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:12.789310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:12.789768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:12.790206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:12.931897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:12.940461 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bcb1a8f7-de48-4761-86b4-e3741d3e18ea tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.164594 Oct 04 22:26:12.941305 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3616/7336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:12 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:13.970391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:13.971076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:13.974301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:13.979593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:13.980079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:13.980513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:13.981226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:13.981716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:13.982146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:14.132535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:14.141604 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c2f6637-54bc-4dcd-8e71-cdc3faaadd5e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.174792 Oct 04 22:26:14.147117 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3721/7337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:13 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:14.415875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09557065-6cc2-4f24-9d3a-8812ce798da5", "name": "network-vif-plugged", "status": "completed", "tag": "065672ac-599a-4fb0-834e-98fd19c26d45"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:14.421308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:14.428583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:14.429212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:14.429658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:14.444510 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] Creating event network-vif-plugged:065672ac-599a-4fb0-834e-98fd19c26d45 for instance 09557065-6cc2-4f24-9d3a-8812ce798da5 on n-h2-851029-13 Oct 04 22:26:14.449871 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-77700096-390d-4768-8e1b-3e95720853e6 req-a208a38f-635a-44c3-badf-2a4066664e8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037894 Oct 04 22:26:14.450501 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3617/7338] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:15.164918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:15.165524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:15.172397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.172868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.173297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.173978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:15.174427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:15.174875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:15.314655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:15.322805 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e7f8cc59-8458-415e-8ae3-21ba164d1d35 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1360 microversion: 2.1 time: 0.162281 Oct 04 22:26:15.323375 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3722/7339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:15 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:16.343080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:16.348350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:16.349058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:16.355184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:16.355675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:16.356117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:16.360238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:16.360238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:16.360238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:16.761808 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:16.769710 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-37cf5be6-2dc8-4774-8105-0f47d4860674 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1553 microversion: 2.1 time: 0.427575 Oct 04 22:26:16.770268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3618/7340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:16 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1553 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:16.791863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:16.792481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:16.799512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:16.800004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:16.800444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:16.801143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:16.801603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:16.802031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:16.944481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:16.954870 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-238ed50f-5166-4252-a0d9-cae2969f0764 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1553 microversion: 2.1 time: 0.166801 Oct 04 22:26:16.955569 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3723/7341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:16 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:20.498457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc922dfd-a3f7-4b32-9b1d-76235d091a18"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:20.500820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:20.507910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:20.508397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:20.508846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:20.509553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:20.510014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:20.510449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:21.346857 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b0597fa7-33cc-4f41-a7a4-d8e6bf9efb41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852122 Oct 04 22:26:21.347465 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3619/7342] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:26:20 2022] POST /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:33.164927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:33.165508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:33.168319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:33.169013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=42 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:33.174568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:33.175126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:33.175580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:33.176294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:33.177298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:33.177735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:33.283816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lazy-loading 'services' on Instance uuid 09557065-6cc2-4f24-9d3a-8812ce798da5 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:26:33.675046 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc16b834-9485-4308-8894-69d38496bf3e tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments/fc922dfd-a3f7-4b32-9b1d-76235d091a18" status: 202 len: 0 microversion: 2.1 time: 0.513930 Oct 04 22:26:33.675709 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3724/7343] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:26:33 2022] DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments/fc922dfd-a3f7-4b32-9b1d-76235d091a18 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:26:33.683503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:33.684310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:33.688685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:33.691474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:33.698747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:33.699345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:33.699721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:33.700441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:33.700905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:33.701346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:33.733669 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd55a073-f2e2-4d92-bfdc-1764befc0102 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052718 Oct 04 22:26:33.734242 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3620/7344] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:33 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:34.747628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:34.750280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:34.757187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:34.757665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:34.758100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:34.758823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:34.759274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:34.759777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:34.792633 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19dc6df1-90d8-4efc-91e1-b39e1092c2fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050348 Oct 04 22:26:34.793229 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3725/7345] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:34 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:35.804857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:35.807070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:35.815751 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:35.816509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:35.816965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:35.818214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:35.818704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:35.819150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:35.852484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8dad5c5c-6e5e-4676-a437-2f8be8ab4a06 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052077 Oct 04 22:26:35.853334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3621/7346] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:35 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:36.865059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:36.867286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:36.874134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:36.874617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:36.875087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:36.875783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:36.876238 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:36.876665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:36.910850 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3dee673-2055-41fa-aed1-ab0b3b1bf690 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049784 Oct 04 22:26:36.912031 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3726/7347] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:36 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:37.924037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:37.926251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:37.935669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:37.936170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:37.936625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:37.937393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:37.937864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:37.938303 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:37.969089 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1814ae9d-415f-49bf-8165-ba7cdda01970 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049020 Oct 04 22:26:37.969665 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3622/7348] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:37 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:38.981648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:38.983835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:38.990605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:38.991122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:38.991559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:38.992360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:38.992812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:38.993229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:39.022537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae20af64-9f14-4eba-9e41-12f3bb85a04a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044901 Oct 04 22:26:39.023125 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3727/7349] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:26:38 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:26:39.034114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:39.034638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:39.042312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:39.042914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:39.043364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:39.044065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:39.044529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:39.044966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:39.305717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 is not attached to volume fc922dfd-a3f7-4b32-9b1d-76235d091a18 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments/fc922dfd-a3f7-4b32-9b1d-76235d091a18 HTTP/1.1 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 is not attached to volume fc922dfd-a3f7-4b32-9b1d-76235d091a18 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': '09557065-6cc2-4f24-9d3a-8812ce798da5', 'id': 'fc922dfd-a3f7-4b32-9b1d-76235d091a18'} Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fc922dfd-a3f7-4b32-9b1d-76235d091a18. Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 is not attached to volume fc922dfd-a3f7-4b32-9b1d-76235d091a18 Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:39.317703 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 is not attached to volume fc922dfd-a3f7-4b32-9b1d-76235d091a18 Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 is not attached to volume fc922dfd-a3f7-4b32-9b1d-76235d091a18 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-426e04f9-de18-4b4f-8fb9-71c6cb63fcd9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments/fc922dfd-a3f7-4b32-9b1d-76235d091a18" status: 404 len: 154 microversion: 2.1 time: 0.289485 Oct 04 22:26:39.323286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3623/7350] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:26:39 2022] DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5/os-volume_attachments/fc922dfd-a3f7-4b32-9b1d-76235d091a18 => generated 154 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:26:43.033541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:43.034079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:43.041137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.041618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.042075 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.043214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.043214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.043623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.071327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:26:43.422372 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26e0fc41-9285-45cc-b9e8-6ff298bfb755 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 204 len: 0 microversion: 2.1 time: 0.392498 Oct 04 22:26:43.423068 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3728/7351] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:26:43 2022] DELETE /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:26:43.431599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:43.432321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:43.439202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.440268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.440812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.442388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:43.442965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:43.443478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:43.591393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:43.599473 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c5761f57-f834-4a50-a8a1-0a0218a890fc tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1559 microversion: 2.1 time: 0.171854 Oct 04 22:26:43.599936 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3624/7352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:43 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:44.623311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:44.624073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:44.630773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:44.631267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:44.631709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:44.632403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:44.632864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:44.633292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:44.885079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:44.892937 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61aaeebb-0fa1-4498-87c9-af12cab773ba tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1559 microversion: 2.1 time: 0.274101 Oct 04 22:26:44.893515 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3729/7353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:44 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1559 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:45.528584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09557065-6cc2-4f24-9d3a-8812ce798da5", "name": "network-vif-deleted", "tag": "065672ac-599a-4fb0-834e-98fd19c26d45"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:45.539635 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:45.540133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:45.540583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:45.552730 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] Creating event network-vif-deleted:065672ac-599a-4fb0-834e-98fd19c26d45 for instance 09557065-6cc2-4f24-9d3a-8812ce798da5 on n-h2-851029-13 Oct 04 22:26:45.558012 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-93ca5c94-45e0-42eb-9d4b-b3bd95369b0b req-261799d8-3296-4d53-a185-d05ea489c22d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Oct 04 22:26:45.558625 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3625/7354] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:45.917145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:45.918478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:45.926289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:45.926851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:45.927281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:45.927996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:45.928529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:45.929167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:45.963941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:45.964427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:45.964963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:45.965348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lazy-loading 'fault' on Instance uuid 09557065-6cc2-4f24-9d3a-8812ce798da5 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:26:46.008187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:46.015950 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2841de15-3427-4fb0-b660-7321b05dcd15 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 200 len: 1350 microversion: 2.1 time: 0.102789 Oct 04 22:26:46.016540 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3730/7355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:45 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:47.039743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:47.040455 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 09557065-6cc2-4f24-9d3a-8812ce798da5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:47.047516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.048010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.048464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.049170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.049636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.050074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.064794 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 HTTP/1.1 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '09557065-6cc2-4f24-9d3a-8812ce798da5'} Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:47.065257 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance 09557065-6cc2-4f24-9d3a-8812ce798da5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2eddd8df-00e6-4c60-bc5a-6ae5006e6595 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5" status: 404 len: 111 microversion: 2.1 time: 0.031523 Oct 04 22:26:47.071673 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3626/7356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:47 2022] GET /compute/v2.1/servers/09557065-6cc2-4f24-9d3a-8812ce798da5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:26:47.076417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00ca6a79-9fc1-426d-909f-d92cdd33cd8a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '.version_select at 0x7f54f5498040>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:47.182873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00ca6a79-9fc1-426d-909f-d92cdd33cd8a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-343654894" status: 202 len: 0 microversion: 2.1 time: 0.110089 Oct 04 22:26:47.183392 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3731/7357] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-343654894 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:26:47.203337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-875b1df2-ab9f-4a63-8fed-da7169745173 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: .version_select at 0x7f54f550a1f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1040573182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgyXvySmzt2NIlZabhvSc3YiHcY3+DIe7rgKuNPkejK5XhxF/oaYLffWvhDPp1yU1K+XL4r3D9xUFj/uMYSdCKwsdP6C7jr/m7iPsD1TEX4wn/IPAjRs06sP2NwMdfpsw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:47.222906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-875b1df2-ab9f-4a63-8fed-da7169745173 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:47.231708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-875b1df2-ab9f-4a63-8fed-da7169745173 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:47.349883 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-875b1df2-ab9f-4a63-8fed-da7169745173 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.150417 Oct 04 22:26:47.350514 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3627/7358] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:26:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:47.401276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-97495676", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1040573182", "networks": [{"uuid": "553624a5-f6a3-4dd8-b6e3-d70500a0a723"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:47.454762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] validate_networks() for [('553624a5-f6a3-4dd8-b6e3-d70500a0a723', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:26:47.881571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:26:47.881995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:26:47.882477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:26:47.882913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:26:47.883332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:26:47.892397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.892881 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.893323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.894055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:47.894508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:47.894985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:47.912782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:26:47.917979 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:26:47.931705 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:26:47.934060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:26:48.055477 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7b733c8-72e5-45c4-b15a-8ff681790188 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658022 Oct 04 22:26:48.056140 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3732/7359] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:26:48.069625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dea3ede5-24f5-4afd-a613-c0291986aeff tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:48.079122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dea3ede5-24f5-4afd-a613-c0291986aeff tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:48.139107 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dea3ede5-24f5-4afd-a613-c0291986aeff tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:48.148774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dea3ede5-24f5-4afd-a613-c0291986aeff tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1261 microversion: 2.1 time: 0.083570 Oct 04 22:26:48.149364 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3628/7360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:48 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:49.173372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:49.174147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:49.181523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:49.182010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:49.182451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:49.183213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:49.183672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:49.184106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:49.252066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:49.260720 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68ccae4c-10eb-48b2-8c85-38ea5cd174b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1265 microversion: 2.1 time: 0.092181 Oct 04 22:26:49.261354 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3733/7361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:49 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:26:50.282964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:50.283688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:50.290538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:50.291068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:50.291514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:50.292226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:50.292688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:50.293122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:50.390878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:50.399172 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-edae0482-4e2a-40d9-bb32-d505561d1d5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1321 microversion: 2.1 time: 0.119806 Oct 04 22:26:50.400192 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3629/7362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:50 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1321 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:51.437704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:51.438275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:51.448217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:51.448703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:51.449146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:51.449861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:51.450322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:51.450792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:51.609151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:51.617023 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2aeaf66d-9546-434d-bc9b-8436ce2afb5b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.183379 Oct 04 22:26:51.617701 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3734/7363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:51 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:52.035942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbfe83b1-9b01-4ac9-acda-1634baf2abd5", "tag": "1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:52.046801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:52.047299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:52.047748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:52.059386 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] Creating event network-changed:1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0 for instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 on n-h2-851029-13 Oct 04 22:26:52.064594 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-06fbd475-ee84-492a-8503-61e5bba8bbb9 req-23cfd935-fa57-451c-9a7a-e0c19c9d4a5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Oct 04 22:26:52.065207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3630/7364] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:26:52.640731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:52.641296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:52.648745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:52.649172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:52.649630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:52.650312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:52.650922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:52.651356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:52.832731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:52.840518 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d43aff7f-3030-4067-893f-5253b581f4cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.203774 Oct 04 22:26:52.841094 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3735/7365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:52 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:53.865071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:53.865706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:53.872944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:53.873441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:53.873889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:53.874594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:53.875093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:53.875531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:54.005988 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:54.013988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d0c0b7c-c928-4236-9e91-153eabd1a67f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.154089 Oct 04 22:26:54.014563 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3631/7366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:53 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:55.036662 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:55.037304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:55.044237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.044717 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.045152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.045842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:55.046293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:55.046746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:55.181896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:55.190237 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-044c317d-777c-4491-b1a0-29fa371474f2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.157485 Oct 04 22:26:55.190862 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3736/7367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:55 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:56.214197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:56.214876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:56.221667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.222161 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.223296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.224016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:56.224489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:56.224933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:56.357898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:56.365702 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-148fe3d6-6922-4f6f-ae9c-a1b40cf5481f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.155380 Oct 04 22:26:56.366295 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3632/7368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:56 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:57.388846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:57.389459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:57.396928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.397413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.397851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.398543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:57.399096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:57.399522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:57.527720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:57.536175 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63c30aca-ca16-4793-98f2-264c8e5ae67c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.151304 Oct 04 22:26:57.536792 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3737/7369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:57 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:58.558858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:58.559497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:58.562460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:58.568375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:58.568958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:58.569541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:58.570272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:58.570854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:58.571365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:58.622938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfe83b1-9b01-4ac9-acda-1634baf2abd5", "name": "network-vif-plugged", "status": "completed", "tag": "1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:26:58.628206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:58.629456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:26:58.635696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:58.642556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:58.642556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:58.652938 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] Creating event network-vif-plugged:1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0 for instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 on n-h2-851029-13 Oct 04 22:26:58.658308 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ed1a11eb-2ef0-4548-a0b8-2407dd932a7c req-f4a01fa1-45c6-44db-9ec2-977751918988 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Oct 04 22:26:58.658950 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3738/7370] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:26:58.712509 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:58.720423 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-27115775-aeae-41bc-835a-637bba971b1f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.165474 Oct 04 22:26:58.734686 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3633/7371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:58 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:26:59.746069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:26:59.746969 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:26:59.753966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:59.754446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:59.754918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:59.755629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:26:59.756079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:26:59.756515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:26:59.894516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:26:59.902600 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ced05c12-ce08-4114-93ae-136430532c3c tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1361 microversion: 2.1 time: 0.161967 Oct 04 22:26:59.903215 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3739/7372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:26:59 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:00.926105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:00.926705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:00.933840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:00.934329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:00.934809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:00.935508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:00.935973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:00.936407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:01.065010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:01.073809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7391147e-adf8-4824-9114-c97863676d47 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1553 microversion: 2.1 time: 0.152261 Oct 04 22:27:01.074378 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3634/7373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:00 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:01.096096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:01.096715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:01.104072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:01.104699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:01.105147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:01.105840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:01.106295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:01.106753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:01.111000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:01.245690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:01.253734 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfb5e0fe-e2da-4b0a-8b24-dde4000f3a6f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1553 microversion: 2.1 time: 0.161592 Oct 04 22:27:01.254343 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3740/7374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:01 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:04.330497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ced7c758-62f8-4291-9766-4f45395ec625"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:04.332927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:04.339927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:04.340426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:04.340879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:04.341593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:04.342174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:04.342506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:05.183174 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a3d2be3-1e1d-4d02-8384-e6a97f631688 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856552 Oct 04 22:27:05.183802 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3635/7375] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:27:04 2022] POST /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:16.976902 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:27:16.980590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:16.981093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:16.983395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:16.984086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:16.989477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:16.989986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:16.990426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:16.991146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:16.991604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:16.992060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.073849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lazy-loading 'services' on Instance uuid bbfe83b1-9b01-4ac9-acda-1634baf2abd5 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:27:17.305582 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58b24f19-59d9-4ac3-a29a-f19331f199b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments/ced7c758-62f8-4291-9766-4f45395ec625" status: 202 len: 0 microversion: 2.1 time: 0.329762 Oct 04 22:27:17.306218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3741/7376] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:27:16 2022] DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments/ced7c758-62f8-4291-9766-4f45395ec625 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:27:17.314129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:17.315005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:17.319665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:17.322036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:17.329209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.330043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.330240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.330974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:17.331933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:17.332372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:17.362634 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc1c65fd-f6a0-4e8e-a73c-9dd0b3d5ad41 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051386 Oct 04 22:27:17.363275 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3636/7377] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:17 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:18.378116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:18.381177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:18.389750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:18.390243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:18.390704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:18.391445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:18.391909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:18.392341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:18.400638 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48428. Oct 04 22:27:18.432574 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-238bfcf4-9358-4774-bc2b-e5b4a418275f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060952 Oct 04 22:27:18.433186 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3742/7378] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:18 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:19.446643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:19.449314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:19.458514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:19.459045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:19.459491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:19.460215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:19.460685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:19.461118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:19.500528 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-afe84cac-625a-48f1-bfd1-519b77453823 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056463 Oct 04 22:27:19.500528 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3637/7379] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:19 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:20.511234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:20.513418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:20.520713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.521205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.521647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.522360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:20.522844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:20.523276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:20.557659 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ee7c0ea8-5841-4eb9-854a-52b4108dcea5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051160 Oct 04 22:27:20.558454 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3743/7380] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:20 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:21.571443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:21.573770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:21.582362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.582893 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.583345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.584386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:21.584527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:21.584946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:21.616677 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e0e7907-c4b9-4006-bef1-cd833eb088e0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049867 Oct 04 22:27:21.617206 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3638/7381] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:21 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:22.629951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:22.632188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:22.639097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.639588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.640028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.640716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.641170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.641598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.670618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d61cdebd-c049-4d9e-8c72-106426f2fb3d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045259 Oct 04 22:27:22.671214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3744/7382] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:27:22 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:27:22.682724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:22.683249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:22.690001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.691091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.691791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.692487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:22.692943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:22.693376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:22.768893 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 is not attached to volume ced7c758-62f8-4291-9766-4f45395ec625 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments/ced7c758-62f8-4291-9766-4f45395ec625 HTTP/1.1 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 is not attached to volume ced7c758-62f8-4291-9766-4f45395ec625 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'bbfe83b1-9b01-4ac9-acda-1634baf2abd5', 'id': 'ced7c758-62f8-4291-9766-4f45395ec625'} Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ced7c758-62f8-4291-9766-4f45395ec625. Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 is not attached to volume ced7c758-62f8-4291-9766-4f45395ec625 Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:22.770626 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 is not attached to volume ced7c758-62f8-4291-9766-4f45395ec625 Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 is not attached to volume ced7c758-62f8-4291-9766-4f45395ec625 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2becd52-7f05-4c34-8b73-83133ed1f245 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments/ced7c758-62f8-4291-9766-4f45395ec625" status: 404 len: 154 microversion: 2.1 time: 0.093836 Oct 04 22:27:22.776485 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3639/7383] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:27:22 2022] DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5/os-volume_attachments/ced7c758-62f8-4291-9766-4f45395ec625 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:27:26.383479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:26.384174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:26.390899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:26.391386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:26.391828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:26.392526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:26.392986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:26.393917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:26.420474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:27:27.261698 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f66d6afd-e748-4de2-9b1b-dd6a8a3fb3b8 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 204 len: 0 microversion: 2.1 time: 0.882007 Oct 04 22:27:27.262318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3745/7384] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:27:26 2022] DELETE /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:27:27.271709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:27.311517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:27.417397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:27.425911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77b89f19-c75c-47f5-b538-aa5ce95ed769 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1559 microversion: 2.1 time: 0.158828 Oct 04 22:27:27.483000 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3640/7385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:27 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:28.449850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:28.450561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:28.458196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.458709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.459155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.459856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:28.460316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:28.460745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:28.595611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:28.603718 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dcb1b7b1-42c7-4d1c-9364-6d964eac83b2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1559 microversion: 2.1 time: 0.158302 Oct 04 22:27:28.604339 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3746/7386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:28 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:29.443590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbfe83b1-9b01-4ac9-acda-1634baf2abd5", "name": "network-vif-deleted", "tag": "1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:29.455023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.457610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.457610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.468152 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] Creating event network-vif-deleted:1d2e7d3b-2b0d-46a7-9a83-dfb5e82718e0 for instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 on n-h2-851029-13 Oct 04 22:27:29.473708 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-588141ca-9ef9-4f7d-b64d-94da04d45b53 req-b00928eb-2a93-47df-b074-3b6ca7afd237 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034534 Oct 04 22:27:29.474309 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3641/7387] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:29.627995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:29.628610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:29.635490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.635990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.636424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.637108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:29.637560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:29.637991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:29.707450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:29.715605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-10aa9a48-963e-4c0b-936f-fe544585bdc3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 200 len: 1346 microversion: 2.1 time: 0.091995 Oct 04 22:27:29.716400 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3747/7388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:29 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:30.740195 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:30.740936 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: bbfe83b1-9b01-4ac9-acda-1634baf2abd5] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:30.747957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.748453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.748905 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.749659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:30.751741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:30.751741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:30.764328 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 HTTP/1.1 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': 'bbfe83b1-9b01-4ac9-acda-1634baf2abd5'} Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:30.766042 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance bbfe83b1-9b01-4ac9-acda-1634baf2abd5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9fd3c476-dfe5-455d-9d90-376d8b107464 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5" status: 404 len: 111 microversion: 2.1 time: 0.032687 Oct 04 22:27:30.771961 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3642/7389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:30 2022] GET /compute/v2.1/servers/bbfe83b1-9b01-4ac9-acda-1634baf2abd5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:27:30.777189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-464cdec9-39e5-4eee-b769-31b519123412 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '.version_select at 0x7f54f5f28940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:30.894873 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-464cdec9-39e5-4eee-b769-31b519123412 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1040573182" status: 202 len: 0 microversion: 2.1 time: 0.121366 Oct 04 22:27:30.895395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3748/7390] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 22:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1040573182 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:27:30.913103 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2ed9f3e5-f5d3-4714-a28b-32e6fcf7591d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: .version_select at 0x7f54f6d18040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-591147484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcncjOFmL3pg1huJAi8LBH0j8TMlpPaBiJ8TFZ5BI04BfedQ9H8kLluwuiQ6+q8nVyLN/M3vuoaW8yWPydhtgKzi6laDY9Vra/Y0+zF+Ng3Js+hH+QM+qvKRq7ygSAvkg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:30.928667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2ed9f3e5-f5d3-4714-a28b-32e6fcf7591d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:27:30.934727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-2ed9f3e5-f5d3-4714-a28b-32e6fcf7591d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:27:31.020189 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2ed9f3e5-f5d3-4714-a28b-32e6fcf7591d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.111792 Oct 04 22:27:31.020811 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3643/7391] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:27:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:27:31.072463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-369984374", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-591147484", "networks": [{"uuid": "553624a5-f6a3-4dd8-b6e3-d70500a0a723"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:31.125240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] validate_networks() for [('553624a5-f6a3-4dd8-b6e3-d70500a0a723', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:27:31.570707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:27:31.571249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:27:31.571614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:27:31.572154 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:27:31.572596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:27:31.581827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.585080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.585080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.585080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:31.585080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:31.585080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:31.602687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:27:31.607876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Getting quotas for user 65c031ce6f8b4a859b2ec8cade5c7bbf and project 13c5c5e7cd154de793354185733d16b8. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:27:31.620597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:27:31.623054 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:27:31.744324 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15221a43-1884-47b1-b4a4-aa9e34d043f3 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675730 Oct 04 22:27:31.745028 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3749/7392] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:27:31.758058 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d774bfc6-95c2-4125-9193-9369d4c17619 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:31.758809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d774bfc6-95c2-4125-9193-9369d4c17619 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:31.812302 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d774bfc6-95c2-4125-9193-9369d4c17619 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:31.820666 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d774bfc6-95c2-4125-9193-9369d4c17619 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1261 microversion: 2.1 time: 0.068056 Oct 04 22:27:31.821246 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3644/7393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:31 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:32.843877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:32.844445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:32.852678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.853156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.853600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.854312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:32.854870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:32.855337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:32.918333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:32.927694 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73426a72-b8c7-4ede-8768-3c3e6726ff66 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1265 microversion: 2.1 time: 0.088012 Oct 04 22:27:32.928359 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3750/7394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:32 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:33.951686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:33.952280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:33.960356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.960853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.961333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:33.962061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:33.962531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:33.963004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:34.029052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:34.039233 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9764e890-3bf1-484f-9fc7-3f0a77202549 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1331 microversion: 2.1 time: 0.091350 Oct 04 22:27:34.042526 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3645/7395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:33 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:35.061797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:35.062787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:35.070039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.070618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.071120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.071876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.072339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.073065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.209225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:35.217105 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c2691b3-f2bb-4fdd-ad79-d749d15821c0 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.159370 Oct 04 22:27:35.217591 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3751/7396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:35 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:35.454707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750e77b6-0e5a-4ffb-8503-55f6b10580ad", "tag": "95f7ba0f-bcd7-495c-8eb7-827cdd921817"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:35.465802 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:35.476892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:35.476892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:35.479175 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] Creating event network-changed:95f7ba0f-bcd7-495c-8eb7-827cdd921817 for instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad on n-h1-851029-13 Oct 04 22:27:35.484493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1bdf187f-7df1-4f71-ba3d-4bafa5a00f22 req-a21f9f94-663b-46b8-bb38-23dda48563f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033862 Oct 04 22:27:35.485286 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3646/7397] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:36.243211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:36.244006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:36.251489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.251982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.252425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.253200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:36.253659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:36.254118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:36.402365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:36.411240 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15fe237b-5785-4213-8f08-5a3a9c19f534 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.172594 Oct 04 22:27:36.411925 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3752/7398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:36 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:37.437072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:37.437812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:37.444996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.445491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.445938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.446654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:37.447136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:37.447568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:37.590974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:37.599790 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-122c7b46-d715-454f-b86f-f4fd34f7ff63 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.168157 Oct 04 22:27:37.600575 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3647/7399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:37 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:38.623102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:38.623721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:38.630651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.631163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.631590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.632457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:38.632908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:38.633328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:38.773736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:38.781609 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ffb6f554-ca03-4270-95b1-e8dac7ac249a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.162460 Oct 04 22:27:38.782198 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3753/7400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:38 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:39.804347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:39.804979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:39.811863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.812366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.812823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:39.813537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:39.814004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:39.814448 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:39.952854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:39.961551 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c42a1481-5b7d-4550-967c-35b37d5d2bae tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.161067 Oct 04 22:27:39.962146 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3648/7401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:39 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:40.985188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:40.985814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:40.992760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:40.993265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:40.993701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:40.994390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:40.994882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:40.995349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:41.135171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:41.144378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7aa8c4ec-8f61-48e0-833e-22ddba7ae9bd tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.163003 Oct 04 22:27:41.145012 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3754/7402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:40 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:42.168667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:42.169239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:42.172056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:42.176957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:42.177460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:42.177921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:42.178637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:42.179140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:42.179582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:42.312577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:42.321571 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5dde9919-7e14-4e8b-9f26-f72f4b4a3994 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.156959 Oct 04 22:27:42.322179 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3649/7403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:42 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:43.012296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750e77b6-0e5a-4ffb-8503-55f6b10580ad", "name": "network-vif-plugged", "status": "completed", "tag": "95f7ba0f-bcd7-495c-8eb7-827cdd921817"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:43.017514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:43.022346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:43.024600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.025080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.025516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.036488 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] Creating event network-vif-plugged:95f7ba0f-bcd7-495c-8eb7-827cdd921817 for instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad on n-h1-851029-13 Oct 04 22:27:43.041449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-40dc8aed-7e38-41f9-9f0a-025608347081 req-69c2bb9d-c917-475a-9ed4-5e8860e552e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Oct 04 22:27:43.042115 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3755/7404] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:27:43.345257 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:43.345839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:43.352667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.353167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.353621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.354334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:43.354841 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:43.355280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:43.495912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:43.503991 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-391e1626-3032-4892-b257-8929b8a1d311 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.162831 Oct 04 22:27:43.504571 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3650/7405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:43 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:44.530269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:44.531004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:44.538827 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.539338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.539770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:44.540465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:44.540921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:44.541346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:44.680610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:44.688648 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a96b9b8-05fe-495c-8b85-1d0cebe08d03 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1361 microversion: 2.1 time: 0.163478 Oct 04 22:27:44.691109 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3756/7406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:44 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:45.713594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:45.714254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:45.721375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.722486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.722963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.723679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.724143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.724610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.862692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:45.870644 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af38c755-bc15-46a2-aa48-0a8e1bfe22d2 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1554 microversion: 2.1 time: 0.161030 Oct 04 22:27:45.871269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3651/7407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:45 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:45.893151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:27:45.894295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:45.901403 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.901897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.902338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.903082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:45.903544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:45.903978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:45.924345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:27:46.037155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:27:46.044806 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b02e9e48-901a-4f77-86d9-cb3e8b85a03d tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1554 microversion: 2.1 time: 0.155598 Oct 04 22:27:46.045377 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3757/7408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:27:45 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:27:49.235191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f75aa38d-5150-43a7-9d19-10aff3b519c7"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:27:49.237588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:27:49.244545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.245069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.245524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.247088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:27:49.247088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:27:49.247372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:27:49.989976 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d19d65eb-a9e0-47da-b45d-1b610ec08bf9 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "POST /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758630 Oct 04 22:27:49.990633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3652/7409] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:27:49 2022] POST /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:01.770588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:01.771182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:01.773701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:01.778648 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.779163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.779602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.780301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:01.780754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:01.781181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:01.864168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lazy-loading 'services' on Instance uuid 750e77b6-0e5a-4ffb-8503-55f6b10580ad {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:28:02.090840 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e4031e9-bc24-4dc4-93c9-f903eac551b5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments/f75aa38d-5150-43a7-9d19-10aff3b519c7" status: 202 len: 0 microversion: 2.1 time: 0.324470 Oct 04 22:28:02.091494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3758/7410] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:28:01 2022] DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments/f75aa38d-5150-43a7-9d19-10aff3b519c7 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:28:02.098518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:02.099391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:02.103705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:02.106145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:02.116167 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.116665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.117120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:02.117838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:02.118308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:02.118779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:02.148562 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a387eee9-7d75-4477-b566-0fd931e484db tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052452 Oct 04 22:28:02.149157 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3653/7411] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:02 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:03.162927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:03.165269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:03.171799 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:03.172281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:03.172710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.173400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:03.173910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:03.174820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:03.206274 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b5768ed7-8283-44e1-8d91-9a7be273d6d5 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048555 Oct 04 22:28:03.206875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3759/7412] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:03 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:04.219620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:04.221894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:04.230230 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:04.230759 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:04.231215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:04.231944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:04.232415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:04.232857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:04.267004 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb954a74-0837-49bd-820d-422fa7283a21 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051992 Oct 04 22:28:04.267613 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3654/7413] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:04 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:05.279693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:05.281892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:05.290577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.291094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.291532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.292223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:05.292673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:05.293097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:05.323958 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18befee1-7d09-437a-bd8c-e145aef6b53a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Oct 04 22:28:05.324655 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3760/7414] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:05 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:06.337096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:06.339507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:06.347546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:06.348049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:06.348500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:06.349208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:06.349668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:06.350105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:06.381710 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4765cc05-8762-4ed5-9ead-20cfe2bc2513 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049277 Oct 04 22:28:06.383143 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3655/7415] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:06 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:07.394125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:07.396358 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:07.403142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:07.403736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:07.404129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:07.404820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:07.405266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:07.405688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:07.435885 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ab1f189-f21a-4ef7-82ca-ecd3ec4cd41a tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046314 Oct 04 22:28:07.436478 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3761/7416] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:28:07 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 22:28:07.448382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:07.448963 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:07.456270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:07.456772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:07.457226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:07.457941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:07.458412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:07.458894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:07.542466 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad is not attached to volume f75aa38d-5150-43a7-9d19-10aff3b519c7 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments/f75aa38d-5150-43a7-9d19-10aff3b519c7 HTTP/1.1 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad is not attached to volume f75aa38d-5150-43a7-9d19-10aff3b519c7 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': '750e77b6-0e5a-4ffb-8503-55f6b10580ad', 'id': 'f75aa38d-5150-43a7-9d19-10aff3b519c7'} Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f75aa38d-5150-43a7-9d19-10aff3b519c7. Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad is not attached to volume f75aa38d-5150-43a7-9d19-10aff3b519c7 Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:07.544082 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad is not attached to volume f75aa38d-5150-43a7-9d19-10aff3b519c7 Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad is not attached to volume f75aa38d-5150-43a7-9d19-10aff3b519c7 {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8cec333-0e63-4396-bf06-ee5fd92380f6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments/f75aa38d-5150-43a7-9d19-10aff3b519c7" status: 404 len: 154 microversion: 2.1 time: 0.101296 Oct 04 22:28:07.552558 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3656/7417] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:28:07 2022] DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad/os-volume_attachments/f75aa38d-5150-43a7-9d19-10aff3b519c7 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:28:11.140011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:11.140505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:11.147466 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:11.147948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:11.148382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:11.149076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:11.149529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:11.149948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:11.176988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:28:11.551756 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cfef406-3106-41fd-8040-ada2e27d1f3f tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 204 len: 0 microversion: 2.1 time: 0.415495 Oct 04 22:28:11.555350 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3762/7418] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:28:11 2022] DELETE /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:28:11.560946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:11.561584 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:11.571165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:11.571682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:11.572296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:11.573021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:11.573488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:11.573958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:11.709575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:11.717623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-87e4d021-afa9-49ec-bdf9-5e1847875cb6 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1560 microversion: 2.1 time: 0.160872 Oct 04 22:28:11.718202 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3657/7419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:11 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:12.742079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:12.742867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:12.749826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:12.753894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:12.753894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:12.753894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:12.753894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:12.753894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:12.886487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:12.894976 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f28df023-a488-4252-be9f-56d429af0f65 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1560 microversion: 2.1 time: 0.157403 Oct 04 22:28:12.895568 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3763/7420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:12 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:13.688830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750e77b6-0e5a-4ffb-8503-55f6b10580ad", "name": "network-vif-deleted", "tag": "95f7ba0f-bcd7-495c-8eb7-827cdd921817"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:13.696290 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:28:13.701558 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 04 22:28:13.704256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:13.704758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:13.707981 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:13.720819 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] Creating event network-vif-deleted:95f7ba0f-bcd7-495c-8eb7-827cdd921817 for instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad on n-h1-851029-13 Oct 04 22:28:13.725872 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ea52523c-e4b9-46c1-b132-ef210b1fdabb req-f77fe16f-4d1a-4e27-809b-e0dfb25c62fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040766 Oct 04 22:28:13.726573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3658/7421] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:13.917837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:13.918402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:13.926366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:13.926869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:13.927304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:13.927990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:13.928442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:13.928861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:13.996122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c031ce6f8b4a859b2ec8cade5c7bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c5c5e7cd154de793354185733d16b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:14.004374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5a4ba5ae-1b37-496f-9b04-c749a1c63607 tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 200 len: 1346 microversion: 2.1 time: 0.090643 Oct 04 22:28:14.006695 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3764/7422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:13 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:15.029447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:15.030197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] [instance: 750e77b6-0e5a-4ffb-8503-55f6b10580ad] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:15.037163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:15.037657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:15.038120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:15.038858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:15.039335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:15.039783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:15.053363 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] HTTP exception thrown: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Request method failure captured: Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad HTTP/1.1 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLLzdeQDh0Zwi3Ty6n3qwHdYiM2QglP9e68jXnV8UUrlwWrUnD4tAK8b3G10RHyPKqy7SEW1t_r6B-hmgmiZiy6d1eDr3ynaobLRYClT-wmljYBrmuDLFwY7koS7idLQdJ6av0p8idRtggPTmRnDMJa0lSwb7N03wvar3MUhXiuKSJg Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13c5c5e7cd154de793354185733d16b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13c5c5e7cd154de793354185733d16b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 13c5c5e7cd154de793354185733d16b8 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1419777662 Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 65c031ce6f8b4a859b2ec8cade5c7bbf Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestEncryptedCinderVolumes-1419777662-project Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '750e77b6-0e5a-4ffb-8503-55f6b10580ad'} Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:15.055046 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Returning 404 to user: Instance 750e77b6-0e5a-4ffb-8503-55f6b10580ad could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09089ee7-f363-4345-ad18-eaf5825f167b tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad" status: 404 len: 111 microversion: 2.1 time: 0.032183 Oct 04 22:28:15.060622 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3659/7423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:15 2022] GET /compute/v2.1/servers/750e77b6-0e5a-4ffb-8503-55f6b10580ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:28:15.066996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-631d24a6-4393-42af-b8d0-9b88cc8454cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] Calling method '.version_select at 0x7f54f4d1a5e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:15.155952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-631d24a6-4393-42af-b8d0-9b88cc8454cb tempest-TestEncryptedCinderVolumes-1419777662 tempest-TestEncryptedCinderVolumes-1419777662-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-591147484" status: 202 len: 0 microversion: 2.1 time: 0.093119 Oct 04 22:28:15.156541 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3765/7424] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 4 22:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-591147484 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:28:49.092236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f464eefd-5d20-4936-8dc2-3dbabf7cf039 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: .version_select at 0x7f54f5e9f3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1614300410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8GyZ9PzGgLcC1ryjt9rZcQ03RTJudmm04Xv4zKQcaV64Jh2phqnmJqW+sZc4LZVs4+bNda1t7JYOQI/oCf/X21mhBvx1GgLIN0RmZhehTzUlgLswdkES5tRoqGe+R8hA=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:49.097852 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=14 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:49.098525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=34 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:49.109522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f464eefd-5d20-4936-8dc2-3dbabf7cf039 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:28:49.118403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-f464eefd-5d20-4936-8dc2-3dbabf7cf039 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for user 7f03e4cbd9c04c25aa8a66a382850760 and project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:28:49.278283 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f464eefd-5d20-4936-8dc2-3dbabf7cf039 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.190109 Oct 04 22:28:49.279654 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3660/7425] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:28:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:28:49.330090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:49.330879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:28:49.334964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-398220150", "imageRef": "80db76b7-2c5a-471b-b5f0-b8619219c4e3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1614300410", "networks": [{"uuid": "1e384aa1-c042-4636-9a55-40744d6aa827"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:28:49.387813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] validate_networks() for [('1e384aa1-c042-4636-9a55-40744d6aa827', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:28:49.777407 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:28:49.777867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:28:49.778338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:28:49.778785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:28:49.779194 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:28:49.788245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:49.788720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:49.789151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:49.789868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:49.790328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:49.790775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:49.807937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:28:49.813760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for user 7f03e4cbd9c04c25aa8a66a382850760 and project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:28:49.826854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:28:49.829153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='80db76b7-2c5a-471b-b5f0-b8619219c4e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:28:49.943722 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2649e65-a810-4864-b680-516e99d62685 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616682 Oct 04 22:28:49.944295 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3766/7426] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:28:49.956057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-355fd137-4e47-454f-a82e-57cb48702dea tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:49.956655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-355fd137-4e47-454f-a82e-57cb48702dea tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:50.014270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-355fd137-4e47-454f-a82e-57cb48702dea tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:50.021670 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-355fd137-4e47-454f-a82e-57cb48702dea tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1258 microversion: 2.1 time: 0.069852 Oct 04 22:28:50.022606 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3661/7427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:49 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:51.046419 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccd228fe-b64e-41e7-a836-5b028c70fb2a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:51.048368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ccd228fe-b64e-41e7-a836-5b028c70fb2a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:51.103479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ccd228fe-b64e-41e7-a836-5b028c70fb2a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:51.111704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ccd228fe-b64e-41e7-a836-5b028c70fb2a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1258 microversion: 2.1 time: 0.069697 Oct 04 22:28:51.112632 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3767/7428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:51 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:52.135174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:52.136216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:52.143032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:52.143633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:52.144075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:52.144792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:52.145248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:52.145683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:52.209042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:52.217557 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1144232d-142a-4f7f-a2a6-08eb7a79ac86 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1310 microversion: 2.1 time: 0.086379 Oct 04 22:28:52.218142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3662/7429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:52 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:53.241313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:53.242023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:53.249656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:53.250982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:53.251552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:53.252571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:53.252984 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:53.253535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:53.330269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:53.338352 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-75055fba-aac0-4965-a3a4-c2eb361e2707 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1316 microversion: 2.1 time: 0.101696 Oct 04 22:28:53.339015 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3768/7430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:53 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:54.366647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:54.367888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:54.376489 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:54.377179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:54.377889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:54.378610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:54.379100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:54.379537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:54.577667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:54.587753 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b9ea1a2-32c9-4897-9578-554edf7456f3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.226671 Oct 04 22:28:54.589985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3663/7431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:54 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:55.611213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:55.611873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:55.621495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:55.622053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:55.622589 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:55.623368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:55.624059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:55.624783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:55.787252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:55.796618 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3cbc1513-b85e-44fa-b15a-b7868c097dee tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.189576 Oct 04 22:28:55.797904 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3769/7432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:55 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:56.902813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:57.042565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:57.054736 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4c47f16-d20f-4e5e-add7-8680a4895e14 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.215802 Oct 04 22:28:57.064817 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3664/7433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:56 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:58.077841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:58.079951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:58.088174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:58.089072 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:58.089764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:58.090828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:58.091571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:58.092286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:58.314710 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:58.326950 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d446e3c3-e828-4be7-b0e9-411ef6be6318 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.252836 Oct 04 22:28:58.327869 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3770/7434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:58 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:28:59.384913 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:28:59.386035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:28:59.395840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:59.396360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:59.396824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:59.397629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:28:59.398404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:28:59.399153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:28:59.599060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:28:59.609535 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e6d9af21-ef78-4964-b90c-c7dd48ad5c51 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.228664 Oct 04 22:28:59.623429 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3665/7435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:28:59 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:00.633757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:00.634451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:00.637247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:00.643003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:00.643559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:00.644012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:00.644912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:00.645376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:00.645845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:00.813449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:00.822106 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6a0f0de-423c-4eca-aa92-96021d88a22e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.192439 Oct 04 22:29:00.822728 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3771/7436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:00 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:01.847836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:01.851896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:01.853287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:01.859279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:01.860290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:01.860737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:01.861554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:01.862024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:01.862474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:02.123091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:02.131603 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ae59606-d377-460a-b113-3f042b37b437 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.289644 Oct 04 22:29:02.132304 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3666/7437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:01 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:02.501643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:02.567506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:02.578986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:02.579470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:02.579899 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:02.591443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] Creating event network-changed:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:29:02.596605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-88acab67-7c2e-42e5-ba7d-a789af0a6cd7 req-f4bba744-9834-47be-ae56-88c0d31a7484 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099445 Oct 04 22:29:02.597214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3772/7438] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:03.155193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:03.160857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:03.165695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:03.166445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:03.167127 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:03.168100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:03.168706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:03.169265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:03.332853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:03.340990 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1c40a95-59a8-4ccd-bb07-f7075441c195 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.190528 Oct 04 22:29:03.341592 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3667/7439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:03 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:04.365304 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:04.366113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:04.375255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:04.375782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:04.376228 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:04.376985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:04.377439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:04.377870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:04.584785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:04.593155 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a864fc89-3673-4c0e-9731-01f979b10f0b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.232158 Oct 04 22:29:04.593899 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3773/7440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:04 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:05.617476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:05.618100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:05.625283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:05.626035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:05.626234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:05.627032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:05.627506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:05.627950 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:05.759822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:05.768484 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-760c7352-b7ef-49fe-88ab-7d44f15eb03a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.154654 Oct 04 22:29:05.774686 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3668/7441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:05 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:06.791748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:06.792391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:06.799386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:06.799861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:06.800292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:06.800978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:06.801430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:06.801854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:06.941445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:06.950397 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63c50a31-eafc-4ef8-8e73-91ea89487817 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.162705 Oct 04 22:29:06.951025 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3774/7442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:06 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:07.281860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "name": "network-vif-plugged", "status": "completed", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:07.291873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:07.292353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:07.292801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:07.304717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] Creating event network-vif-plugged:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:29:07.309797 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-74d5dabb-003b-4aab-8cb2-2bcdb5c28919 req-d9015d7c-d74e-41dc-b15f-e48f2ad6a981 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086154 Oct 04 22:29:07.310417 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3669/7443] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:07.975296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:07.975902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:07.983198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:07.983675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:07.984190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:07.984884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:07.985338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:07.985760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:08.127070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:08.134734 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-751c9093-f4fa-4209-96fc-ba38292c8da0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1358 microversion: 2.1 time: 0.163264 Oct 04 22:29:08.135304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3775/7444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:07 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:09.158970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:09.159823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:09.165849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.166332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.166809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.167506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.167967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.168401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.304180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:09.312816 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1e96ec90-0b68-4802-aa20-662dab43214c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1548 microversion: 2.1 time: 0.158341 Oct 04 22:29:09.322989 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3670/7445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:09 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:09.336236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:09.336851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:09.344328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.344808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.346015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.346015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.346460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.347070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.477556 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:09.485890 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87f83f09-b82d-454e-9427-966d8e42fd9e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1548 microversion: 2.1 time: 0.153559 Oct 04 22:29:09.486463 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3776/7446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:09 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:09.507790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:09.512608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:09.513379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Searching by: {'deleted': False, 'project_id': '2303c480f63d4d1e90ecf439c71e787a'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:29:09.518830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.519321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.519762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.520488 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.520949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.521380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.545573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:29:09.573329 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce208217-f01b-45f2-b0a3-19ea446a70e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069315 Oct 04 22:29:09.573920 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3671/7447] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 22:29:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:29:09.586141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:09.586778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:09.593002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.593483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.593917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.594610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:09.595149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:09.595574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:09.729427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:09.736899 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0f8633d4-4712-4604-a3ff-c2dd2b03885f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1548 microversion: 2.1 time: 0.154698 Oct 04 22:29:09.737554 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3777/7448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:09 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:29:12.874372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2403869-cf08-4e1a-b82b-5c4b0eab1cad"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:12.877583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:12.885291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:12.885822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:12.886315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:12.887182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:12.887674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:12.888159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:13.766344 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-82e044e5-fa90-4099-bd7a-cc3e69ba3d01 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896299 Oct 04 22:29:13.767039 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3672/7449] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:29:12 2022] POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:28.233972 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:28.234879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:28.237171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:28.237837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=58 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:28.242499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:28.243016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:28.243451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:28.244158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:28.244616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:28.245039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:28.373643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:28.382565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-181677e3-a5e3-4e41-95a5-b78a5ba72aaf tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1594 microversion: 2.1 time: 0.152533 Oct 04 22:29:28.383183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3778/7450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:28 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:29:30.714181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:30.720196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:30.720196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:29:30.720662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:30.733923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:30.734536 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:30.735043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:30.747884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] Creating event network-changed:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:29:30.753516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6957c643-71e3-4605-804e-15656dc977ee req-e4ded851-86ea-41f3-bc16-edf94519b40d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041684 Oct 04 22:29:30.754126 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3673/7451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:33.829844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1423990960"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:33.830401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:33.837575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:33.838060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:33.838496 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:33.839223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:33.839678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:33.840103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:33.967378 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Adding security group 5e25f2f9-34e2-45fe-9d82-c4fb2f51a730 to port 1939e97a-38ba-4675-8e7b-7f044e3625f3 Oct 04 22:29:34.382182 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6f9cdb9-e320-414b-9982-46f059fc0ca0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action" status: 202 len: 0 microversion: 2.1 time: 0.556548 Oct 04 22:29:34.386427 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3779/7452] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:29:33 2022] POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:29:34.397113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:29:34.397730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:29:34.397868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:29:34.405865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.406381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.407098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.408221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.408632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.409080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.422282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:29:34.424610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:29:34.424610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:29:34.440429 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] Creating event network-changed:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:29:34.446369 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cf4c020d-a6f3-4b4e-84cc-327978bb0662 req-c1750828-4d34-4e7b-99da-a749a40ddb5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053738 Oct 04 22:29:34.447046 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3780/7453] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:29:34.687708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:29:34.697452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-49458186-8bca-41bf-b314-a3914f3fb402 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1759 microversion: 2.1 time: 0.309173 Oct 04 22:29:34.699706 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3674/7454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:29:34 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1759 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:06.588883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:06.589680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:06.595724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:31:06.598083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:06.607252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:06.607820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:06.608267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:06.608988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:06.609467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:06.609886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:06.855284 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47e5b3c2-48ba-4e3c-be71-83c4c1c63ef5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action" status: 202 len: 0 microversion: 2.1 time: 0.268820 Oct 04 22:31:06.855996 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3781/7455] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:31:06 2022] POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:31:06.862744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:31:06.867729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:06.871233 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:06.874851 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:06.875348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:06.875800 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:06.876515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:06.876985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:06.877427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:07.077908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:07.087399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6170189f-c588-41df-9bc2-1a6bb045800a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1761 microversion: 2.1 time: 0.226937 Oct 04 22:31:07.087999 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3675/7456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:06 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1761 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:08.113148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:08.113927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:08.122901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:08.123397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:08.123842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:08.124550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:08.125012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:08.125444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:08.279083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:08.288126 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e6603df-589e-4041-93a9-0f397f79795d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1766 microversion: 2.1 time: 0.180122 Oct 04 22:31:08.288770 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3782/7457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:08 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1766 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:31:09.311861 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:31:09.312487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:31:09.322092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:09.322583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:09.323067 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:09.323792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:31:09.324265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:31:09.324703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:31:09.475174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:31:09.484200 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9b8a3039-ca2a-404f-9344-a9e07e0ca42c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1759 microversion: 2.1 time: 0.176253 Oct 04 22:31:09.487680 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3676/7458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:31:09 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:23.468663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:23.469440 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:23.474175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1423990960"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:23.474740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:23.483386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:23.483875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:23.484317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:23.485014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:23.485469 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:23.485896 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:23.685652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Removing security group 5e25f2f9-34e2-45fe-9d82-c4fb2f51a730 from port 1939e97a-38ba-4675-8e7b-7f044e3625f3 Oct 04 22:32:24.051244 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20c11b24-15bb-4fbc-b418-a880a1f26a5b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action" status: 202 len: 0 microversion: 2.1 time: 0.584525 Oct 04 22:32:24.055635 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3783/7459] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:32:23 2022] POST /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:24.060830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:24.061792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=20 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:24.065990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:24.080801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:24.081450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:24.081906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:24.095346 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] Creating event network-changed:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:32:24.100136 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] [0bcef439-1ba8-40a2-bee4-fb7764b0fa54] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:32:25.108126 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] [0bcef439-1ba8-40a2-bee4-fb7764b0fa54] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49096. Oct 04 22:32:25.111429 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-de839a5d-766f-41f6-a475-b7be2d5e44ce req-83c46338-a499-42c0-bbbb-d29cf0852850 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054121 Oct 04 22:32:25.112055 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3677/7460] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:25.504091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:25.505220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:25.516651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.517346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.517898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.519349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.519916 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.520456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.612801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lazy-loading 'services' on Instance uuid f552583c-a18c-4c4d-83c3-deba849b8009 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:32:25.787462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-143b696d-2e3b-4047-b372-827d2bb9ff2e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments/f2403869-cf08-4e1a-b82b-5c4b0eab1cad" status: 202 len: 0 microversion: 2.1 time: 0.288475 Oct 04 22:32:25.788530 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3784/7461] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:32:25 2022] DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments/f2403869-cf08-4e1a-b82b-5c4b0eab1cad => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:25.798770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:25.801786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:25.812000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.812766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.816055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.816055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:25.816055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:25.816055 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:25.847353 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1c36d137-f6ac-4d78-b013-20e5e148258f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053267 Oct 04 22:32:25.848244 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3678/7462] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:25 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:26.860962 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:26.863465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:26.871217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:26.871697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:26.872137 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:26.872835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:26.873287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:26.873712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:26.903788 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4aae3fa0-57af-49a0-ad04-a33ef19b870a tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Oct 04 22:32:26.904367 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3785/7463] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:26 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:27.133924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:27.149793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:27.153319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:27.153319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:27.164453 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] Creating event network-changed:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:32:27.172623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4ac67cc2-365c-4baf-a62f-d1446f082153 req-c7e04491-0057-4ddc-8516-021bd482b32d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042026 Oct 04 22:32:27.173904 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3679/7464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:27.916716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:27.919013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:27.926932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:27.927431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:27.927877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:27.928600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:27.929162 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:27.929504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:27.965095 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ae65660-aad5-4337-9295-124667a29ac7 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052370 Oct 04 22:32:27.965693 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3786/7465] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:27 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:28.979825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:28.982101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:28.991666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:28.992170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:28.992629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:28.993352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:28.993830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:28.994277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:29.025621 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7505cea-815e-44f0-bcb6-67880446f3ab tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051166 Oct 04 22:32:29.026208 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3680/7466] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:28 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:30.038206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:30.040682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:30.047774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:30.048339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:30.048851 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:30.050247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:30.050805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:30.051305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:30.081279 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8030ebcb-98b6-4624-92d7-1e7278396174 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Oct 04 22:32:30.081856 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3787/7467] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:30 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:31.093575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:31.095866 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:31.103519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.104012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.104462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.105231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.105691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.106125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.134822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb968aed-3b5e-465f-9ff9-355c47c0556d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045201 Oct 04 22:32:31.135383 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3681/7468] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:32:31 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:32:31.146465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:31.147006 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:31.153724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.154208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.154652 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.155362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:31.155819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:31.156245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:31.231893 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] HTTP exception thrown: Instance f552583c-a18c-4c4d-83c3-deba849b8009 is not attached to volume f2403869-cf08-4e1a-b82b-5c4b0eab1cad Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Request method failure captured: Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: request: DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments/f2403869-cf08-4e1a-b82b-5c4b0eab1cad HTTP/1.1 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLOPdf9NJS0Vn7XLIjrPbCd2G0apP-e5iIKEa4OqHGmGVsnEYYB1wGkeC0xjO2YPSNLKQHSx91j9_WY3BOXw081zfTo64jnmLTVVjYA3IWUUMMPzNtBF-ohBRs4lECMj__R67FZuWYFrsxL3xpKdChqcqqK__ctsIOqSVcd-vW3KAcg Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7f03e4cbd9c04c25aa8a66a382850760 Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f552583c-a18c-4c4d-83c3-deba849b8009 is not attached to volume f2403869-cf08-4e1a-b82b-5c4b0eab1cad Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'server_id': 'f552583c-a18c-4c4d-83c3-deba849b8009', 'id': 'f2403869-cf08-4e1a-b82b-5c4b0eab1cad'} Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f2403869-cf08-4e1a-b82b-5c4b0eab1cad. Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f552583c-a18c-4c4d-83c3-deba849b8009 is not attached to volume f2403869-cf08-4e1a-b82b-5c4b0eab1cad Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:31.233822 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f552583c-a18c-4c4d-83c3-deba849b8009 is not attached to volume f2403869-cf08-4e1a-b82b-5c4b0eab1cad Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Returning 404 to user: Instance f552583c-a18c-4c4d-83c3-deba849b8009 is not attached to volume f2403869-cf08-4e1a-b82b-5c4b0eab1cad {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-57fbe432-c663-4b2f-b504-b31cbc6749cb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments/f2403869-cf08-4e1a-b82b-5c4b0eab1cad" status: 404 len: 154 microversion: 2.1 time: 0.093370 Oct 04 22:32:31.239517 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3788/7469] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:32:31 2022] DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009/os-volume_attachments/f2403869-cf08-4e1a-b82b-5c4b0eab1cad => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:32:34.666255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:34.666871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:34.673967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:34.684033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:34.684033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:34.684033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:34.684033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:34.684033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:34.707593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:32:35.014919 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-622f4281-620d-4958-b3a3-9705566205f8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 204 len: 0 microversion: 2.1 time: 0.352626 Oct 04 22:32:35.015552 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3682/7470] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:32:34 2022] DELETE /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:32:35.023912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:35.024597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:35.033218 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:35.033723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:35.034563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:35.035325 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:35.035779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:35.036206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:35.178468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:35.186419 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59e2274a-fe82-4262-ba16-3d37bbea3f13 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1554 microversion: 2.1 time: 0.166563 Oct 04 22:32:35.187234 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3789/7471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:35 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:36.210133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:36.210887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:36.217742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:36.218239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:36.218710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:36.219422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:36.219895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:36.220333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:36.410299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:36.419092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7627804-8721-48cb-896f-18f85ab08860 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1554 microversion: 2.1 time: 0.213128 Oct 04 22:32:36.419962 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3683/7472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:36 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:37.141460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f552583c-a18c-4c4d-83c3-deba849b8009", "name": "network-vif-deleted", "tag": "1939e97a-38ba-4675-8e7b-7f044e3625f3"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:37.151996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:37.158044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:37.158044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:37.164264 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] Creating event network-vif-deleted:1939e97a-38ba-4675-8e7b-7f044e3625f3 for instance f552583c-a18c-4c4d-83c3-deba849b8009 on n-h2-851029-13 Oct 04 22:32:37.169213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-27d8ae2d-17a5-4e3a-abcc-5cd5f4373e31 req-46c3ffa1-f5a5-49fd-9408-76e415f835f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031468 Oct 04 22:32:37.169843 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3790/7473] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:37.442979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:37.443960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:37.451382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:37.451884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:37.454024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:37.454863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:37.455358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:37.455812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:37.491603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:37.492171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:37.492662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:37.493291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lazy-loading 'fault' on Instance uuid f552583c-a18c-4c4d-83c3-deba849b8009 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:32:37.536076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:37.544565 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54b41b2c-c9ca-46c9-8ee0-8257b0824477 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 200 len: 1348 microversion: 2.1 time: 0.105571 Oct 04 22:32:37.545262 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3684/7474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:37 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:38.570814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:38.571519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: f552583c-a18c-4c4d-83c3-deba849b8009] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:38.577780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.578265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.578727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.579429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:38.579884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:38.580312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:38.594139 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] HTTP exception thrown: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Request method failure captured: Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 HTTP/1.1 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLOPdf9NJS0Vn7XLIjrPbCd2G0apP-e5iIKEa4OqHGmGVsnEYYB1wGkeC0xjO2YPSNLKQHSx91j9_WY3BOXw081zfTo64jnmLTVVjYA3IWUUMMPzNtBF-ohBRs4lECMj__R67FZuWYFrsxL3xpKdChqcqqK__ctsIOqSVcd-vW3KAcg Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7f03e4cbd9c04c25aa8a66a382850760 Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'f552583c-a18c-4c4d-83c3-deba849b8009'} Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:32:38.595798 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Returning 404 to user: Instance f552583c-a18c-4c4d-83c3-deba849b8009 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59adf0f1-a115-4349-b145-a0dd4ca8c388 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009" status: 404 len: 111 microversion: 2.1 time: 0.032405 Oct 04 22:32:38.602539 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3791/7475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:38 2022] GET /compute/v2.1/servers/f552583c-a18c-4c4d-83c3-deba849b8009 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:32:38.606497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-053b7275-0b2c-4e7e-b6be-a049dcc9a37d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '.version_select at 0x7f54f5eb6790>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:38.611007 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-053b7275-0b2c-4e7e-b6be-a049dcc9a37d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:32:39.617978 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-053b7275-0b2c-4e7e-b6be-a049dcc9a37d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49168. Oct 04 22:32:39.758911 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-053b7275-0b2c-4e7e-b6be-a049dcc9a37d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1614300410" status: 202 len: 0 microversion: 2.1 time: 1.156039 Oct 04 22:32:39.759437 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3685/7476] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 4 22:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1614300410 => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:32:51.558650 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d0e4d0c-1a58-4b02-aa3f-8f5aaf89c6bc tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: .version_select at 0x7f54f4d05280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-254772464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr6XTaFAPy/RyD/l2PVNz+ryspHetTJ0PY7QZbULZtQzo3G8nWZuGjGTf83GFvPe6mThGLiEQRZ5jNkHtvM306/zSr1c5YYaDYN77gOEzs8Ncu5/inm2LAdPnVFIVS66w=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:51.568518 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:32:51.568925 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 04 22:32:51.570110 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:32:51.570266 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 04 22:32:51.571367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=18 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:51.573233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:51.595307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0d0e4d0c-1a58-4b02-aa3f-8f5aaf89c6bc tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:32:51.601313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0d0e4d0c-1a58-4b02-aa3f-8f5aaf89c6bc tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for user 7f03e4cbd9c04c25aa8a66a382850760 and project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:32:51.719916 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d0e4d0c-1a58-4b02-aa3f-8f5aaf89c6bc tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.167143 Oct 04 22:32:51.720437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3792/7477] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:32:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:32:51.771368 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:32:51.771909 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:32:51.773371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:51.774149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:32:51.778215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1075693672", "imageRef": "9a0800e7-674f-4479-8e68-42654b32b964", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-254772464", "networks": [{"uuid": "1e384aa1-c042-4636-9a55-40744d6aa827"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:32:51.836016 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] validate_networks() for [('1e384aa1-c042-4636-9a55-40744d6aa827', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:32:52.325091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:32:52.325537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:32:52.326221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:32:52.326655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:32:52.327117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:32:52.339209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:52.339707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:52.340158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:52.340919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:52.341409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:52.341848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:52.363910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:32:52.370073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Getting quotas for user 7f03e4cbd9c04c25aa8a66a382850760 and project 2303c480f63d4d1e90ecf439c71e787a. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:32:52.383889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:32:52.386170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9a0800e7-674f-4479-8e68-42654b32b964',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:32:52.663849 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68bd94fa-bbfd-4a1e-a782-1e8c414b5eb1 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896256 Oct 04 22:32:52.664519 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3686/7478] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:32:52.677265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2662e69-c0fe-413f-ac24-97f4f94d8ce0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:52.677893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2662e69-c0fe-413f-ac24-97f4f94d8ce0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:52.739409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f2662e69-c0fe-413f-ac24-97f4f94d8ce0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:52.747120 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2662e69-c0fe-413f-ac24-97f4f94d8ce0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1258 microversion: 2.1 time: 0.075372 Oct 04 22:32:52.747718 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3793/7479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:52 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:53.774546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51687d18-fd0b-4b76-858b-3ec723522f04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:53.775319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51687d18-fd0b-4b76-858b-3ec723522f04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:53.834878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51687d18-fd0b-4b76-858b-3ec723522f04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:53.842573 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51687d18-fd0b-4b76-858b-3ec723522f04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1258 microversion: 2.1 time: 0.071923 Oct 04 22:32:53.843276 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3687/7480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:53 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:32:54.866723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:54.867378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:54.875122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:54.875613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:54.876060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:54.876762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:54.877715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:54.878143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:54.941898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:54.950405 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6279e860-00da-40e7-abfe-0e1463755eb5 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1310 microversion: 2.1 time: 0.087743 Oct 04 22:32:54.952605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3794/7481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:54 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:55.974976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:55.976515 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:55.985180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:55.986333 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:55.987074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:55.988468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:55.989222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:55.989838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:56.192594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:56.204045 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22aa952f-46c5-452a-a3f5-adf88cee8c82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.233656 Oct 04 22:32:56.205013 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3688/7482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:55 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:57.230233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:57.231787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:57.239911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:57.240398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:57.240836 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:57.241575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:57.242028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:57.242454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:57.394400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:57.404225 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3f49e96-f586-4155-93c4-1a13dc0e0e60 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.178437 Oct 04 22:32:57.406485 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3795/7483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:57 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:58.430101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:58.431034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:58.437712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:58.438224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:58.438769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:58.440009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:58.440519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:58.440992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:58.594199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:58.602289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32ee84a9-743f-4f86-84f5-0fdbc65907af tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.177264 Oct 04 22:32:58.603324 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3689/7484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:58 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:32:59.625544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:32:59.626902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:32:59.634861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:59.635936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:59.636636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:59.637604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:32:59.638063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:32:59.638541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:32:59.793692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:32:59.804110 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80f9767f-f501-4774-9696-d2ea3072376c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.182531 Oct 04 22:32:59.804715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3796/7485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:32:59 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:00.981234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:01.003198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:01.014717 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3c2c4de-e972-4752-af22-385ff5a96a54 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.190487 Oct 04 22:33:01.015928 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3690/7486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:00 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:02.044567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:02.045422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:02.053593 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.054092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.054549 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.055300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:02.055762 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:02.056198 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:02.206699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:02.215522 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed3dad72-1f98-43d9-8850-20b341ba80d0 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.175141 Oct 04 22:33:02.216542 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3797/7487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:02 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:03.239985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:03.240664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:03.243554 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:03.248776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:03.249282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:03.249736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:03.250470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:03.250972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:03.255384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:03.395178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:03.403322 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a86b0c80-82de-4cfb-910b-002d3f2b6a6f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.167746 Oct 04 22:33:03.403931 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3691/7488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:03 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:04.425882 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:04.426686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:04.428874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:04.435091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:04.435588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:04.436027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:04.436750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:04.437242 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:04.437707 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:04.591627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:04.602979 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c45db0d0-5019-418c-b34b-35394fcd3667 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.181020 Oct 04 22:33:04.603609 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3798/7489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:04 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:33:05.626638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:05.627317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:05.629503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:05.635659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:05.636160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:05.636611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:05.637336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:05.637805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:05.638245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:05.804928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:05.813572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a762c92d-89f4-43d2-81ab-c8ca4c5964c9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.191041 Oct 04 22:33:05.814743 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3692/7490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:05 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:06.837439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:06.838034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:06.846092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:06.846582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:06.847058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:06.847787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:06.848255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:06.848692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:06.991427 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:06.999481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-188f8cff-9e28-4d84-97f0-691c26a62bbe tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.166054 Oct 04 22:33:07.000051 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3799/7491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:06 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:08.023376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:08.024226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:08.032200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:08.040701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:08.040701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:08.040701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:08.040701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:08.040701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:08.046824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:08.057583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:08.058077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:08.058535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:08.076374 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] Creating event network-changed:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:33:08.082874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-da46a317-7fe7-4a3c-83ea-c7372341345c req-5086365f-9b9b-4f1e-bd79-9a4bd5551305 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105624 Oct 04 22:33:08.083590 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3693/7492] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:08.201003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:08.210959 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-407ac2a5-0991-4c02-b747-882ba44b10a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.191437 Oct 04 22:33:08.211491 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3800/7493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:08 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:33:09.236066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:09.236812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:09.243277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:09.243746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:09.244197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:09.244910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:09.245375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:09.245973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:09.387310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:09.395894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d924cd8-b411-4a5e-a295-736a55bd6244 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.165054 Oct 04 22:33:09.398046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3694/7494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:09 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:10.419818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:10.420423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:10.427965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:10.428446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:10.428890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:10.429599 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:10.430049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:10.430480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:10.575478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:10.585544 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ecabe5c9-4c98-45ee-8303-ded92ea162a8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.169739 Oct 04 22:33:10.586202 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3801/7495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:10 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:11.608791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:11.609416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:11.616912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:11.617406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:11.617853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:11.618560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:11.619051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:11.619487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:11.753023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:11.760884 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-634d60d4-55f0-4bf3-893e-216b84ed8eff tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.155979 Oct 04 22:33:11.761461 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3695/7496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:11 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:12.784369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:12.784988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:12.791847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:12.792357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:12.792795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:12.793487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:12.793936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:12.794374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:12.931367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:12.939251 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33cecced-6952-4ea4-82f0-a7880decabde tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.159317 Oct 04 22:33:12.940091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3802/7497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:12 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:13.961012 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:33:13.961817 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:33:13.965323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:13.965951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:13.972292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:13.972789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:13.973241 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:13.973953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:13.974417 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:13.974972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:14.107537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:14.116039 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8bdb8814-7839-4eb6-aa77-e5d72ac24e41 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.156539 Oct 04 22:33:14.116652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3696/7498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:13 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:14.538356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "name": "network-vif-plugged", "status": "completed", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:14.548748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:14.549241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:14.549682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:14.561259 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] Creating event network-vif-plugged:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:33:14.566280 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-83dc10e7-09ca-42f8-bf3c-e12e538d94ad req-5d640134-d8d1-4dbb-875a-366ee10944be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Oct 04 22:33:14.566933 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3803/7499] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:15.138146 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:15.138813 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:15.147643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:15.148142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:15.148590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:15.149307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:15.149774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:15.150211 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:15.169219 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49386. Oct 04 22:33:15.171313 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49384. Oct 04 22:33:15.289555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:15.297543 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b92aa9d-8e3a-42d7-af53-32f96d3f507e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1358 microversion: 2.1 time: 0.163234 Oct 04 22:33:15.298142 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3697/7500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:15 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:16.322794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:16.323511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:16.330445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.330959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.331392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.332082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.332528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.332951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.469406 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:16.477758 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-52d165fe-c7ff-4d74-8543-52a206988c8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1548 microversion: 2.1 time: 0.160251 Oct 04 22:33:16.478336 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3804/7501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:16 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:16.499998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:16.500621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:16.508128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.508620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.509070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.509779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.510250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.510716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.642958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:16.650804 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ae75e7f-ff17-4117-a7f5-0e6eab6875ae tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1548 microversion: 2.1 time: 0.154679 Oct 04 22:33:16.651419 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3698/7502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:16 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:16.672671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:16.677805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:16.678692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Searching by: {'deleted': False, 'project_id': '2303c480f63d4d1e90ecf439c71e787a'} {{(pid=123541) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 22:33:16.683971 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.684436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.684868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.685600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.686070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.686491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.714273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.multi_cell_list [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123541) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 22:33:16.741952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-957208a6-6f0d-4375-a753-a1315b6db570 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072780 Oct 04 22:33:16.742545 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3805/7503] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 4 22:33:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:16.754878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:16.755513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:16.761985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.762485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.762964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.763682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:16.764151 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:16.764590 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:16.899424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:16.907429 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-392bdb0e-9597-4e77-9763-ff3ce326a431 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1548 microversion: 2.1 time: 0.157112 Oct 04 22:33:16.908010 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3699/7504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:16 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:19.865161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b9144f6-431c-42bb-8ee8-186680ec4abc"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:19.867612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:19.874431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.874964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.875408 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:19.876118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:19.876575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:19.877003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:20.566590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53ecc6b7-6af0-46c5-80b8-b17394188f3b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706120 Oct 04 22:33:20.567429 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3806/7505] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 4 22:33:19 2022] POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:32.442409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:32.445609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:32.448769 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:32.449457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=70 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:32.453283 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:32.453789 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:32.454397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:32.455134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:32.455965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:32.456424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:32.591563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:32.601971 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47ff0a8f-0ffa-4b25-a6aa-7c7aa0146dcd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1594 microversion: 2.1 time: 0.163231 Oct 04 22:33:32.607887 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3700/7506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:32 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:33:35.028391 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:35.029905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:35.030686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:33:35.035136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:35.046495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:35.047087 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:35.047745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:35.061056 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] Creating event network-changed:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:33:35.067104 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-1c052467-01a9-4a96-83b9-95d46ce04cf2 req-4f415151-087b-4ce0-9d4e-4dfa07e1180d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040835 Oct 04 22:33:35.069564 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3807/7507] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:37.967214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-696104325"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:37.968797 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:37.975848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:37.976343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:37.976787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:37.977486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:37.977954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:37.978383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:38.106759 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.security_group_api [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Adding security group 4e19143d-3a7b-449b-bac5-9f4b6d8869f0 to port f49cf841-0a71-4780-9802-35d8e7e1e75d Oct 04 22:33:38.507511 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-11684097-ec5d-4db8-bc5c-93e3c88d6bbb tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action" status: 202 len: 0 microversion: 2.1 time: 0.544487 Oct 04 22:33:38.514695 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3701/7508] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:33:37 2022] POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:33:38.517016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:33:38.517739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:33:38.526834 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:38.527360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:38.527806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:38.528539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:38.534729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:33:38.536253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:38.536866 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:38.545660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:33:38.546296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:33:38.547053 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:33:38.563042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] Creating event network-changed:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:33:38.568834 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4662ce04-0b13-472c-92e3-426e8359c7fd req-e1e8c873-1dc6-4adc-8c9b-a8e7d88628da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038518 Oct 04 22:33:38.570494 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3702/7509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:33:38.714722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:33:38.724833 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b8b6a67d-980c-4a6c-85e9-4fc2df2229c6 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1759 microversion: 2.1 time: 0.212075 Oct 04 22:33:38.726330 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3808/7510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:33:38 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1759 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:34:24.817752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:24.818547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:24.823854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:34:24.826248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:24.832829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:24.833304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:24.833762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:24.834499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:24.835011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:24.840258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:25.063088 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7dfd7afc-f09b-4906-86cb-937162cd903f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action" status: 202 len: 0 microversion: 2.1 time: 0.247291 Oct 04 22:34:25.063940 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3703/7511] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:34:24 2022] POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:34:25.076722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:25.080201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:25.080201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:25.080201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:34:25.085761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:25.086320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:25.086910 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:25.087731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:25.088376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:25.088985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:25.275184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:25.289751 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b5766dc-8a99-4c71-ade7-95ac23ec61b4 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1751 microversion: 2.1 time: 0.220189 Oct 04 22:34:25.290387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3809/7512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:25 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:26.323337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:26.324247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:26.332221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:26.332720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:26.333173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:26.333888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:26.334384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:26.334865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:26.485991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:26.494414 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fec83812-9545-4c4e-a036-59708c8ff202 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.175805 Oct 04 22:34:26.495022 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3704/7513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:26 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:27.519119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:27.519737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:27.527088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:27.527578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:27.528012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:27.529377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:27.529843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:27.530270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:27.680798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:27.691424 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad5dbb3e-20d4-4558-8e21-80bccaa69e7e tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.175130 Oct 04 22:34:27.691424 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3810/7514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:27 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:34:28.714494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:28.715172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:28.723039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:28.723544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:28.723996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:28.724718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:28.725190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:28.725631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:28.874318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:28.882844 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f09bcc8-ef73-4b74-8ae3-240610ca2d04 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.172211 Oct 04 22:34:28.883438 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3705/7515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:28 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:29.907414 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:29.907988 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:29.915011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:29.915497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:29.915937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:29.916641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:29.917094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:29.917520 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:30.063809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:30.072702 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3148a37a-6ff0-40fa-bfca-4633b2c17117 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.169775 Oct 04 22:34:30.073304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3811/7516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:29 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:31.096279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:31.096989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:31.104180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:31.107926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:31.107926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:31.107926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:31.107926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:31.107926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:31.259043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:31.267963 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e77f774-ee5b-4aa0-91c1-4355b5a4ddc8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.175690 Oct 04 22:34:31.268548 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3706/7517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:31 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:32.291166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:32.291788 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:32.299606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:32.300093 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:32.300528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:32.301234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:32.301688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:32.302151 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:32.447798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:32.457078 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c17daffa-5972-4d80-9f37-335494f0fa11 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.169728 Oct 04 22:34:32.457672 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3812/7518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:32 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:33.480575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:33.481226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:33.489328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:33.489809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:33.490246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:33.490992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:33.491462 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:33.491896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:33.649858 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:33.658903 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd4d4424-14f5-438e-a336-e32c57bb2a6c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.182118 Oct 04 22:34:33.659499 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3707/7519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:33 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:34.682842 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:34.683671 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:34.690388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:34.690912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:34.691354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:34.692047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:34.692504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:34.692932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:34.836013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:34.845524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67daf140-92a0-4f55-9bf1-c6a41d19dcc2 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.166769 Oct 04 22:34:34.846122 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3813/7520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:34 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:35.869540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:35.870289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:35.878011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:35.878516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:35.878992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:35.879720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:35.880185 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:35.880620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:36.050409 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:36.059087 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fde0ccf8-4208-49db-a4dd-ad65675f2e00 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1756 microversion: 2.1 time: 0.193447 Oct 04 22:34:36.060255 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3708/7521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:35 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:34:37.083909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:34:37.084529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:34:37.092590 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:37.100568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:37.100568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:37.100568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:34:37.100568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:34:37.100568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:34:37.250360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:34:37.255952 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-49e1680b-488d-4a0b-9695-71b0b0bf0c64 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1759 microversion: 2.1 time: 0.175954 Oct 04 22:34:37.256551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3814/7522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:34:37 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:40.477062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=12 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:40.477753 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:40.481783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-696104325"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:40.482327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:40.488157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:40.489426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:40.489426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:40.489806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:40.490272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:40.490740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:40.620660 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.network.security_group_api [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Removing security group 4e19143d-3a7b-449b-bac5-9f4b6d8869f0 from port f49cf841-0a71-4780-9802-35d8e7e1e75d Oct 04 22:35:40.993154 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a985874-eaae-4cee-81c9-d354241286ec tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action" status: 202 len: 0 microversion: 2.1 time: 0.516637 Oct 04 22:35:40.994250 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3709/7523] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:35:40 2022] POST /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:35:41.008014 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:41.010160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:35:41.106059 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:41.118999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:41.120396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:41.120396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:41.134908 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] Creating event network-changed:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:35:41.141739 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c3d5f6bb-9bc9-4c41-ab5e-592e1039bdb1 req-bbefcfe4-72b7-4a83-bc56-ba6967aaa04a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142142 Oct 04 22:35:41.143021 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3815/7524] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:42.557245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:42.557850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:42.564541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.565036 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.565481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.566194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.566687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.567122 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.655823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lazy-loading 'services' on Instance uuid b5e221dd-8040-4827-81b2-d7c5cddf4cba {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:35:42.873619 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d181d590-c372-4ad4-8abb-1ac3c88be3e9 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments/4b9144f6-431c-42bb-8ee8-186680ec4abc" status: 202 len: 0 microversion: 2.1 time: 0.321229 Oct 04 22:35:42.874274 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3710/7525] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:35:42 2022] DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments/4b9144f6-431c-42bb-8ee8-186680ec4abc => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:35:42.886639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:42.889173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:42.896167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.897088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.897417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.898122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:42.898577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:42.899029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:42.931412 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23155f06-64dd-4212-b39d-20688a84531f tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050494 Oct 04 22:35:42.932255 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3816/7526] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:42 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:43.157978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:43.168183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:43.169009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:43.169229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:43.181405 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] Creating event network-changed:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:35:43.186523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ec61eb97-56b6-434c-825a-b33c6d9ba860 req-7d8866d3-f749-4be9-b6d7-1277227f13d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Oct 04 22:35:43.187248 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3711/7527] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:43.944616 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:43.947114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:43.954601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:43.955118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:43.955578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:43.956266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:43.956719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:43.957368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:43.989740 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c71240d-8fe6-4e83-83ae-d76e64dfe4bd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049242 Oct 04 22:35:43.990223 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3817/7528] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:43 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:45.003727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:45.005942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:45.012229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:45.012715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:45.013158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:45.013856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:45.014316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:45.014848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:45.047722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5652de67-6f6b-4978-b129-73013499390c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Oct 04 22:35:45.048323 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3712/7529] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:44 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:46.060506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:46.062757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:46.069577 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:46.070316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:46.070795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:46.071495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:46.071950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:46.072376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:46.103379 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db66ec9d-304e-43b1-a6fb-621ed8f59e3c tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Oct 04 22:35:46.103947 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3818/7530] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:46 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:47.117175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:47.119450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:47.125778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:47.126268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:47.126743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:47.127451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:47.127921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:47.128457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:47.165447 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-17d32e85-6a37-4284-a7f8-adfa5bee82e8 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052247 Oct 04 22:35:47.166248 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3713/7531] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:47 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:35:48.178446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:48.180909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:48.188675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:48.189159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:48.189588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:48.190278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:48.190752 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:48.191175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:48.220205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d101615-3d17-4765-9836-efbb50b13e8b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045752 Oct 04 22:35:48.220774 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3819/7532] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 4 22:35:48 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 22:35:48.231387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:48.231937 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:48.239177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:48.239664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:48.240109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:48.240814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:48.241273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:48.241707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:48.318795 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] HTTP exception thrown: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba is not attached to volume 4b9144f6-431c-42bb-8ee8-186680ec4abc Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Request method failure captured: Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: request: DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments/4b9144f6-431c-42bb-8ee8-186680ec4abc HTTP/1.1 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLOPdf9NJS0Vn7XLIjrPbCd2G0apP-e5iIKEa4OqHGmGVsnEYYB1wGkeC0xjO2YPSNLKQHSx91j9_WY3BOXw081zfTo64jnmLTVVjYA3IWUUMMPzNtBF-ohBRs4lECMj__R67FZuWYFrsxL3xpKdChqcqqK__ctsIOqSVcd-vW3KAcg Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: 7f03e4cbd9c04c25aa8a66a382850760 Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba is not attached to volume 4b9144f6-431c-42bb-8ee8-186680ec4abc Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'server_id': 'b5e221dd-8040-4827-81b2-d7c5cddf4cba', 'id': '4b9144f6-431c-42bb-8ee8-186680ec4abc'} Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4b9144f6-431c-42bb-8ee8-186680ec4abc. Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba is not attached to volume 4b9144f6-431c-42bb-8ee8-186680ec4abc Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:48.320688 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba is not attached to volume 4b9144f6-431c-42bb-8ee8-186680ec4abc Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Returning 404 to user: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba is not attached to volume 4b9144f6-431c-42bb-8ee8-186680ec4abc {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6ca51e0-f240-42b5-ac82-0a6679ab63fd tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments/4b9144f6-431c-42bb-8ee8-186680ec4abc" status: 404 len: 154 microversion: 2.1 time: 0.094803 Oct 04 22:35:48.326223 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3714/7533] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 4 22:35:48 2022] DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba/os-volume_attachments/4b9144f6-431c-42bb-8ee8-186680ec4abc => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:35:51.662699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:51.663307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:51.670344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:51.670954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:51.671542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:51.672887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:51.673346 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:51.673781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:51.700207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:35:52.040558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5c31d1c-13ab-498b-a265-ac997ce6a215 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 204 len: 0 microversion: 2.1 time: 0.381485 Oct 04 22:35:52.041160 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3820/7534] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:35:51 2022] DELETE /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:35:52.049441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:52.050082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:52.058182 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:52.058871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:52.059227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:52.059944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:52.060410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:52.060854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:52.197881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:52.206817 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56fc32f9-9d8f-4b1e-a296-1353d409d41b tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1554 microversion: 2.1 time: 0.161117 Oct 04 22:35:52.207414 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3715/7535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:52 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:53.231432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:53.232010 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:53.240131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:53.240608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:53.241041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:53.241728 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:53.242174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:53.242597 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:53.377461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:53.385435 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-89584e62-8a85-4cac-ad0a-6a6ce92a6e0d tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1554 microversion: 2.1 time: 0.158345 Oct 04 22:35:53.386014 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3821/7536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:53 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:54.408754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:54.410989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:54.413929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e221dd-8040-4827-81b2-d7c5cddf4cba", "name": "network-vif-deleted", "tag": "f49cf841-0a71-4780-9802-35d8e7e1e75d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:35:54.418343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:54.418901 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:54.419362 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:54.420095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:54.420599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:54.421041 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:54.425005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:54.425480 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:54.425912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:54.438118 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] Creating event network-vif-deleted:f49cf841-0a71-4780-9802-35d8e7e1e75d for instance b5e221dd-8040-4827-81b2-d7c5cddf4cba on n-h1-851029-13 Oct 04 22:35:54.443456 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-abc73ed6-de89-4c18-b8c4-cea6de524bd4 req-e723c17f-27ad-45b7-b529-9703b8278731 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Oct 04 22:35:54.444077 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3822/7537] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:35:54.492160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f03e4cbd9c04c25aa8a66a382850760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2303c480f63d4d1e90ecf439c71e787a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:35:54.500898 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41aa077d-4916-455d-a174-5bbb45da4d02 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 200 len: 1512 microversion: 2.1 time: 0.095670 Oct 04 22:35:54.501496 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3716/7538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:54 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:35:55.526067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:55.526863 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] [instance: b5e221dd-8040-4827-81b2-d7c5cddf4cba] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:35:55.533783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:55.534308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:55.535227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:55.535502 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:35:55.535968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:35:55.536393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:35:55.551590 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] HTTP exception thrown: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Request method failure captured: Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba HTTP/1.1 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLOPdf9NJS0Vn7XLIjrPbCd2G0apP-e5iIKEa4OqHGmGVsnEYYB1wGkeC0xjO2YPSNLKQHSx91j9_WY3BOXw081zfTo64jnmLTVVjYA3IWUUMMPzNtBF-ohBRs4lECMj__R67FZuWYFrsxL3xpKdChqcqqK__ctsIOqSVcd-vW3KAcg Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2303c480f63d4d1e90ecf439c71e787a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 2303c480f63d4d1e90ecf439c71e787a Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892212637 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 7f03e4cbd9c04c25aa8a66a382850760 Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestMinimumBasicScenario-892212637-project Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': 'b5e221dd-8040-4827-81b2-d7c5cddf4cba'} Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:35:55.555659 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Returning 404 to user: Instance b5e221dd-8040-4827-81b2-d7c5cddf4cba could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e930ce6-a953-4cd5-8605-bd1c82f4a4b3 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba" status: 404 len: 111 microversion: 2.1 time: 0.034296 Oct 04 22:35:55.561212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3823/7539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:35:55 2022] GET /compute/v2.1/servers/b5e221dd-8040-4827-81b2-d7c5cddf4cba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:35:55.564704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18ebf726-43e1-4431-8369-fc5fc469ed82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] Calling method '.version_select at 0x7f54f5dc84c0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:35:55.641731 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18ebf726-43e1-4431-8369-fc5fc469ed82 tempest-TestMinimumBasicScenario-892212637 tempest-TestMinimumBasicScenario-892212637-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-254772464" status: 202 len: 0 microversion: 2.1 time: 0.081465 Oct 04 22:35:55.642328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3717/7540] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 4 22:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-254772464 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:36:07.833615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:07.834369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:07.998484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: .version_select at 0x7f54f4c8edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1333475929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNK6Du5sUD1nmVH+71T4hc4obHvz5SXpkz+P9q9kfXgZjbT7Qm0JsaZlYsEtBprJxvggyu/uibKv18Synsan4KbQkD1slBvk8Uhc6RWD87h9Cy1MOQnZbMoWrq3nD2Viw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:08.018296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:36:08.023451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:36:08.037670 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:36:09.045440 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49756. Oct 04 22:36:09.155247 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eacc8fb8-efa2-488c-b73e-8497725192b4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.327711 Oct 04 22:36:09.155870 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3824/7541] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:36:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:17.916890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:17.918734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:17.924071 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:17.924365 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 04 22:36:17.931307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-890981940", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "a99e4339-0755-4124-9de2-36ba7af4f7af"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1333475929", "security_groups": [{"name": "tempest-secgroup-smoke-494320839"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:18.065682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] validate_networks() for [('a99e4339-0755-4124-9de2-36ba7af4f7af', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:36:18.532690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:36:18.533691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:36:18.534187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:36:18.535323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:36:18.535984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:36:18.546512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:18.547879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:18.548941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:18.550450 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:18.551512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:18.553109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:18.587732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:36:18.595622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:36:18.611920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:36:18.614550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:36:18.836538 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bf52c60f-ebb0-4306-b81e-04ded6fb9a91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.921574 Oct 04 22:36:18.837866 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3718/7542] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:36:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:36:18.847297 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:36:18.847861 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 (ip 10.222.0.36) !!! Oct 04 22:36:18.848634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:18.854418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a34dbb9-741c-4d1f-908b-26e85a23513a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:18.857270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a34dbb9-741c-4d1f-908b-26e85a23513a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:18.964511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a34dbb9-741c-4d1f-908b-26e85a23513a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:18.972167 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a34dbb9-741c-4d1f-908b-26e85a23513a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1266 microversion: 2.1 time: 0.127085 Oct 04 22:36:18.974714 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3825/7543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:18 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:19.998397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47362c14-c41f-4ffa-809b-784224a250e9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:20.000039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47362c14-c41f-4ffa-809b-784224a250e9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:20.059104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-47362c14-c41f-4ffa-809b-784224a250e9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:20.068192 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47362c14-c41f-4ffa-809b-784224a250e9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1266 microversion: 2.1 time: 0.074606 Oct 04 22:36:20.071095 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3719/7544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:19 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:21.091733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:21.093659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:21.101089 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:21.101726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:21.102239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:21.103100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:21.103628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:21.104132 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:21.186181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:21.186181 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19f981d9-6990-4361-afe9-0d6f80cd052e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1318 microversion: 2.1 time: 0.093232 Oct 04 22:36:21.186181 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3826/7545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:21 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:22.204100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:22.204732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:22.211807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:22.212305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:22.212799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:22.213504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:22.213990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:22.214426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:22.283012 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:22.290865 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-51f156bd-c7eb-4e20-9540-52f2800b7be2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1336 microversion: 2.1 time: 0.090861 Oct 04 22:36:22.291453 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3720/7546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:22 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:23.315216 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:23.316106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:23.323518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:23.324273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:23.324720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:23.325434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:23.325890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:23.326315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:23.553491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:23.563858 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d3d10f9a-f969-4438-a792-db38eb1b227c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.253146 Oct 04 22:36:23.564452 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3827/7547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:23 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:23.816520 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c51de9-84fe-4953-a68e-531034f9d7e6", "tag": "1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:23.827686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:23.828176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:23.828616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:23.840375 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] Creating event network-changed:1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66 for instance 22c51de9-84fe-4953-a68e-531034f9d7e6 on n-h2-851029-13 Oct 04 22:36:23.846523 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-32e1f79d-9da0-4d0e-b34b-61f3cd18dbe1 req-7d6dc8f0-a9e2-4030-aa4d-623ffb4fd9b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034822 Oct 04 22:36:23.847162 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3721/7548] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:24.587830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:24.588499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:24.596333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:24.596990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:24.597429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:24.598140 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:24.598596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:24.599058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:24.737429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:24.745489 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b1a4232-698b-431d-aa32-7eb3e8b0d993 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.161642 Oct 04 22:36:24.746060 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3828/7549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:24 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:25.770236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:25.771013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:25.777275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:25.777772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:25.778223 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:25.778955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:25.779431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:25.780548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:25.912275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:25.920068 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-64809e78-5e11-4ce4-8465-5d91e1213b95 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.154996 Oct 04 22:36:25.920708 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3722/7550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:25 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:26.942783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:26.943424 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:26.950725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.951204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.951639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:26.952369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:26.952820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:26.953241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:27.085692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:27.093925 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15d2305a-94f4-4c19-a754-3c4810d701a6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.155017 Oct 04 22:36:27.094490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3829/7551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:26 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:28.117631 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:28.118191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:28.125742 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:28.126242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:28.126758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:28.127475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:28.127973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:28.128424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:28.270966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:28.278486 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-622f187f-b7b6-43bc-9db7-7cdbd989f90a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.164873 Oct 04 22:36:28.279308 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3723/7552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:28 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:29.301545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:29.306239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:29.306239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:29.310277 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.311335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.311855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.312601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.313055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.313488 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.454410 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:29.462706 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b24cacf7-0347-4349-ba45-504d905fd90f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.164967 Oct 04 22:36:29.463668 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3830/7553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:29 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:29.573610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:29.633864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c51de9-84fe-4953-a68e-531034f9d7e6", "name": "network-vif-plugged", "status": "completed", "tag": "1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:29.643965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:29.644457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:29.644898 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:29.656431 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] Creating event network-vif-plugged:1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66 for instance 22c51de9-84fe-4953-a68e-531034f9d7e6 on n-h2-851029-13 Oct 04 22:36:29.661556 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-56a64cf7-686a-49be-9c79-768e362a2a45 req-c5d97bda-3f2f-4a51-b644-36636926dd35 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093164 Oct 04 22:36:29.662164 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3724/7554] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:36:30.485625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:30.486237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:30.493130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:30.493609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:30.494169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:30.494911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:30.495366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:30.495793 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:30.630625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:30.638683 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f0cab9e4-d742-4c15-b38e-e1a7aedcff13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1391 microversion: 2.1 time: 0.157068 Oct 04 22:36:30.639954 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3831/7555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:30 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:31.659313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:31.664721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:31.665470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:31.672673 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:31.673179 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:31.673891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:31.674364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:31.674867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:31.675320 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:31.813986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:31.822006 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8cdc11e9-f043-44db-a8ee-1426f3cf8c87 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1563 microversion: 2.1 time: 0.163699 Oct 04 22:36:31.822588 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3725/7556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:31 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:31.844775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:31.845387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:31.852126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:31.852604 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:31.853036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:31.853724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:31.854174 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:31.854598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:31.986675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:31.994516 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da1a9ac2-bd7e-4ad5-b011-e0eed8edf4d7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1563 microversion: 2.1 time: 0.154123 Oct 04 22:36:31.995207 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3832/7557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:31 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:36:34.517129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c51de9-84fe-4953-a68e-531034f9d7e6", "tag": "1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:34.518568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:36:34.525535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:34.533114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:34.537094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:34.537572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:34.538032 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:34.542428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:34.542918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:34.543768 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:34.544277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:34.544758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:34.557445 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] Creating event network-changed:1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66 for instance 22c51de9-84fe-4953-a68e-531034f9d7e6 on n-h2-851029-13 Oct 04 22:36:34.564430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4a5c714c-4002-41dc-93dc-a4180b01ea0e req-a7465661-8f2f-4402-a1c6-5da69be1e930 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051085 Oct 04 22:36:34.565304 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3833/7558] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:36:34.792259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:36:34.801647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8d40f0a-7b39-4de2-9946-706735f48cae tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1563 microversion: 2.1 time: 0.293175 Oct 04 22:36:34.802583 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3726/7559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:36:34 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1563 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:36:56.123879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:56.124668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=44 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:36:56.128835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:36:56.131124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:36:56.137202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.137684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.138123 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.138874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:36:56.139394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:36:56.139828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:36:56.196511 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efe959f9-07a3-468a-ab94-5a45448c9b9c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action" status: 200 len: 24567 microversion: 2.1 time: 0.074411 Oct 04 22:36:56.197209 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3834/7560] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:36:56 2022] POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:37:02.619625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:02.620338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:02.622589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:02.623306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=36 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:02.628049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.630943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.630943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:02.630943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.630943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.630943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:02.877156 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52e2ddb8-6b68-4622-9c16-e5e40608cdfb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action" status: 202 len: 0 microversion: 2.1 time: 0.261155 Oct 04 22:37:02.877769 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3727/7561] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:02 2022] POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:37:02.887011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:02.887812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:02.895697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.896187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.896620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:02.897323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:02.897779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:02.898251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:03.041136 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:03.049061 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c69a7471-38d1-482a-bc3c-08503e51e01c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1687 microversion: 2.1 time: 0.166382 Oct 04 22:37:03.049629 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3835/7562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:02 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:04.075208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:04.076548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:04.082842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:04.086788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:04.086788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:04.086788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:04.086788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:04.086788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:04.220803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:04.229325 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4979f97-1f6a-46e8-9141-b09c77c1dbcc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1667 microversion: 2.1 time: 0.160373 Oct 04 22:37:04.229934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3728/7563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:04 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:05.327865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:05.330036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:05.337606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.338086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.338521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.339239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.339694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.340116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.390730 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b320697-3757-4c99-a8f8-f1bd50f3ffa6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action" status: 200 len: 32643 microversion: 2.1 time: 0.067198 Oct 04 22:37:05.391402 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3836/7564] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:05 2022] POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action => generated 32643 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:37:05.403199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:05.403752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:05.410707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.411209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.411665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.412370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.412865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.413305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.613626 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13b35f37-45fe-4158-93b2-0d9bb25bf168 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action" status: 202 len: 0 microversion: 2.1 time: 0.213973 Oct 04 22:37:05.614247 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3729/7565] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:05 2022] POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:37:05.623672 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:05.624660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:05.631865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.632396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.632775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.633476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:05.633928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:05.634357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:05.776188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:05.785063 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b950c541-ff85-4917-800c-c7d7be1817d3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1674 microversion: 2.1 time: 0.165945 Oct 04 22:37:05.785278 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3837/7566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:05 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:06.810619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:06.811367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:06.817885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:06.824764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:06.824764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:06.824764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:06.824764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:06.824764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:06.958612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:06.966737 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c357c1a8-318c-4d91-8095-720e75163fe1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1682 microversion: 2.1 time: 0.161866 Oct 04 22:37:06.968269 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3730/7567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:06 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:07.067436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:07.069606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:07.077952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:07.078128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:07.078560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:07.079272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:07.079726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:07.080149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:07.132164 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3878c1e-7c80-47ef-9762-fc344c37ac88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action" status: 200 len: 35557 microversion: 2.1 time: 0.068433 Oct 04 22:37:07.132753 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3838/7568] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:37:07 2022] POST /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6/action => generated 35557 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:37:08.321274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:08.321840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:08.323687 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c51de9-84fe-4953-a68e-531034f9d7e6", "tag": "1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:08.328928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.329679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.330138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.330888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.331555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.332004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.335955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.336505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.337186 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.350277 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] Creating event network-changed:1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66 for instance 22c51de9-84fe-4953-a68e-531034f9d7e6 on n-h2-851029-13 Oct 04 22:37:08.356264 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fbe5cc7c-e38c-4775-8447-0b5ca1079b74 req-122e76c4-c790-4001-a6c0-1bb58931ce5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037106 Oct 04 22:37:08.358522 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3839/7569] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:37:08.363517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:37:08.678515 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-01f73022-8ea1-4dee-ab28-cf80d514a7c3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 204 len: 0 microversion: 2.1 time: 0.361630 Oct 04 22:37:08.679394 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3731/7570] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:37:08 2022] DELETE /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:37:08.689007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:08.690007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:08.697833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.698390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.698948 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.699711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:08.700741 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:08.701204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:08.889967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:08.897913 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-731524ad-2992-44a0-9629-664d9f404070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1688 microversion: 2.1 time: 0.213479 Oct 04 22:37:08.898935 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3840/7571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:08 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:09.923681 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:09.924388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:09.931246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:09.931741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:09.932189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:09.932897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:09.933363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:09.933798 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:10.077396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:10.087133 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ca2c3981-ceda-417a-ab1e-13b5321d1d0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1688 microversion: 2.1 time: 0.168258 Oct 04 22:37:10.093824 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3732/7572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:09 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:11.111859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:11.112484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:11.120281 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:11.120801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:11.121323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:11.122179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:11.122618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:11.125091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:11.135080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c51de9-84fe-4953-a68e-531034f9d7e6", "name": "network-vif-deleted", "tag": "1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:11.147746 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:11.148558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:11.151192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:11.162239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] Creating event network-vif-deleted:1f0f802a-25d5-4cc6-aca3-e1e3f78eaf66 for instance 22c51de9-84fe-4953-a68e-531034f9d7e6 on n-h2-851029-13 Oct 04 22:37:11.167796 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a509eb59-182f-4c51-8bfa-244433df74e5 req-886e0fe4-8562-4ce4-9bd2-87ef4b27f1e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Oct 04 22:37:11.168466 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3733/7573] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:37:11.195521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:11.203960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-197d12bb-6f2a-474f-ac2a-a95b6f993e2d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1502 microversion: 2.1 time: 0.096255 Oct 04 22:37:11.208388 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3841/7574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:11 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1502 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:12.228356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:12.229007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:12.236367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:12.236873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:12.237332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:12.238056 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:12.238534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:12.239009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:12.271248 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:12.271744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:12.272199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:12.272685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lazy-loading 'fault' on Instance uuid 22c51de9-84fe-4953-a68e-531034f9d7e6 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:37:12.317894 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:12.326077 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21a99b00-513d-4232-a5db-76c599954dac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 200 len: 1356 microversion: 2.1 time: 0.102122 Oct 04 22:37:12.326652 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3734/7575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:12 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:13.349028 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:13.349654 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 22c51de9-84fe-4953-a68e-531034f9d7e6] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:13.357152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:13.357601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:13.358047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:13.358772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:13.359232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:13.359659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:13.373128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] HTTP exception thrown: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Request method failure captured: Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 HTTP/1.1 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLVX1Dc8FB_KBKVSHTiMa3Z4UcEenYGjiRlVBlGiDMZcseAaf6r_792XDIyR5ic2GX7e0b-NRl7a1F4UWGsd8LUXGAYa8rlbkf5n64BVJyHd84U5w27A7KBd0t4bQWeU6yx_py0smCyLITJVsIk56DEr2f3jhKOE84gsaz_TxjkVLgA Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c46a9af8ecc54b789da81391bb358260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a2050bdc49a7450ea712b0f31f637dca Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '22c51de9-84fe-4953-a68e-531034f9d7e6'} Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:37:13.374814 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Returning 404 to user: Instance 22c51de9-84fe-4953-a68e-531034f9d7e6 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5eb8b6b3-84f2-4da2-abdb-6ca0fa4dbea0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 04 22:37:13.380922 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3842/7576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:13 2022] GET /compute/v2.1/servers/22c51de9-84fe-4953-a68e-531034f9d7e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:37:17.319270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d57e4d3-50c6-49ba-a50b-f33b8bb89461 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '.version_select at 0x7f54f54fef70>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:17.416801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d57e4d3-50c6-49ba-a50b-f33b8bb89461 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1333475929" status: 202 len: 0 microversion: 2.1 time: 0.101516 Oct 04 22:37:17.417334 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3735/7577] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 4 22:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1333475929 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:37:17.447858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b22594b7-868b-4d24-9745-774763ed54fc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: .version_select at 0x7f54f4ca7d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38648080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/QnDcxvjNwfTTDXun0fxtIkFnXxA9bNN0AuVaoaWbABusBG6FR+c01o8zVaSgqF1oGuHw3TszIFDpKbJAMY0fZPxxc/NRt47Ourp+j5ZJ8slPTgy6c54rE11A3ROcy8Q=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:17.466051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b22594b7-868b-4d24-9745-774763ed54fc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:37:17.471463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-b22594b7-868b-4d24-9745-774763ed54fc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:37:17.577413 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b22594b7-868b-4d24-9745-774763ed54fc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.133849 Oct 04 22:37:17.578098 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3843/7578] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:37:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:37:26.775209 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:26.780100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1808933282", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "9bcbc4af-dabd-4a08-b18a-824c0a80faea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38648080", "security_groups": [{"name": "tempest-secgroup-smoke-1311178768"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:26.901967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] validate_networks() for [('9bcbc4af-dabd-4a08-b18a-824c0a80faea', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:37:27.326052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:37:27.326591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:37:27.327720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:37:27.328154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:37:27.328618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:37:27.338159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:27.339018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:27.339824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:27.341157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:27.341641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:27.342091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:27.361740 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:37:27.367514 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:37:27.381827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:37:27.384207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:37:27.515384 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a830044c-00a1-4771-9b5f-31f3bf29cd5a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741928 Oct 04 22:37:27.516229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3736/7579] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:37:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:37:27.528805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8919ac02-e91a-4e3f-a1b2-4a5612763b61 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:27.530051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8919ac02-e91a-4e3f-a1b2-4a5612763b61 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:27.533413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=40 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:27.534168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:27.534878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:27.718771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8919ac02-e91a-4e3f-a1b2-4a5612763b61 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:27.726591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8919ac02-e91a-4e3f-a1b2-4a5612763b61 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1265 microversion: 2.1 time: 0.203016 Oct 04 22:37:27.727213 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3844/7580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:27 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:28.759490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:28.760147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:28.767879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:28.768375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:28.768833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:28.769543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:28.770010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:28.770454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:28.855675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:28.864063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5259d066-f4de-4586-ac00-ecd358c0cba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1269 microversion: 2.1 time: 0.109522 Oct 04 22:37:28.864705 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3737/7581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:28 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:29.888341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:29.888949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:29.898223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:29.898826 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:29.899377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:29.900295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:29.900797 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:29.901233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:29.981170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:29.989713 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7518e61b-fa6f-4514-83de-4ea6b496afbd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1325 microversion: 2.1 time: 0.105991 Oct 04 22:37:29.990291 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3845/7582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:29 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:31.014030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:31.014870 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:31.022633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:31.023184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:31.024648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:31.024648 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:31.024968 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:31.025512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:31.166517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:31.180112 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bcae3bb4-fc04-4475-8b71-9e6555fad875 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.170327 Oct 04 22:37:31.180714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3738/7583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:31 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:31.900925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382544ff-2025-496b-b163-0af14688fd34", "tag": "b965d43b-c640-4a4c-bc37-15ce9b0bc15d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:31.911147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:31.911625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:31.912055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:31.926442 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] Creating event network-changed:b965d43b-c640-4a4c-bc37-15ce9b0bc15d for instance 382544ff-2025-496b-b163-0af14688fd34 on n-h1-851029-13 Oct 04 22:37:31.931502 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-21b855e7-07c0-4564-b224-6a1c82d6fc49 req-b3d2d6da-a4ce-4d00-bce7-fb7d02013b17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034246 Oct 04 22:37:31.933212 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3846/7584] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:32.204384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:32.205724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:32.213219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:32.213827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:32.214342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:32.215705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:32.216245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:32.216754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:32.362609 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:32.370943 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1546b1d3-4fb4-4ec8-a7a6-fb9feae238c8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.170394 Oct 04 22:37:32.371825 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3739/7585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:32 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:33.395142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:33.396001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:33.403016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:33.403511 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:33.403964 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:33.404681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:33.405171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:33.405608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:33.550110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:33.558196 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac190dc9-f5e0-4596-89d6-5c68e5b9d041 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.168292 Oct 04 22:37:33.559346 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3847/7586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:33 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:34.582877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:34.583537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:34.586245 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:34.591611 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:34.592114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:34.592572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:34.593288 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:34.593763 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:34.594208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:34.737332 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:34.745222 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c38cb88-642c-4fbf-bd25-2f68b4963729 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.166383 Oct 04 22:37:34.745803 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3740/7587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:34 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:35.768527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:35.769138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:35.775802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:35.776280 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:35.776713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:35.778084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:35.778544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:35.778996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:35.914283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:35.923046 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c43d8f4-5d3b-423e-8b17-ad88e2ab3c0d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.158467 Oct 04 22:37:35.923634 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3848/7588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:35 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:36.945887 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:36.946842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:36.953948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:36.954446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:36.954919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:36.959884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:36.959884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:36.959884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:37.154263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:37.162123 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4aae1c7c-209e-4b5d-89b9-aaf57f7790a2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.220558 Oct 04 22:37:37.162725 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3741/7589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:36 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:37.979753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382544ff-2025-496b-b163-0af14688fd34", "name": "network-vif-plugged", "status": "completed", "tag": "b965d43b-c640-4a4c-bc37-15ce9b0bc15d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:37.990624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:37.991142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:37.991578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.003795 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] Creating event network-vif-plugged:b965d43b-c640-4a4c-bc37-15ce9b0bc15d for instance 382544ff-2025-496b-b163-0af14688fd34 on n-h1-851029-13 Oct 04 22:37:38.009185 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-303ad82d-1a9d-4f6e-9d1a-20439c752fac req-6489b98f-1c3f-431b-886d-5042692c1a61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Oct 04 22:37:38.009818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3849/7590] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:38.186234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:38.187101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:38.188845 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:38.189577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:38.195531 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:38.196260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:38.196718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.197439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:38.197908 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:38.198375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:38.345709 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:38.353978 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1fb12f8e-8285-432d-b5e0-db56471de271 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.172150 Oct 04 22:37:38.354631 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3742/7591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:38 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:39.381048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:39.381732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:39.389078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:39.389563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:39.389993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:39.390768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:39.391233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:39.391656 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:39.555548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:39.555548 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-26e5de05-8b55-4b9f-ab80-e8ae6bc1266c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1391 microversion: 2.1 time: 0.179375 Oct 04 22:37:39.556102 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3850/7592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:39 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:40.579573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:40.580204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:40.592407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.592920 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.593382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.594115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.594597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.595261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.759449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:40.768686 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b632158-7045-4e3f-bd29-0d6d4c68bb0c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1561 microversion: 2.1 time: 0.192954 Oct 04 22:37:40.769283 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3743/7593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:40 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:37:40.792208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:40.792878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:40.794905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:37:40.800666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.801180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.801629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.802465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:40.805753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:40.805753 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:40.957625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:40.967099 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be433211-7522-4d49-9547-e87ffb280d00 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1561 microversion: 2.1 time: 0.178750 Oct 04 22:37:40.967694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3851/7594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:40 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:37:43.494141 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:37:43.495079 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382544ff-2025-496b-b163-0af14688fd34", "tag": "b965d43b-c640-4a4c-bc37-15ce9b0bc15d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:37:43.496321 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:37:43.507221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:43.507771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:43.507915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:43.508251 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:43.508397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:43.508857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:43.509079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:37:43.514722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:37:43.515815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:37:43.524334 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] Creating event network-changed:b965d43b-c640-4a4c-bc37-15ce9b0bc15d for instance 382544ff-2025-496b-b163-0af14688fd34 on n-h1-851029-13 Oct 04 22:37:43.531585 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-05a0478c-f7ad-4618-bbfd-0a2888096526 req-c17559e2-a095-4f64-aba0-b33df3bf94fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041438 Oct 04 22:37:43.533092 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3852/7595] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:37:43.733680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:37:43.742379 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-958ae720-a0d4-43e6-9c8d-7942ccad336b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1561 microversion: 2.1 time: 0.256341 Oct 04 22:37:43.743485 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3744/7596] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:37:43 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1561 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:15.047369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:15.049659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:15.051981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=20 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:15.052647 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:15.058211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:15.066394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:15.066394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:15.066394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:15.066394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:15.066394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:15.118852 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-498bb047-e014-4410-9bf9-f933def6ea03 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action" status: 200 len: 24571 microversion: 2.1 time: 0.075766 Oct 04 22:38:15.119586 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3853/7597] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:38:15 2022] POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:38:45.562537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=9 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:45.563424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=50 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:45.568239 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:38:45.570618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:45.577632 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:45.578258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:45.578743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:45.579468 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:45.579942 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:45.580386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:45.830519 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1933c96a-8973-42bb-acfe-823374238c0e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action" status: 202 len: 0 microversion: 2.1 time: 0.269549 Oct 04 22:38:45.831158 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3745/7598] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:38:45 2022] POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:38:45.840031 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:45.840785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:45.843729 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:38:45.848973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:45.849452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:45.849893 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:45.850588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:45.851055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:45.851476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:45.988814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:45.997216 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a3668b2-a5cd-443a-ad7d-d88019f00242 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1671 microversion: 2.1 time: 0.161461 Oct 04 22:38:45.997783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3854/7599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:45 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:47.023523 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:47.024264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:47.030698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:47.031200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:47.031657 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:47.032368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:47.032868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:47.033314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:47.169402 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:47.177287 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9108d8a2-5280-4886-86c7-729fefc65423 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.159180 Oct 04 22:38:47.177863 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3746/7600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:47 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:48.201436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:48.202084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:48.209124 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:48.209613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:48.210058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:48.210875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:48.211341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:48.211771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:48.346371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:48.354811 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-47173b13-336c-4342-ba61-7f71f44bd94a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.157438 Oct 04 22:38:48.355391 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3855/7601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:48 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:49.378957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:49.379612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:49.386877 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:49.387379 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:49.387836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:49.388550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:49.389022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:49.389464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:49.521996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:49.530332 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3eb5a964-cff9-493e-b8d7-b3ba63f70070 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.155690 Oct 04 22:38:49.530934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3747/7602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:49 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:50.553726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:50.554357 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:50.561150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:50.561635 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:50.562076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:50.562807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:50.563267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:50.563694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:50.701889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:50.709742 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-798cde83-9e0a-4ea3-997f-9ac0f60551eb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.160167 Oct 04 22:38:50.714387 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3856/7603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:50 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:51.733431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:51.734089 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:51.740967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:51.741459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:51.741906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:51.742637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:51.743639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:51.744072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:51.874739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:51.882521 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90dffcfd-8873-40d0-a4d4-ddb5c1d8cba3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.153042 Oct 04 22:38:51.883444 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3748/7604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:51 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:52.906818 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:52.907379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:52.914050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:52.914522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:52.914980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:52.915669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:52.916119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:52.916541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:53.048833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:53.057166 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d17cae8e-3c74-49cc-9f29-3e631a8472b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.154297 Oct 04 22:38:53.057743 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3857/7605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:52 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:54.081392 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:54.081953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:54.089306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:54.089807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:54.090259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:54.090987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:54.091457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:54.091897 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:54.223183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:54.230893 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c83832b-eb46-4daa-9bbe-3bd9112d3b83 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.153512 Oct 04 22:38:54.231471 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3749/7606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:54 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:55.256476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:55.257091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:55.263923 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:55.264402 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:55.264837 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:55.265523 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:55.266002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:55.266425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:55.401833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:55.410173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db5c99db-fae6-462d-9ddc-15128867d218 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.159209 Oct 04 22:38:55.410765 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3858/7607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:55 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:38:56.434062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:56.434707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:56.441830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:56.442329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:56.442810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:56.443561 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:56.444032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:56.444469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:56.588458 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:56.596267 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7f440c2d-9fb1-44c1-92d1-7cb29c8e41b6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.166126 Oct 04 22:38:56.596858 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3750/7608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:56 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:57.618833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:57.619554 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:57.626553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:57.627070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:57.627514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:57.628207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:57.628663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:57.629092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:57.762550 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:57.770370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ab780b8-345b-4b6a-aa2c-12bc47ace7dd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.155470 Oct 04 22:38:57.771316 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3859/7609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:57 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:58.794142 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:58.794812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:58.801750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:58.802249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:58.802729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:58.803494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:58.803948 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:58.804388 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:58.942057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:38:58.950289 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d47a787-fa96-4df6-8440-2300c15de94e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.160733 Oct 04 22:38:58.950930 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3751/7610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:58 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:38:59.972522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:38:59.973125 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:38:59.980657 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.981133 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.981565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:38:59.982245 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:38:59.982719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:38:59.983143 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:00.382234 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:00.389964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed3da2ab-9c77-4066-8a4d-2a1a809ba1fe tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.421304 Oct 04 22:39:00.390535 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3860/7611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:38:59 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:01.412522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:01.413137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:01.420772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:01.421238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:01.421700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:01.422414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:01.422925 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:01.423376 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:01.554916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:01.563422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd8135f8-eee4-4448-a728-c9754237f34c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.154865 Oct 04 22:39:01.563994 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3752/7612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:01 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:02.586773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:02.587378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:02.594479 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:02.594990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:02.598630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:02.598630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:02.598630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:02.598630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:02.742142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:02.750595 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd26ecfe-3798-4516-a30f-996ca09c42e8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1676 microversion: 2.1 time: 0.167762 Oct 04 22:39:02.751183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3861/7613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:02 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:03.775434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:03.776054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:03.782854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:03.783348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:03.783793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:03.784496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:03.784962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:03.785398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:03.917996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:03.926108 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d7076df7-5b6a-4c82-bdc5-a9dbf3571ac7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1679 microversion: 2.1 time: 0.155190 Oct 04 22:39:03.926721 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3753/7614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:03 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:36.146302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:36.148701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:36.150912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=16 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:36.151581 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=52 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:36.156326 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.156855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.157298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.157995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:36.158454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:36.158912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:36.360091 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f715dc1f-bb92-4e92-91ab-8acb81764b28 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action" status: 200 len: 69134 microversion: 2.1 time: 0.217730 Oct 04 22:39:36.362055 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3862/7615] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:39:36 2022] POST /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34/action => generated 69134 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:39:53.512011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:53.512661 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:53.514489 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "382544ff-2025-496b-b163-0af14688fd34", "tag": "b965d43b-c640-4a4c-bc37-15ce9b0bc15d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:53.517165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=18 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:53.518358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:53.520679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:53.521361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:39:53.523335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:53.523915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:53.524432 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:53.525393 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:53.526079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:53.526874 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:53.534745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:53.534745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:53.534745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:53.543731 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] Creating event network-changed:b965d43b-c640-4a4c-bc37-15ce9b0bc15d for instance 382544ff-2025-496b-b163-0af14688fd34 on n-h1-851029-13 Oct 04 22:39:53.549203 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2ad30e56-b118-46f7-a861-75ee38638855 req-65342345-97a6-4d47-a02d-e75b658d061c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038909 Oct 04 22:39:53.549940 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3863/7616] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:39:53.558602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:39:53.893677 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d219fb00-9f75-4b3e-935b-d43bea2d9aa2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 204 len: 0 microversion: 2.1 time: 0.385530 Oct 04 22:39:53.894534 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3754/7617] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:39:53 2022] DELETE /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:39:53.903501 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:53.904404 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:53.912522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:53.913338 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:53.913781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:53.914492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:53.914978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:53.915516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:54.058773 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:54.067002 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-850a4630-9891-437a-831d-ad6162ce61be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1685 microversion: 2.1 time: 0.167565 Oct 04 22:39:54.067694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3864/7618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:53 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:39:55.092796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:55.093548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:55.101730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:55.102244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:55.102761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:55.103494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:55.103971 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:55.104411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:55.241008 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:55.249027 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9df924a-60aa-4d39-b0b6-c223d6749d97 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1685 microversion: 2.1 time: 0.160698 Oct 04 22:39:55.249617 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3755/7619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:55 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:56.260334 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:39:56.260908 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 04 22:39:56.272274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:56.272906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:56.279501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:56.280091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:56.280435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:56.281157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:56.281628 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:56.282069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:56.323376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "382544ff-2025-496b-b163-0af14688fd34", "name": "network-vif-deleted", "tag": "b965d43b-c640-4a4c-bc37-15ce9b0bc15d"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:39:56.334160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:56.334798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:56.335007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:56.346133 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] Creating event network-vif-deleted:b965d43b-c640-4a4c-bc37-15ce9b0bc15d for instance 382544ff-2025-496b-b163-0af14688fd34 on n-h1-851029-13 Oct 04 22:39:56.351611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3303ddbd-c25e-46a3-8048-b5937b724634 req-0cea2a40-17b3-4e80-9ee3-e5aa703730b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098098 Oct 04 22:39:56.358565 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3865/7620] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:39:56.359312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:56.366853 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff48f77c-3893-4f44-8e9e-301b5e6558ab tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1499 microversion: 2.1 time: 0.098469 Oct 04 22:39:56.367455 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3756/7621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:56 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1499 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:57.392770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:57.393564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:57.400067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:57.400806 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:57.401288 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:57.402034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:57.402515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:57.402961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:57.439846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:57.440379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:57.440879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:57.441396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lazy-loading 'fault' on Instance uuid 382544ff-2025-496b-b163-0af14688fd34 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:39:57.484730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:39:57.493368 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed1b1ed3-bcbe-4666-8dc2-e10b132d269b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 200 len: 1355 microversion: 2.1 time: 0.106151 Oct 04 22:39:57.493958 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3866/7622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:57 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:39:58.517149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:39:58.517767 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 382544ff-2025-496b-b163-0af14688fd34] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:39:58.525314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:58.525819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:58.526276 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:58.527027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:39:58.527507 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:39:58.527954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:39:58.543614 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] HTTP exception thrown: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Request method failure captured: Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 HTTP/1.1 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLVX1Dc8FB_KBKVSHTiMa3Z4UcEenYGjiRlVBlGiDMZcseAaf6r_792XDIyR5ic2GX7e0b-NRl7a1F4UWGsd8LUXGAYa8rlbkf5n64BVJyHd84U5w27A7KBd0t4bQWeU6yx_py0smCyLITJVsIk56DEr2f3jhKOE84gsaz_TxjkVLgA Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c46a9af8ecc54b789da81391bb358260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: a2050bdc49a7450ea712b0f31f637dca Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '382544ff-2025-496b-b163-0af14688fd34'} Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:39:58.545197 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Returning 404 to user: Instance 382544ff-2025-496b-b163-0af14688fd34 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-50746bd0-53a4-4238-accd-1caf0a180dcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34" status: 404 len: 111 microversion: 2.1 time: 0.033420 Oct 04 22:39:58.550633 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3757/7623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:39:58 2022] GET /compute/v2.1/servers/382544ff-2025-496b-b163-0af14688fd34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:40:02.772644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed067121-c553-4d61-87cb-2286d7b25520 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '.version_select at 0x7f54fa655550>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:02.889171 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed067121-c553-4d61-87cb-2286d7b25520 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38648080" status: 202 len: 0 microversion: 2.1 time: 0.120488 Oct 04 22:40:02.889689 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3867/7624] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 22:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38648080 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:40:02.920606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: .version_select at 0x7f54f5f9af70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-40323584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYtMNgiN3U+xybG4pzVKfRiuGVj6FlBakt4AahFSrOrvER3jjxOcrvBdYcf73Ub1LLtAB5Mrku9ZT5THZUVD8onkudet5kl5ydZMpaWePGNqeogeD/seF0WhqWsQ/rVhw=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:02.937062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:40:02.943106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:40:02.956471 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:40:03.964600 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50166. Oct 04 22:40:04.066216 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3445737-30e8-4dd2-86d5-bebff579dba1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.149546 Oct 04 22:40:04.066882 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3758/7625] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:40:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:40:13.843477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=18 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:13.845699 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:13.851953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1485881945", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "dc9de7f9-8841-423d-ab62-625aa430d308"}], "key_name": "tempest-TestNetworkAdvancedServerOps-40323584", "security_groups": [{"name": "tempest-secgroup-smoke-1139534515"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:14.019106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] validate_networks() for [('dc9de7f9-8841-423d-ab62-625aa430d308', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:40:14.639838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:40:14.640785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:40:14.640785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:40:14.641116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:40:14.641582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:40:14.652514 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:14.653003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:14.653462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:14.654199 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:14.654689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:14.658428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:14.673782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:40:14.679448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:40:14.692721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:40:14.695602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:40:15.053484 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ddb9811-6bef-4684-ad80-0fd24aae1fd5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.211794 Oct 04 22:40:15.055030 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3868/7626] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:40:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:40:15.063602 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:15.064593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:15.065378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:15.070299 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9c22153-e1ff-4041-8768-bfcddb3c9eed tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:15.070956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9c22153-e1ff-4041-8768-bfcddb3c9eed tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:15.125956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9c22153-e1ff-4041-8768-bfcddb3c9eed tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:15.134456 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9c22153-e1ff-4041-8768-bfcddb3c9eed tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1265 microversion: 2.1 time: 0.072579 Oct 04 22:40:15.135261 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3759/7627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:15 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:16.162927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:16.163636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:16.171632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:16.172272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:16.172954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:16.173943 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:16.177595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:16.177595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:16.262744 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:16.271113 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb292793-194b-4e02-8179-ac34b7fa6997 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1269 microversion: 2.1 time: 0.114731 Oct 04 22:40:16.271734 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3869/7628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:16 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:40:17.295667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:17.296406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:17.306396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:17.307549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:17.308200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:17.309165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:17.309775 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:17.310224 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:17.381076 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:17.389868 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc05b967-af03-4a83-a302-6e819fda142f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1317 microversion: 2.1 time: 0.098015 Oct 04 22:40:17.392743 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3760/7629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:17 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:18.414711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:18.415438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:18.422761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:18.423259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:18.423708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:18.424434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:18.424902 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:18.425335 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:18.626563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:18.634380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efba307d-a3b1-4c77-9035-3d9decb9b691 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.224413 Oct 04 22:40:18.635002 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3870/7630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:18 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:40:19.335608 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:19.350549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:19.351080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:19.351532 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:19.364218 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] Creating event network-changed:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h2-851029-13 Oct 04 22:40:19.370493 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e130601b-8e62-4270-86dd-65296655394f req-ae876ba9-d645-436f-a9f0-8087b692eecb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038984 Oct 04 22:40:19.371147 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3761/7631] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:40:19.659931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:19.660532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:19.668360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:19.674862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:19.674862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:19.674862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:19.674862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:19.674862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:19.896497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:19.904389 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4ce5df07-66fa-4acc-90da-027dda13d509 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.248392 Oct 04 22:40:19.904971 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3871/7632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:19 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:40:20.930835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:20.931476 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:20.940441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:20.940947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:20.941398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:20.942125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:20.942595 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:20.943662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:21.082198 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:21.090238 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-04a66475-50d5-4916-b673-aa1f44f670c1 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.164516 Oct 04 22:40:21.090855 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3762/7633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:20 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:22.113531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:22.114181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:22.121586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:22.122065 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:22.122504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:22.123227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:22.123689 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:22.124113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:22.342715 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:22.342715 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c55ec201-4805-4382-9325-a551373f06c5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.161163 Oct 04 22:40:22.342715 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3872/7634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:22 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:40:23.293821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:23.294446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:23.301327 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:23.301814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:23.302780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:23.303481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:23.303946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:23.304383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:23.437217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:23.447304 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53908352-d6dc-4acd-932c-b2a9ffc0e300 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.157004 Oct 04 22:40:23.448320 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3763/7635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:23 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:24.471063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:24.471840 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:24.480050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:24.480677 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:24.481207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:24.481922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:24.482409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:24.482941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:24.626377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:24.634977 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82f93c66-06d3-4d10-99c3-69c2e9156473 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.168118 Oct 04 22:40:24.635576 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3873/7636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:24 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:25.659086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:25.659716 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:25.663723 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:40:25.663852 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e (ip 10.222.0.36) !!! Oct 04 22:40:25.671018 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:25.671521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:25.671983 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:25.672743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:25.673217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:25.673664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:25.818591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:25.826825 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56cb2c73-d3a4-4df8-a86d-f55d9116cafb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.171654 Oct 04 22:40:25.827358 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3764/7637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:25 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:26.575113 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "name": "network-vif-plugged", "status": "completed", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:26.580318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:26.581004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:26.587348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:26.587841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:26.588274 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:26.600141 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] Creating event network-vif-plugged:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h2-851029-13 Oct 04 22:40:26.605234 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9fc45288-c181-4e02-8ea5-0dda8c367f03 req-4b25200e-105e-401e-921d-876caca4ddc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034406 Oct 04 22:40:26.605853 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3874/7638] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:40:26.850311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:26.850954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:26.857779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:26.858436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:26.858916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:26.859619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:26.860085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:26.860521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:26.993969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:27.001729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a451d882-3770-44a7-b77f-aa4ae4825e29 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1391 microversion: 2.1 time: 0.155993 Oct 04 22:40:27.002318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3765/7639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:26 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:28.026178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:28.026946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:28.033830 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:28.034319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:28.034784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:28.035484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:28.035936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:28.036364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:28.170917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:28.179299 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71f2ab9f-d9e5-4c4e-984b-8e4648484274 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1561 microversion: 2.1 time: 0.157976 Oct 04 22:40:28.179868 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3875/7640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:28 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:28.201830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:28.202451 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:28.204350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:28.210061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:28.210534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:28.211009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:28.211710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:28.212175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:28.212610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:28.344439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:28.352683 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c1eaa43-bc43-4908-a916-ef8e5f851675 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1561 microversion: 2.1 time: 0.155084 Oct 04 22:40:28.353244 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3766/7641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:28 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:30.702076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:40:30.702725 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:30.706128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:30.710036 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:30.711074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:30.711512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:30.712220 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:30.712670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:30.713262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:30.721587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:30.722105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:30.722831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:30.737413 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] Creating event network-changed:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h2-851029-13 Oct 04 22:40:30.743841 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-91beeda8-3f78-4fe0-a553-de844778e16c req-5828cef9-8126-4c36-aeca-4bc147ddee8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042661 Oct 04 22:40:30.746907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3767/7642] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:40:30.956269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:40:30.965557 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-716e31b0-037a-40c1-b3a0-026592866d71 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1561 microversion: 2.1 time: 0.267897 Oct 04 22:40:30.966044 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3876/7643] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:40:30 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1561 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:40:52.218481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:40:52.220821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:40:52.223099 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:52.223815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:40:52.229711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:52.230217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:52.237160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:52.237160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:40:52.237160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:40:52.237160 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:40:52.287230 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fe75ce2-c1e7-4866-8808-6a29a165b350 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action" status: 200 len: 24572 microversion: 2.1 time: 0.073308 Oct 04 22:40:52.288399 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3768/7644] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:40:52 2022] POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:41:02.992180 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:02.994595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:02.996833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:02.997519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=46 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:03.002388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.002912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.003703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.004164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.004628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.005061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.050004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:03.056462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=123541) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 22:41:03.063474 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:41:03.063898 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:41:03.064382 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:41:03.064909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:41:03.065559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:41:03.354134 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7060ce2-ed8a-4b8f-861c-3d9c4739e2e2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action" status: 202 len: 0 microversion: 2.1 time: 0.366255 Oct 04 22:41:03.354788 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3877/7645] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:41:02 2022] POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:41:03.363692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:03.364415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:03.368313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:03.373366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.373868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.374322 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.375070 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:03.375544 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:03.375985 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:03.514884 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:03.523372 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9df7c119-035b-48a3-87fd-cc713809c4ac tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1689 microversion: 2.1 time: 0.164037 Oct 04 22:41:03.523953 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3769/7646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:03 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:41:04.549562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:04.550183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:04.558027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:04.558525 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:04.559141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:04.559862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:04.560330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:04.560765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:04.706319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:04.715102 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f1cb43b-eafa-4984-95b8-bd1d9e67f652 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1689 microversion: 2.1 time: 0.170635 Oct 04 22:41:04.715694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3878/7647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:04 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:05.737426 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:05.738052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:05.744929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:05.745453 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:05.745907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:05.746617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:05.747117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:05.747559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:05.893831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:05.901815 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5533f5d7-27fc-4c08-be78-d3a8c1be6a6f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1689 microversion: 2.1 time: 0.168332 Oct 04 22:41:05.902397 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3770/7648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:05 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:06.975084 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:06.975704 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:06.982293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:06.982809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:06.983253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:06.984769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:06.984769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:06.984942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:07.122934 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:07.131276 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bff3748f-6f8f-4215-bf21-34d226e3ae8d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1689 microversion: 2.1 time: 0.209270 Oct 04 22:41:07.131860 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3879/7649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:06 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:08.155139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:08.155764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:08.163339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:08.163833 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:08.164280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:08.164986 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:08.165459 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:08.165892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:08.305113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:08.313173 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84d1e95c-eb0b-4e28-b842-5d6e181346fd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.161881 Oct 04 22:41:08.314750 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3771/7650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:08 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:09.336770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:09.337377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:09.344082 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:09.344560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:09.344986 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:09.345667 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:09.346114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:09.346533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:09.482512 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:09.491101 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-821924a3-5750-4c66-9d41-345e95863346 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.157545 Oct 04 22:41:09.491681 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3880/7651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:09 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:41:10.514431 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:10.515096 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:10.521930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:10.522425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:10.522907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:10.523619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:10.524091 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:10.524529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:10.663946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:10.671849 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-877dd30d-f222-4973-9aca-50c1d029087d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.161381 Oct 04 22:41:10.672435 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3772/7652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:10 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:11.695546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:11.696166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:11.703727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:11.704441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:11.704888 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:11.705600 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:11.706061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:11.706494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:11.851605 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:11.851605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64a9e974-2c27-4b76-b9a9-374cd4f93f7b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.159038 Oct 04 22:41:11.851605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3881/7653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:11 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:12.874043 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:12.874577 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:12.882205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:12.882782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:12.883246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:12.883962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:12.884437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:12.884881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:13.019652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:13.027822 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bb2bc257-4488-49f1-bdd5-48e2769a3323 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.157773 Oct 04 22:41:13.028416 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3773/7654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:12 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:14.052570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:14.053187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:14.059906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:14.060393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:14.060835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:14.061536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:14.062001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:14.062431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:14.201965 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:14.210444 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c8b015c-c419-4bbf-9dbe-040f73c35fff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.162062 Oct 04 22:41:14.211095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3882/7655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:14 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:15.234946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:15.245799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:15.378765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:15.387774 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8549d061-5ea5-49ee-8810-fa54ae6f6a32 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.156752 Oct 04 22:41:15.388371 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3774/7656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:15 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:16.411681 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:16.412296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:16.419467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:16.419983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:16.420422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:16.421126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:16.421584 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:16.422019 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:16.569977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:16.584690 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6cc17a4c-d3bb-469d-925f-ecdb4f07a923 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.171427 Oct 04 22:41:16.584690 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3883/7657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:16 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:17.606024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:17.606652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:17.613551 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:17.614049 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:17.614517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:17.615291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:17.615756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:17.616192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:17.757062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:17.765823 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc90ed88-7beb-4586-9681-615683fc2b24 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.163642 Oct 04 22:41:17.766474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3775/7658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:17 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:18.790940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:18.791558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:18.798204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:18.798721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:18.799170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:18.799864 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:18.800321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:18.800751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:18.932897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:18.940944 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d450893-1960-48f7-a784-6fb20ba81830 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.154778 Oct 04 22:41:18.941691 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3884/7659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:18 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:19.965024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:19.965569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:19.972623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:19.973115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:19.973568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:19.974859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:19.975381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:19.975824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:20.113120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:20.121339 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34b43d64-85d0-4d41-ac0a-9c5f7c28a2e5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.160271 Oct 04 22:41:20.121973 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3776/7660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:19 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:21.144909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:21.145528 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:21.152522 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:21.153007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:21.153451 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:21.154159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:21.154614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:21.155067 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:21.292666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:21.300721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5994f478-1526-4ada-a18b-553f3ebc12b2 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.159831 Oct 04 22:41:21.301298 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3885/7661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:21 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:22.324945 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:22.325596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:22.332594 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.333092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.333543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.334258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:22.334752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:22.335197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:22.477865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:22.485726 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-500418a9-47a9-4554-8ed5-6a9bb9352df4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.164980 Oct 04 22:41:22.486294 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3777/7662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:22 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:41:23.510865 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:23.511543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:23.518311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:23.518862 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:23.519303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:23.519990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:23.520485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:23.521430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:23.653993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:23.662437 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb5a7371-8856-4315-addb-1f68bfd5f91d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1694 microversion: 2.1 time: 0.155654 Oct 04 22:41:23.663042 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3886/7663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:23 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:24.686057 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:24.686698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:24.694232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:24.694785 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:24.695235 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:24.695949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:24.696420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:24.696855 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:24.839695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:24.848219 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-79a478fa-4239-4d12-acef-e39d44effe58 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1693 microversion: 2.1 time: 0.165931 Oct 04 22:41:24.848836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3778/7664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:24 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:25.081680 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "name": "network-vif-unplugged", "status": "completed", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:25.092884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:25.099311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:25.099311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:25.105918 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Creating event network-vif-unplugged:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h1-851029-13 Oct 04 22:41:25.111756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123541) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:25.124199 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-cfefab20-1d50-40b3-8670-80730a6e228f req-69f8ac00-35fe-4ec4-ab7f-eae383c5fdb9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046536 Oct 04 22:41:25.124815 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3887/7665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:25.872396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:25.873026 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:25.880748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:25.881246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:25.881693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:25.882831 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:25.883308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:25.883747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:26.018389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:26.026724 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc96934c-4165-4fcd-9ca6-3223ad79e5f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1693 microversion: 2.1 time: 0.158215 Oct 04 22:41:26.027302 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3779/7666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:25 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:27.051302 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:27.051998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:27.059183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:27.059666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:27.060102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:27.060954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:27.061401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:27.061829 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:27.140720 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:27.152242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:27.152918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:27.153377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:27.166804 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Creating event network-changed:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h1-851029-13 Oct 04 22:41:27.172760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851029-13', 'n-h2-851029-13'} {{(pid=123542) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 22:41:27.192115 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-918c2c25-9d1e-4719-aa4b-ae756fe46a2c req-dbe3caab-2bb6-4bab-9c87-484b0b69a635 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055043 Oct 04 22:41:27.193611 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3780/7667] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:41:27.207880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:27.217964 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1573264f-d39f-4f87-97ad-5e017e66782c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1693 microversion: 2.1 time: 0.170938 Oct 04 22:41:27.218551 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3888/7668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:27 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:28.243807 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:28.244516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:28.251069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:28.251563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:28.252031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:28.252739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:28.253221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:28.253636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:28.390612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:28.398444 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9c056abe-98a0-44bb-8719-8ce6d0127fb7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1691 microversion: 2.1 time: 0.160694 Oct 04 22:41:28.399035 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3781/7669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:28 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:29.422757 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:29.423377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:29.431176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:29.431760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:29.432222 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:29.432930 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:29.433386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:29.433981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:29.581409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:29.589846 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbe2ccf4-d3be-43d7-9b49-129135849bcb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1691 microversion: 2.1 time: 0.171294 Oct 04 22:41:29.590442 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3889/7670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:29 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:30.613704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:30.614367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:30.621371 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.621873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.622328 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:30.623066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.623543 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.623989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:30.762676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:30.771793 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59d2c930-6fb8-4f53-948e-547d7d4ef213 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1688 microversion: 2.1 time: 0.161971 Oct 04 22:41:30.772388 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3782/7671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:30 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:30.794730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:30.795454 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:30.802255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.802848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.803349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:30.804107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:30.804633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:30.805122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.046463 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-035e2d2b-f1bd-44b5-b46b-f03d693b9593 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action" status: 204 len: 0 microversion: 2.1 time: 0.255516 Oct 04 22:41:31.047187 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3890/7672] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:41:30 2022] POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:41:31.056095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:31.056790 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:31.063928 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.064629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.065272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.066358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.067290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.067958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.237023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:31.246166 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0142325-8c22-494d-964e-a5a662aa7a81 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1688 microversion: 2.1 time: 0.194445 Oct 04 22:41:31.249410 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3783/7673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:31 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:31.272308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:31.273044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:31.279455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.279947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.280392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.281100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:31.281566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:31.282000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:31.297843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:31.463271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:31.480558 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f664e3b-e613-4ae0-9f82-236d3bdc2837 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1688 microversion: 2.1 time: 0.212698 Oct 04 22:41:31.481355 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3891/7674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:31 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:32.504125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:32.504787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:32.511710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:32.512205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:32.512730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:32.513408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:32.513832 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:32.514264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:32.660397 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:32.668843 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-942a3526-36a8-4a33-b66d-d7401b3a3055 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1688 microversion: 2.1 time: 0.168949 Oct 04 22:41:32.669457 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3784/7675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:32 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:41:33.037602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "name": "network-vif-plugged", "status": "completed", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:41:33.047371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:33.047854 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:33.048287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:33.063563 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] Creating event network-vif-plugged:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h1-851029-13 Oct 04 22:41:33.069263 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-99b79505-021e-4e7f-b3c9-7f33a6778e1f req-3f935537-fc9f-4a70-82e0-ee7bdea519bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088827 Oct 04 22:41:33.069829 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3892/7676] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:41:33.693139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:41:33.693685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:41:33.696499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:33.701483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:33.702011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:33.702464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:33.703214 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:41:33.703686 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:41:33.704196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:41:33.708781 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=99 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:41:33.837849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:41:33.846443 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22429a90-e29f-458c-b381-6af04654673d tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1680 microversion: 2.1 time: 0.157845 Oct 04 22:41:33.847147 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3785/7677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:41:33 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:04.064933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:04.065693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=5 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:04.070049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:04.072434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:04.079251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:04.080690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:04.080690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:04.080868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:04.081301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:04.082249 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:04.135757 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c1c0f485-43bd-46c0-b4fa-b17c4bff42d9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action" status: 200 len: 24578 microversion: 2.1 time: 0.073262 Oct 04 22:42:04.136490 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3893/7678] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:42:04 2022] POST /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e/action => generated 24578 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:42:21.444617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:21.444617 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:21.445225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:21.445582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:21.445582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=5 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:21.448155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:21.448668 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:21.449133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:21.450259 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:21.450513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:21.450804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:21.452565 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:21.454073 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:21.462176 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:21.462848 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:21.463390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:21.476568 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] Creating event network-changed:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h1-851029-13 Oct 04 22:42:21.479951 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:42:21.482148 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-459d40ba-62d4-411f-a3ab-5fa41bf5052e req-79e5335c-900f-40ec-aa30-bde16976138a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045921 Oct 04 22:42:21.483171 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3894/7679] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:21.954875 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f319d7b-f9d8-4815-895f-bfbd73b83d94 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 204 len: 0 microversion: 2.1 time: 0.521190 Oct 04 22:42:21.956140 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3786/7680] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:42:21 2022] DELETE /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:42:21.967950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:21.969195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:21.978359 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:21.979298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:21.979981 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:21.980949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:21.981779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:21.982425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:22.131411 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:22.139571 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c640bdae-631b-40b6-844e-b1dce4ee7280 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1686 microversion: 2.1 time: 0.177973 Oct 04 22:42:22.140158 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3895/7681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:21 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:23.168747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:23.169466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:23.177174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:23.177670 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:23.178126 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:23.178900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:23.179372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:23.179815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:23.313040 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:23.320960 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-187000fa-dc97-42b9-bad9-23c87345c452 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1567 microversion: 2.1 time: 0.156486 Oct 04 22:42:23.321544 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3787/7682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:23 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:23.926318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e541447-b8ad-451f-8a34-0dbaeaae5a6e", "name": "network-vif-deleted", "tag": "56ff215e-9782-4d9e-ad4e-e809a89468d5"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:23.936992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:23.937478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:23.938120 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:23.950129 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] Creating event network-vif-deleted:56ff215e-9782-4d9e-ad4e-e809a89468d5 for instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e on n-h1-851029-13 Oct 04 22:42:23.955212 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f098528d-13a0-43f7-8eea-23d111fe2b85 req-e73891cd-c82b-45c0-8fe1-be4a43e87b9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Oct 04 22:42:23.956702 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3896/7683] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:24.344545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:24.345391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:24.352599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:24.353187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:24.353646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:24.354350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:24.354865 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:24.355306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:24.388885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:24.389383 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:24.389836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:24.390300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lazy-loading 'fault' on Instance uuid 7e541447-b8ad-451f-8a34-0dbaeaae5a6e {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:42:24.435372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:24.451933 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-124e4d45-55c1-4b7a-b140-b9aa5766d954 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 200 len: 1355 microversion: 2.1 time: 0.111287 Oct 04 22:42:24.452498 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3788/7684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:24 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 1355 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:25.476187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:25.476917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 7e541447-b8ad-451f-8a34-0dbaeaae5a6e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:25.483940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:25.484464 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:25.484856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:25.485541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:25.485990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:25.486415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:25.500306 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] HTTP exception thrown: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Request method failure captured: Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e HTTP/1.1 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLVX1Dc8FB_KBKVSHTiMa3Z4UcEenYGjiRlVBlGiDMZcseAaf6r_792XDIyR5ic2GX7e0b-NRl7a1F4UWGsd8LUXGAYa8rlbkf5n64BVJyHd84U5w27A7KBd0t4bQWeU6yx_py0smCyLITJVsIk56DEr2f3jhKOE84gsaz_TxjkVLgA Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c46a9af8ecc54b789da81391bb358260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a2050bdc49a7450ea712b0f31f637dca Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '7e541447-b8ad-451f-8a34-0dbaeaae5a6e'} Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:42:25.502035 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Returning 404 to user: Instance 7e541447-b8ad-451f-8a34-0dbaeaae5a6e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8bea5f4-acef-400c-b4e3-9dc96374a4da tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e" status: 404 len: 111 microversion: 2.1 time: 0.032614 Oct 04 22:42:25.507027 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3897/7685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:25 2022] GET /compute/v2.1/servers/7e541447-b8ad-451f-8a34-0dbaeaae5a6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:42:29.610364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-49c5c373-2747-469b-84a8-6b32db99db8e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '.version_select at 0x7f54f6016a60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:29.716095 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-49c5c373-2747-469b-84a8-6b32db99db8e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40323584" status: 202 len: 0 microversion: 2.1 time: 0.109369 Oct 04 22:42:29.716746 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3789/7686] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 4 22:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40323584 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:42:29.747628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: .version_select at 0x7f54f55451f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-159763604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0CaFGJqt/D7MQ0BVYZ4RLQtA3M1iPxXB5vN5WMYhVtIrxZYoamtznbqriU2IPMS9I3NvhPsbl6cVuAEz1TAJrPsIn62shVXLcyL+H6S7hFl/q4WCR/TR41BJIZUeXJtw=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:29.767448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:42:29.775421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:42:29.791968 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:42:30.799339 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [156649cd-679d-4941-b90d-b8cfbe0bb371] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50432. Oct 04 22:42:30.904046 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6f3d6cd0-d8a8-4b1d-9c56-15645ece70a0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.160725 Oct 04 22:42:30.904590 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3898/7687] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:42:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:39.889853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:39.890787 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:39.895991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-929161304", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "cf79e286-c994-4749-959d-d827068a9edf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-159763604", "security_groups": [{"name": "tempest-secgroup-smoke-809131069"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:40.137757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] validate_networks() for [('cf79e286-c994-4749-959d-d827068a9edf', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:42:40.957443 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:42:40.958000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:42:40.958360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:42:40.958818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:42:40.959277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:42:40.968268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:40.968764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:40.969221 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:40.969964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:40.970435 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:40.970899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:40.989394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:42:40.994730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:42:41.007010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:42:41.009354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:42:41.117390 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5053ee93-b8f4-44a0-8240-7157eb99dea3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.229228 Oct 04 22:42:41.118053 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3790/7688] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:42:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:42:41.128182 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:41.128676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:41.129203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:41.133324 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39b452aa-237a-4ea2-b586-162a93cd1c8b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:41.136217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39b452aa-237a-4ea2-b586-162a93cd1c8b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:41.248009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-39b452aa-237a-4ea2-b586-162a93cd1c8b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:41.256617 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39b452aa-237a-4ea2-b586-162a93cd1c8b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1265 microversion: 2.1 time: 0.131115 Oct 04 22:42:41.257198 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3899/7689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:41 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:42.279415 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:42.280291 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:42.292710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:42.293226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:42.293771 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:42.298347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:42.298347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:42.298347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:42.360675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:42.369514 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-72ad0743-35de-4875-b55a-a3c1db990c2b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1269 microversion: 2.1 time: 0.094037 Oct 04 22:42:42.370126 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3791/7690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:42 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:43.394046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:43.395436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:43.402592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:43.403365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:43.403973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:43.404688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:43.405459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:43.405900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:43.470515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:43.479374 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a3b5cd1-efe2-4948-bbaf-3a0610e6273c tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1325 microversion: 2.1 time: 0.089525 Oct 04 22:42:43.479996 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3900/7691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:43 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:44.504194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:44.504892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:44.512290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.513010 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.513653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.514569 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:44.515078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:44.515527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:44.657801 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:44.665810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-405dbc7f-e3b6-426b-916d-bb4162a96b7a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.166511 Oct 04 22:42:44.666398 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3792/7692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:44 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:45.272399 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2508e423-8618-4726-a96e-03100e664bef", "tag": "a2f5d542-fa44-49d2-91b8-840976c17bd1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:45.282735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:45.283214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:45.284273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:45.297907 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] Creating event network-changed:a2f5d542-fa44-49d2-91b8-840976c17bd1 for instance 2508e423-8618-4726-a96e-03100e664bef on n-h1-851029-13 Oct 04 22:42:45.302949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9ac39535-f583-4927-82b7-13c4ec8525c0 req-fcf45111-6cb8-4f61-a49d-b70b2d4d8d27 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034899 Oct 04 22:42:45.304209 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3901/7693] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:45.695839 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:45.696342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:45.703411 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:45.703915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:45.704398 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:45.705108 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:45.706265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:45.706817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:45.849481 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:45.857425 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eea4008c-d7c1-4046-8974-56b72e94f9e3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.165678 Oct 04 22:42:45.858003 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3793/7694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:45 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:46.882544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:46.883240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:46.889716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.890196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.890636 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:46.891351 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:46.891804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:46.892230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:47.029945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:47.037749 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20bc56df-92d9-4f8a-89b0-f36e18ac80ea tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.160995 Oct 04 22:42:47.038314 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3902/7695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:46 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:48.060583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:48.061205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:48.068106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:48.068597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:48.069039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:48.069750 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:48.070237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:48.070692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:48.204403 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:48.212452 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f0f3d23-c509-4b0d-8405-abf38f0c7bd7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.155721 Oct 04 22:42:48.213026 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3794/7696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:48 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:49.236061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:49.237056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:49.243732 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.244254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.244695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.245398 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:49.245857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:49.246293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:49.382081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:49.389994 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-765f6235-9017-4ddf-9435-02fe778042a3 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.157986 Oct 04 22:42:49.390605 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3903/7697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:49 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:50.413976 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:50.414519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:50.421473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.421967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.422414 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.423149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:50.423619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:50.424685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:50.555958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:50.563802 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e67b7e6-e193-40da-ba74-394952598203 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.153901 Oct 04 22:42:50.564380 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3795/7698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:50 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:51.586777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:51.587392 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:51.590275 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:51.595119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.596172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.596621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:51.597362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:51.597817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:51.598247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:51.732219 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:51.740806 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1f03872d-f8ab-44fe-afc9-79d05bd9a572 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.158023 Oct 04 22:42:51.741395 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3904/7699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:51 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:52.767610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:52.768229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:52.770084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:52.770911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:42:52.776370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:52.776863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:52.777315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:52.780529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:52.780529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:52.780529 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:52.915728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:52.924056 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-259ec539-34be-467d-866e-0a2479fc0241 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.159812 Oct 04 22:42:52.963277 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3796/7700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:52 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:53.367906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2508e423-8618-4726-a96e-03100e664bef", "name": "network-vif-plugged", "status": "completed", "tag": "a2f5d542-fa44-49d2-91b8-840976c17bd1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:53.378624 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.379156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.379598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.391222 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] Creating event network-vif-plugged:a2f5d542-fa44-49d2-91b8-840976c17bd1 for instance 2508e423-8618-4726-a96e-03100e664bef on n-h1-851029-13 Oct 04 22:42:53.396430 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4c8ae507-01e0-4d74-8c14-9755f07504cf req-fa06bc32-776e-464a-a13a-f2a89ed3faf2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032910 Oct 04 22:42:53.397030 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3905/7701] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:53.946984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:53.947610 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:53.955482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.955993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.956446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:53.957154 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:53.957639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:53.958075 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:54.092104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:54.099805 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cec59da0-c8dc-4881-884e-3fb37c766b39 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1390 microversion: 2.1 time: 0.156766 Oct 04 22:42:54.100372 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3797/7702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:53 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:55.125448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:55.126152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:55.132742 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.133225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.133661 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.134367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.134844 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.135270 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.276544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:55.281779 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a3b657f7-afad-45c6-b3f6-7521d3a339e0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1563 microversion: 2.1 time: 0.161487 Oct 04 22:42:55.282362 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3906/7703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:55 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:42:55.304882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:55.305499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:55.312215 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.312706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.313145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.313842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:55.314943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:55.315370 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:55.447910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:55.456765 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c62977a-501d-4e6f-a622-71f6847e4e4b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1563 microversion: 2.1 time: 0.155678 Oct 04 22:42:55.457347 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3798/7704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:55 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:42:57.541779 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:42:57.542396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:42:57.550426 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.551061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.551503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.552487 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.553187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.553823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.631525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2508e423-8618-4726-a96e-03100e664bef", "tag": "a2f5d542-fa44-49d2-91b8-840976c17bd1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:42:57.641550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:42:57.642051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:42:57.642991 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:42:57.656310 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] Creating event network-changed:a2f5d542-fa44-49d2-91b8-840976c17bd1 for instance 2508e423-8618-4726-a96e-03100e664bef on n-h1-851029-13 Oct 04 22:42:57.662513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7ebca006-f824-48a0-b1ec-b98712971029 req-f7e81403-5abb-49c3-9445-913ecb21b4d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122168 Oct 04 22:42:57.663218 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3799/7705] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:42:57.703735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:42:57.712755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e47085ca-fde4-4881-af9d-05f3842c1f88 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1563 microversion: 2.1 time: 0.175552 Oct 04 22:42:57.713352 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3907/7706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:42:57 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:43:31.056606 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:43:31.058997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:43:31.061258 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:43:31.062039 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=52 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:43:31.067200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:43:31.067779 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:43:31.068231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:43:31.068944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:43:31.069407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:43:31.069843 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:43:31.124807 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee674e76-48e9-45f9-9cb6-3145f6428128 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action" status: 200 len: 24566 microversion: 2.1 time: 0.072563 Oct 04 22:43:31.126034 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3800/7707] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:43:31 2022] POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:44:01.504582 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=20 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:01.505349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=40 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:01.506597 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:44:01.506764 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:44:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action (ip 10.222.0.36) !!! Oct 04 22:44:01.513296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:01.523214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:01.523745 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:01.524189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:01.555003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 22:44:01.818978 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03131369-c835-41d9-827c-5741c760b16b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action" status: 202 len: 0 microversion: 2.1 time: 0.316107 Oct 04 22:44:01.819646 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3908/7708] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:01 2022] POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:44:01.830139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:01.837486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:01.841917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:01.842416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:01.842956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:01.843705 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:01.844178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:01.844618 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:01.986153 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:01.994965 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ab92651-ba49-4a14-8771-3a6cb9dc06b5 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.170570 Oct 04 22:44:01.995559 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3801/7709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:01 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:03.022517 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:03.023253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:03.029457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:03.029938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:03.031055 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:03.031750 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:03.032207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:03.032643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:03.166020 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:03.173931 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b60934fb-4a20-4460-aa82-466c599a36aa tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.156737 Oct 04 22:44:03.174502 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3909/7710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:03 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:04.197208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:04.197737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:04.205929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:04.206424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:04.206911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:04.207666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:04.208155 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:04.208579 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:04.345177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:04.353236 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a514133-8228-4960-9a23-858ce5912182 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.160024 Oct 04 22:44:04.353817 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3802/7711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:04 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:05.376527 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:05.377142 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:05.384046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:05.384533 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:05.384967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:05.385673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:05.386128 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:05.386557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:05.517737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:05.525611 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8cab97af-8a7a-4a08-81a6-4d65414d7f13 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.153058 Oct 04 22:44:05.526180 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3910/7712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:05 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:06.549891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:06.550541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:06.557684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:06.558188 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:06.558643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:06.559391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:06.559871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:06.560312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:06.695758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:06.704516 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-45a81867-f566-4dd8-9aef-fa2d7e7edeb8 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.158640 Oct 04 22:44:06.705103 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3803/7713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:06 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:07.727867 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:07.728596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:07.736076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:07.736559 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:07.737000 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:07.737696 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:07.738149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:07.738579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:07.869690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:07.878670 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-71e43740-a0f8-43fd-a791-29d48f996683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.154783 Oct 04 22:44:07.879457 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3911/7714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:07 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:08.903148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:08.904037 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:08.910545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:08.911093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:08.911545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:08.912263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:08.912733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:08.913175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:09.057506 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:09.066054 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62f41870-349e-4add-976f-fd991cac8d91 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.167060 Oct 04 22:44:09.066634 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3804/7715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:08 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:10.089785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:10.090315 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:10.099050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:10.099539 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:10.100042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:10.100693 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:10.101145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:10.101566 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:10.241966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:10.250704 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31a5ce1b-f983-4718-bcae-d6472ca29c0f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.164920 Oct 04 22:44:10.256821 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3912/7716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:10 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:11.275725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:11.276352 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:11.283770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:11.284447 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:11.285003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:11.285881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:11.286404 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:11.287061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:11.425522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:11.433463 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80cdd3c2-278d-4b3c-a731-78673afdfba4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.161690 Oct 04 22:44:11.434037 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3805/7717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:11 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:12.457942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:12.458491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:12.465756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:12.466267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:12.466768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:12.468035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:12.468506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:12.468993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:12.612891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:12.621932 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd8a3a3c-5c92-40e0-89af-a44ca593bc3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.168016 Oct 04 22:44:12.622544 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3913/7718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:12 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:13.647285 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:13.647899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:13.655100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:13.655623 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:13.656085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:13.656821 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:13.657298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:13.657737 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:13.798092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:13.805912 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-83010070-dc8e-40cd-940c-c249f395c677 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.162808 Oct 04 22:44:13.806487 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3806/7719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:13 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:44:14.830378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:14.830939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:14.837483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:14.837961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:14.838393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:14.839138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:14.839588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:14.840007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:14.981040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:14.989490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bd60195-0042-48d4-8e79-5b990824f387 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.163360 Oct 04 22:44:14.990183 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3914/7720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:14 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:16.014875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:16.015773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:16.022652 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.023246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.023717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.024399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:16.024864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:16.025294 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:16.159791 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:16.167579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75aa8347-e25a-4749-a8ba-3153ed7e8fbf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.158334 Oct 04 22:44:16.168160 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3807/7721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:16 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:17.190954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:17.191897 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:17.198989 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:17.201578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:17.201578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:17.201578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:17.201578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:17.201912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:17.346442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:17.354694 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1989b82c-0e75-46d8-9462-47f3dcbd1ba6 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1691 microversion: 2.1 time: 0.167753 Oct 04 22:44:17.358330 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3915/7722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:17 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:18.379820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:18.380601 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:18.387703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.388199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.388752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.389491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:18.389961 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:18.390400 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:18.526604 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:18.535116 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1fc1689-8708-44d3-b293-7ad6df99357b tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1668 microversion: 2.1 time: 0.159217 Oct 04 22:44:18.535675 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3808/7723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:18 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:19.635785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:19.637914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:19.644952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.645452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.645922 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.646651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.647163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.647620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.700447 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b11255d-bc0a-4282-9cbe-30860a2642a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action" status: 200 len: 35758 microversion: 2.1 time: 0.068531 Oct 04 22:44:19.701414 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3916/7724] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:19 2022] POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action => generated 35758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:44:19.713111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:19.720226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:19.720645 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:19.721101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:19.744234 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Going to try to start instance {{(pid=123542) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 22:44:19.986507 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bc8ae888-7087-4849-a176-f5f39f48cf52 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action" status: 202 len: 0 microversion: 2.1 time: 0.276410 Oct 04 22:44:19.987098 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3809/7725] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:19 2022] POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:44:19.996460 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:20.007973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:20.142509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:20.153507 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ae84e18b-2b7a-4212-a85d-97dabcfc6250 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1677 microversion: 2.1 time: 0.161271 Oct 04 22:44:20.154130 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3917/7726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:19 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:21.182194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:21.182957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:21.189914 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:21.190408 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:21.190881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:21.191597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:21.192062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:21.192500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:21.344314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:21.352518 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-086bb7c2-e377-41db-8c8e-a8e069e5c54e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1677 microversion: 2.1 time: 0.176412 Oct 04 22:44:21.353104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3810/7727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:21 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:22.377484 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:44:22.378100 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:22.385045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:22.385529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:22.385967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:22.386686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:22.387144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:22.387575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:22.525835 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:44:22.533824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2daa39a6-38d5-41e6-b791-8d28abea95ee tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1681 microversion: 2.1 time: 0.160343 Oct 04 22:44:22.534413 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3918/7728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:44:22 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:44:54.765758 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:44:54.768095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:44:54.770342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=22 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:54.771052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:44:54.775732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:54.783069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:54.783069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:54.783069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:44:54.783069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:44:54.783069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:44:54.843418 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3eb91a26-2bc6-4871-8917-6ebcc3da9b0a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action" status: 200 len: 60321 microversion: 2.1 time: 0.081572 Oct 04 22:44:54.844353 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3811/7729] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:44:54 2022] POST /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef/action => generated 60321 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:45:12.337552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:12.338091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:12.340676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2508e423-8618-4726-a96e-03100e664bef", "tag": "a2f5d542-fa44-49d2-91b8-840976c17bd1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:12.341297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=22 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:12.342164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:12.347564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:12.348155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:12.349004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:12.349670 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:12.350206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:12.350786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:12.352437 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:12.358749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:12.358749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:12.358749 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:12.372789 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] Creating event network-changed:a2f5d542-fa44-49d2-91b8-840976c17bd1 for instance 2508e423-8618-4726-a96e-03100e664bef on n-h1-851029-13 Oct 04 22:45:12.378742 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f5c1d989-b6ec-4e32-a054-ba283038c8b2 req-765a9f7f-b54b-48a5-bae9-b3a1ed9f9bb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042492 Oct 04 22:45:12.379882 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3812/7730] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:45:12.381483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:45:12.795940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac9532cb-48aa-4a60-8abe-ba7b54d7fbc4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 204 len: 0 microversion: 2.1 time: 0.462595 Oct 04 22:45:12.797026 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3919/7731] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:45:12 2022] DELETE /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:45:12.807957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:12.808683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:12.815406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:12.815910 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:12.816467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:12.817210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:12.818622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:12.819120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:12.962085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:12.971513 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22084482-5200-44be-a7cd-fe180f499fcf tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1687 microversion: 2.1 time: 0.169928 Oct 04 22:45:12.980448 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3813/7732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:12 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:13.996095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:13.996878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:14.006828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:14.007052 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:14.007588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:14.008470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:14.008932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:14.009490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:14.174746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:14.182605 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d76beda8-bbe5-4920-9e15-efcf5f795e38 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1687 microversion: 2.1 time: 0.191012 Oct 04 22:45:14.183208 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3920/7733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:13 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:15.207167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:15.207870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:15.212129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2508e423-8618-4726-a96e-03100e664bef", "name": "network-vif-deleted", "tag": "a2f5d542-fa44-49d2-91b8-840976c17bd1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:15.215578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:15.216115 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:15.216561 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:15.217282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:15.217802 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:15.218494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:15.222581 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:15.227732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:15.227732 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:15.235579 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] Creating event network-vif-deleted:a2f5d542-fa44-49d2-91b8-840976c17bd1 for instance 2508e423-8618-4726-a96e-03100e664bef on n-h1-851029-13 Oct 04 22:45:15.240729 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5399a8d9-1e0d-400a-a32a-669ed83da6d6 req-6df20929-b8f6-4676-b500-4f573dad2061 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085225 Oct 04 22:45:15.241335 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3814/7734] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:15.283598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:15.291652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e29df8d4-a721-4394-a199-30ea6e5d65de tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 200 len: 1502 microversion: 2.1 time: 0.088639 Oct 04 22:45:15.296376 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3921/7735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:15 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 1502 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:45:16.317295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:16.318077 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 2508e423-8618-4726-a96e-03100e664bef] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:16.324360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.324926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.325680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.326399 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:16.326903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:16.327347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:16.341905 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] HTTP exception thrown: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Request method failure captured: Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef HTTP/1.1 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLVX1Dc8FB_KBKVSHTiMa3Z4UcEenYGjiRlVBlGiDMZcseAaf6r_792XDIyR5ic2GX7e0b-NRl7a1F4UWGsd8LUXGAYa8rlbkf5n64BVJyHd84U5w27A7KBd0t4bQWeU6yx_py0smCyLITJVsIk56DEr2f3jhKOE84gsaz_TxjkVLgA Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c46a9af8ecc54b789da81391bb358260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: a2050bdc49a7450ea712b0f31f637dca Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '2508e423-8618-4726-a96e-03100e664bef'} Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:45:16.343756 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Returning 404 to user: Instance 2508e423-8618-4726-a96e-03100e664bef could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23d9ad77-27ec-4e00-b060-f3d123a6c376 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef" status: 404 len: 111 microversion: 2.1 time: 0.033375 Oct 04 22:45:16.347101 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3815/7736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:16 2022] GET /compute/v2.1/servers/2508e423-8618-4726-a96e-03100e664bef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:45:20.173868 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d7df5353-f4ad-4de1-9110-1fafb9ff46be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '.version_select at 0x7f54f56983a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:20.267300 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d7df5353-f4ad-4de1-9110-1fafb9ff46be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159763604" status: 202 len: 0 microversion: 2.1 time: 0.097515 Oct 04 22:45:20.267907 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3922/7737] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 4 22:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-159763604 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:45:20.301964 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: .version_select at 0x7f54f629c700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-778473643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKAF71EWp3zQYifO8vdSJ9FdYMNSA4hsXTxTELPNPikrFOaagL+9BEGWpi9dMefxIGH+Rsf+ei8LviYAuCsDqbmVtn7mjNIAiMMJoiJuEWHZgt7uUbX4L8yaIjtH2cDHg=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:20.320088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:45:20.325553 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:45:20.339993 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:45:21.347278 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50686. Oct 04 22:45:21.433722 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bf94af4-4af4-48ae-bbd8-dca1452543cc tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.135642 Oct 04 22:45:21.434343 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3816/7738] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:45:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:45:31.001883 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1474852490", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "networks": [{"uuid": "039eb591-f12a-4723-8272-7f5d614712b6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-778473643", "security_groups": [{"name": "tempest-secgroup-smoke-1918748168"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:31.014643 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:31.015974 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:31.130210 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] validate_networks() for [('039eb591-f12a-4723-8272-7f5d614712b6', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:45:31.619789 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:45:31.620256 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:45:31.620961 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:45:31.621388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:45:31.622005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:45:31.633177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:31.633678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:31.634232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:31.635012 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:31.635478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:31.635911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:31.658448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:45:31.665377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Getting quotas for user a2050bdc49a7450ea712b0f31f637dca and project c46a9af8ecc54b789da81391bb358260. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:45:31.679303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:45:31.681803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:45:31.848162 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80596150-2d54-482e-9642-855cf808d24e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.850105 Oct 04 22:45:31.850710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3923/7739] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:45:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:45:31.860441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e93346cd-13c1-4dbe-9513-aa711e765d01 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:31.868573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e93346cd-13c1-4dbe-9513-aa711e765d01 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:31.868573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=16 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:31.868573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=4 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:31.868573 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:31.962232 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e93346cd-13c1-4dbe-9513-aa711e765d01 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:31.971069 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e93346cd-13c1-4dbe-9513-aa711e765d01 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1266 microversion: 2.1 time: 0.114610 Oct 04 22:45:31.971663 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3817/7740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:31 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:32.996157 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d109618-1cf2-4df2-a7cb-a7024ac159f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:32.996880 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d109618-1cf2-4df2-a7cb-a7024ac159f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:33.059990 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d109618-1cf2-4df2-a7cb-a7024ac159f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:33.067422 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d109618-1cf2-4df2-a7cb-a7024ac159f4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1266 microversion: 2.1 time: 0.077150 Oct 04 22:45:33.068016 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3924/7741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:32 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:34.093804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:34.094428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:34.102643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:34.103171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:34.103625 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:34.104343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:34.104830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:34.105286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:34.171391 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:34.179957 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-96b8edd7-5956-4c3b-99ac-35f8ee2f96ca tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1318 microversion: 2.1 time: 0.091582 Oct 04 22:45:34.180547 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3818/7742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:34 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:35.203928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:35.204568 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:35.212360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:35.212805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:35.213240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:35.213966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:35.214924 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:35.215348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:35.283571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:35.293023 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f167fde5-b144-4cb9-8fd0-e3f94f8558b7 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1336 microversion: 2.1 time: 0.093253 Oct 04 22:45:35.293818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3925/7743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:35 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1336 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:36.320123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:36.321015 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:36.328969 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:36.329492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:36.329955 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:36.330712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:36.331197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:36.331680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:36.536484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:36.544893 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dcd2e39e-b06e-41df-90cf-4bf327ae98ef tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.228991 Oct 04 22:45:36.545697 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3819/7744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:36 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:45:36.763498 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb8344d-8b95-4176-b58e-d0721dd74471", "tag": "bfc8787f-7b50-4224-8a6e-8e75b76f15f7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:36.775103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:36.775588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:36.776050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:36.787962 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] Creating event network-changed:bfc8787f-7b50-4224-8a6e-8e75b76f15f7 for instance 9fb8344d-8b95-4176-b58e-d0721dd74471 on n-h2-851029-13 Oct 04 22:45:36.793083 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d6826296-d6bb-41ca-8726-f089241267f3 req-27a3c51a-ec03-48eb-89b3-a1a58f7568d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Oct 04 22:45:36.793696 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3926/7745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:37.568428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:37.569097 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:37.576885 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:37.577131 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:37.577589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:37.578316 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:37.578848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:37.579295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:37.716875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:37.724621 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97bd2ac8-c2f4-4333-8422-fe5b6cd96d3f tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.160314 Oct 04 22:45:37.725211 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3820/7746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:37 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:38.748583 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:38.749266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:38.755743 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:38.756319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:38.756800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:38.757557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:38.758130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:38.758562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:38.896914 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:38.905656 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65cf0a67-e889-44f8-966c-7371e6d5b8ff tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.162214 Oct 04 22:45:38.906243 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3927/7747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:38 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:39.929387 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:39.930054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:39.937576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:39.938124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:39.938586 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:39.939354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:39.939842 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:39.940323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:40.091867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:40.100607 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e04fb5b3-98a3-4b6d-b86c-3911d233cea4 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.175225 Oct 04 22:45:40.101221 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3821/7748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:39 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:41.125236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:41.125839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:41.132847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:41.133329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:41.133772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:41.134475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:41.134955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:41.135381 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:41.267090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:41.274650 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f633b063-6ed9-4ed2-929e-6eced0d823f0 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.153918 Oct 04 22:45:41.275239 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3928/7749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:41 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:42.081557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8344d-8b95-4176-b58e-d0721dd74471", "name": "network-vif-plugged", "status": "completed", "tag": "bfc8787f-7b50-4224-8a6e-8e75b76f15f7"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:42.087990 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:45:42.088120 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:45:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 04 22:45:42.102846 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:42.103355 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:42.103783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:42.115052 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] Creating event network-vif-plugged:bfc8787f-7b50-4224-8a6e-8e75b76f15f7 for instance 9fb8344d-8b95-4176-b58e-d0721dd74471 on n-h2-851029-13 Oct 04 22:45:42.120063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f8709c36-d2ac-4883-ab35-d3ef938eab6e req-a823717c-856a-4c43-8818-b352eb4380d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042733 Oct 04 22:45:42.120716 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3822/7750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:45:42.299235 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:42.300322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:42.303208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:42.311293 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:42.311906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:42.312360 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:42.313296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:42.314340 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:42.315181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:42.467720 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:42.475726 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83d1d3a3-72c5-4215-9e42-7b8cc841f083 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.181268 Oct 04 22:45:42.476318 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3929/7751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:42 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:43.499110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:43.499830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:43.507080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:43.507582 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:43.508032 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:43.508754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:43.509290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:43.509667 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:43.650557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:43.658462 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e45ec3b1-a5a0-47eb-992c-59a2bac2c9a9 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1392 microversion: 2.1 time: 0.163697 Oct 04 22:45:43.659081 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3823/7752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:43 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:44.682458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:44.683108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:44.685509 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:44.691081 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:44.691562 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:44.691996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:44.692722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:44.693765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:44.693765 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:44.834591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:44.843630 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eb2561b3-337b-42e5-8f1f-d5188e04c987 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1564 microversion: 2.1 time: 0.165638 Oct 04 22:45:44.844513 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3930/7753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:44 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:44.872570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:44.873192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:44.875192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:45:44.880903 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:44.881401 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:44.881849 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:44.882563 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:44.883059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:44.883496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:45.020941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:45.029820 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-115987d6-c45e-4109-81d4-6a31bb5ccdcd tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1564 microversion: 2.1 time: 0.161056 Oct 04 22:45:45.039101 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3824/7754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:44 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:45:47.547090 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:45:47.548118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:45:47.552814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb8344d-8b95-4176-b58e-d0721dd74471", "tag": "bfc8787f-7b50-4224-8a6e-8e75b76f15f7"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:45:47.563548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.563771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.564048 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.564267 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.564696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.564879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.565775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:45:47.566233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:45:47.566702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:45:47.578172 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] Creating event network-changed:bfc8787f-7b50-4224-8a6e-8e75b76f15f7 for instance 9fb8344d-8b95-4176-b58e-d0721dd74471 on n-h2-851029-13 Oct 04 22:45:47.584921 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-97366467-dc3d-47ce-b3b9-b64f1d00ed4d req-7cb069ea-079c-4e0f-87a2-df37af3d69d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035647 Oct 04 22:45:47.584921 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3825/7755] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:45:47.807264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:45:47.816450 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-825d87e5-e32f-4660-9c65-bf0d403c4683 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1564 microversion: 2.1 time: 0.274410 Oct 04 22:45:47.817051 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3931/7756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:45:47 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1564 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:09.100282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=20 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:09.101113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:09.339007 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:09.342165 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:09.350271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:09.351994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:09.351994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:09.352212 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:09.352665 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:09.353110 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:09.410502 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-07da07d3-0182-4965-a341-f758cbdc79db tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action" status: 200 len: 24572 microversion: 2.1 time: 0.312157 Oct 04 22:46:09.411186 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3826/7757] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:09 2022] POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action => generated 24572 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:46:15.855046 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:15.855614 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:15.857980 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:15.858727 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=40 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:15.863668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:15.864161 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:15.864603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:15.865300 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:15.865763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:15.866184 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:15.891825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lazy-loading 'flavor' on Instance uuid 9fb8344d-8b95-4176-b58e-d0721dd74471 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:46:16.266762 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4263e844-a44f-402f-8ccd-89d9d1e89c06 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action" status: 202 len: 0 microversion: 2.1 time: 0.415660 Oct 04 22:46:16.267697 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3932/7758] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:15 2022] POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:46:16.276911 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:16.277699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:16.285222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:16.285752 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:16.286237 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:16.287199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:16.287693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:16.288124 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:16.447072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:16.455254 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd32a032-59f6-42a1-9956-e6faf5898d84 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1691 microversion: 2.1 time: 0.183023 Oct 04 22:46:16.455846 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3827/7759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:16 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:17.482287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:17.483023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:17.489455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:17.489937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:17.490378 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:17.491165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:17.491655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:17.492088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:17.675828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:17.690687 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bacbbee4-e035-4723-8d7f-8affd8dd88be tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1674 microversion: 2.1 time: 0.214077 Oct 04 22:46:17.691360 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3933/7760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:17 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:18.792005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:18.794342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:18.801512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:18.802009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:18.802460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:18.803206 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:18.803672 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:18.804111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:18.857623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2294d7e7-6acc-4741-a238-4876400d38cb tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action" status: 200 len: 36367 microversion: 2.1 time: 0.069890 Oct 04 22:46:18.858319 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3828/7761] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:18 2022] POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action => generated 36367 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:46:18.870441 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:18.871091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:18.878060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:18.878551 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:18.879018 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:18.879766 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:18.880231 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:18.880664 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:19.117960 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cc2e20d4-07dd-4116-a482-128774677d4a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action" status: 202 len: 0 microversion: 2.1 time: 0.251270 Oct 04 22:46:19.118494 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3934/7762] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:18 2022] POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:46:19.128592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:19.129312 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:19.137292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:19.137774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:19.138222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:19.138962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:19.139434 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:19.139918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:19.311780 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:19.320042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bc2c6cf1-ad78-48bf-bdea-afaca58a4166 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1680 microversion: 2.1 time: 0.196047 Oct 04 22:46:19.320637 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3829/7763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:19 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:20.345634 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:20.346334 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:20.352659 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:20.353251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:20.353694 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:20.354482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:20.354873 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:20.355297 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:20.500077 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:20.508712 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0430d119-d0e6-4e26-b508-d38a75c5ee92 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1680 microversion: 2.1 time: 0.168265 Oct 04 22:46:20.509324 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3935/7764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:20 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:21.533342 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:21.533993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:21.541145 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:21.541649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:21.542085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:21.542838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:21.543310 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:21.543743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:21.685183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:21.693422 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1bdb0c3-ddf0-4731-bbf2-996aae38a077 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1683 microversion: 2.1 time: 0.163962 Oct 04 22:46:21.694016 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3830/7765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:21 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:21.796574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:21.798913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:21.810611 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:21.850503 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5636094f-5959-43fc-9dec-387413c1962e tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action" status: 200 len: 36367 microversion: 2.1 time: 0.057730 Oct 04 22:46:21.851222 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3936/7766] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:46:21 2022] POST /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471/action => generated 36367 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 22:46:23.346912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:23.347526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb8344d-8b95-4176-b58e-d0721dd74471", "tag": "bfc8787f-7b50-4224-8a6e-8e75b76f15f7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:23.347895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:23.355323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:23.355819 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:23.356267 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:23.356989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:23.357482 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:23.357916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:23.359387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:23.359875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:23.360855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:23.373935 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] Creating event network-changed:bfc8787f-7b50-4224-8a6e-8e75b76f15f7 for instance 9fb8344d-8b95-4176-b58e-d0721dd74471 on n-h2-851029-13 Oct 04 22:46:23.379321 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a0be3a28-36a7-4788-9116-b68d2b588a8d req-3f5d0584-88ce-475d-a55c-0b4d329d5625 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Oct 04 22:46:23.380166 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3937/7767] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:23.388375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:46:23.791926 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f1e416e-deb8-41b1-83f7-7e36a01ddc02 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 204 len: 0 microversion: 2.1 time: 0.449217 Oct 04 22:46:23.792726 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3831/7768] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:46:23 2022] DELETE /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:46:23.801764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:23.802491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:23.809947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:23.818005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:23.818005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:23.818005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:23.818005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:23.818005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:23.973016 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:23.981449 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f52dfa8-22f6-48d1-ab89-049e35970d70 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1689 microversion: 2.1 time: 0.183968 Oct 04 22:46:23.981973 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3938/7769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:23 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:25.008593 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:25.010343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:25.017429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:25.017924 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:25.018369 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:25.019136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:25.019627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:25.020095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:25.212524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:25.220647 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-460542c5-57ec-4c60-bbac-d2e66d600e07 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1689 microversion: 2.1 time: 0.216470 Oct 04 22:46:25.221287 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3832/7770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:25 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:25.997188 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8344d-8b95-4176-b58e-d0721dd74471", "name": "network-vif-deleted", "tag": "bfc8787f-7b50-4224-8a6e-8e75b76f15f7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:26.009970 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:26.010486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:26.010947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:26.022771 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] Creating event network-vif-deleted:bfc8787f-7b50-4224-8a6e-8e75b76f15f7 for instance 9fb8344d-8b95-4176-b58e-d0721dd74471 on n-h2-851029-13 Oct 04 22:46:26.028472 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6c1b0e00-73c7-41ce-b35e-a66481721a9e req-55eac16c-1c24-485c-9909-0a7520e19b87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038679 Oct 04 22:46:26.029084 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3939/7771] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:26.245547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:26.246351 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:26.253274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:26.253982 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:26.254456 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:26.255231 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:26.255827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:26.256242 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:26.333172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2050bdc49a7450ea712b0f31f637dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a9af8ecc54b789da81391bb358260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:26.341809 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef31c710-ba90-4dc4-9e22-01733eefde99 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 200 len: 1351 microversion: 2.1 time: 0.100807 Oct 04 22:46:26.342573 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3833/7772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:26 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:27.365892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:27.366595 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] [instance: 9fb8344d-8b95-4176-b58e-d0721dd74471] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:27.373764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:27.374252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:27.374716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:27.375420 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:27.375878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:27.376306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:27.391238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] HTTP exception thrown: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Request method failure captured: Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 HTTP/1.1 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLVX1Dc8FB_KBKVSHTiMa3Z4UcEenYGjiRlVBlGiDMZcseAaf6r_792XDIyR5ic2GX7e0b-NRl7a1F4UWGsd8LUXGAYa8rlbkf5n64BVJyHd84U5w27A7KBd0t4bQWeU6yx_py0smCyLITJVsIk56DEr2f3jhKOE84gsaz_TxjkVLgA Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c46a9af8ecc54b789da81391bb358260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c46a9af8ecc54b789da81391bb358260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: c46a9af8ecc54b789da81391bb358260 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2118661396 Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: a2050bdc49a7450ea712b0f31f637dca Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2118661396-project Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '9fb8344d-8b95-4176-b58e-d0721dd74471'} Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:46:27.392894 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Returning 404 to user: Instance 9fb8344d-8b95-4176-b58e-d0721dd74471 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9fc531a9-4872-4e4f-8f1f-d584ffab6669 tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471" status: 404 len: 111 microversion: 2.1 time: 0.032763 Oct 04 22:46:27.397723 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3940/7773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:27 2022] GET /compute/v2.1/servers/9fb8344d-8b95-4176-b58e-d0721dd74471 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:46:31.130965 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-681d5a85-5f4b-47c4-bf3a-58c3676c5b8a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] Calling method '.version_select at 0x7f54f6001ee0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:31.257707 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-681d5a85-5f4b-47c4-bf3a-58c3676c5b8a tempest-TestNetworkAdvancedServerOps-2118661396 tempest-TestNetworkAdvancedServerOps-2118661396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-778473643" status: 202 len: 0 microversion: 2.1 time: 0.131064 Oct 04 22:46:31.258217 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3834/7774] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 4 22:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-778473643 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:46:47.963701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=18 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:47.964846 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:48.165241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-993fecc3-0fda-4560-8d25-56e3307ed0c5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'create', calling method: .version_select at 0x7f54fa4d5280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1022190403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6JDPIx8Ip2o6MwWk8s9s2xbW7o9Bzg0Sv/mP0vGuVPmM2vow5NS0G5dv5iBBXI7AoB+IG/1wZ+xL7L3mgYBKrft9kBmKYh8H2/LmvL8ur9BeNgn0WjNXa/TMMneStQGg=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:48.181122 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-993fecc3-0fda-4560-8d25-56e3307ed0c5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for project 445d5e66aff147509d3420fe603311e5. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:46:48.187953 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-993fecc3-0fda-4560-8d25-56e3307ed0c5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for user d4165f92e6374dde923e0f9c47483e2a and project 445d5e66aff147509d3420fe603311e5. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:46:48.341349 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-993fecc3-0fda-4560-8d25-56e3307ed0c5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.383445 Oct 04 22:46:48.341969 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3941/7775] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:46:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:51.552956 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:51.553854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:46:51.557859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2041327880", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1022190403", "security_groups": [{"name": "tempest-secgroup-smoke-2143626047"}], "networks": [{"uuid": "c72b6d90-7345-4a06-b8d1-ba171bd2cd83"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:51.666518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] validate_networks() for [('c72b6d90-7345-4a06-b8d1-ba171bd2cd83', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:46:52.083642 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:46:52.084078 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:46:52.084565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:46:52.084990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:46:52.085418 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:46:52.094876 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:52.095372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:52.095822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:52.096575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:52.097034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:52.097473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:52.115501 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for project 445d5e66aff147509d3420fe603311e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:46:52.121570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for user d4165f92e6374dde923e0f9c47483e2a and project 445d5e66aff147509d3420fe603311e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:46:52.134990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:46:52.137329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:46:52.266092 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81fe3555-1160-4b19-8efc-4684ef3fc5ca tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714674 Oct 04 22:46:52.266966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3835/7776] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:46:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:46:52.286091 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1de02890-b8ac-4fb6-baec-c2a586ed9c07 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:52.286993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1de02890-b8ac-4fb6-baec-c2a586ed9c07 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:52.347518 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-1de02890-b8ac-4fb6-baec-c2a586ed9c07 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:52.355949 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1de02890-b8ac-4fb6-baec-c2a586ed9c07 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1247 microversion: 2.1 time: 0.081709 Oct 04 22:46:52.356686 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3942/7777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:52 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:53.379272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3db7c502-cbf7-4025-8ec5-c3be07103f08 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:53.379895 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3db7c502-cbf7-4025-8ec5-c3be07103f08 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:53.435330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3db7c502-cbf7-4025-8ec5-c3be07103f08 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:53.443109 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3db7c502-cbf7-4025-8ec5-c3be07103f08 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1247 microversion: 2.1 time: 0.067682 Oct 04 22:46:53.443719 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3836/7778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:53 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:54.468170 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:54.468712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:54.476276 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:54.476815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:54.477252 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:54.477946 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:54.478401 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:54.478856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:54.551564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:54.559486 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf693e7a-ec3e-40d4-98f7-43096aa08c4b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1299 microversion: 2.1 time: 0.096190 Oct 04 22:46:54.560286 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3943/7779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:54 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:55.583319 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:55.584092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:55.594850 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:55.595473 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:55.596064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:55.596943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:55.597480 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:55.597998 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:55.745219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:55.753623 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-821bacda-8493-4e5d-91b9-639adda2590d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.174126 Oct 04 22:46:55.754229 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3837/7780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:55 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:56.757756 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:46:56.768751 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:56.769243 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:56.769679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:56.777669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:56.779194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:56.786125 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] Creating event network-changed:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h1-851029-13 Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:56.805290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:56.806351 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-ca83f2ba-e7de-4438-8eb5-6a502011a489 req-8dec542b-27a2-4bd0-93c6-149a373afa48 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038607 Oct 04 22:46:56.806351 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3944/7781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:46:56.947368 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:56.956015 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e2ce553-fcd3-4ae6-ae5e-4ed65dfc38e7 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.183108 Oct 04 22:46:56.956608 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3838/7782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:56 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:46:57.981876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:57.982578 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:57.988782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:57.989265 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:57.989700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:57.990395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:57.990895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:57.991308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:58.128786 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:58.137171 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cad05609-aec4-47ea-ad0d-6b8cf0ef7c8d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.161134 Oct 04 22:46:58.137756 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3945/7783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:57 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:46:59.160384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:46:59.161006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:46:59.168128 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:59.168666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:59.169117 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:59.169863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:46:59.170335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:46:59.170815 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:46:59.301646 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:46:59.309921 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bc9ad425-175d-4d06-8644-99547eb82346 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.153448 Oct 04 22:46:59.310500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3839/7784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:46:59 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:00.334206 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:00.335004 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:00.342519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:00.343108 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:00.343641 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:00.344348 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:00.344801 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:00.345227 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:00.487995 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:00.495813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b90baa5-f9c2-47a5-84c2-69950b13f7ec tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.165601 Oct 04 22:47:00.496384 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3946/7785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:00 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:01.519284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:01.519915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:01.527386 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:01.527886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:01.528336 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:01.529050 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:01.529518 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:01.529958 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:01.669354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:01.679526 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-439796fc-b976-44d0-8b96-0743ed357ab3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.163899 Oct 04 22:47:01.680275 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3840/7786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:01 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:02.497299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:02.557485 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "name": "network-vif-plugged", "status": "completed", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:02.567456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:02.567940 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:02.568377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:02.582902 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] Creating event network-vif-plugged:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h1-851029-13 Oct 04 22:47:02.586634 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-453270ac-16b3-490c-82d6-0f4d56b49b79 req-85e3f677-b481-4425-8190-85c1ca3354cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090866 Oct 04 22:47:02.587822 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3947/7787] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:47:02.700578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:02.705834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:02.706467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:02.713158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:02.713669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:02.714118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:02.715046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:02.715522 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:02.715994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:02.852909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:02.860752 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88cb236b-0bc8-41a0-a9f0-1c5245fa458d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.160945 Oct 04 22:47:02.861333 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3841/7788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:02 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:03.885675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:03.886409 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:03.893941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:03.894421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:03.894884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:03.895586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:03.896034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:03.896458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:04.032213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:04.040831 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97760e03-4704-4558-bc0b-ea358dfeac2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1373 microversion: 2.1 time: 0.159990 Oct 04 22:47:04.041866 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3948/7789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:03 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:05.063461 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:05.064092 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:05.066024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=8 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:47:05.072192 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:05.076957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:05.076957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:05.076957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:05.076957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:05.076957 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:05.208666 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:05.216062 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f1244ae-45c7-4253-96a2-c2028b94f29a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1556 microversion: 2.1 time: 0.156555 Oct 04 22:47:05.216647 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3842/7790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:05 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:05.237919 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:47:05.238564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:47:05.246183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:05.246724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:05.247159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:05.247876 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:05.248329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:05.248755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:05.384905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:47:05.392652 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f5f462e-7a33-4ecc-952c-6b6a34fa5c64 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1556 microversion: 2.1 time: 0.158678 Oct 04 22:47:05.393211 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3949/7791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:47:05 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:47:07.466638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:47:07.481337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:47:07.481863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:47:07.482308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:47:07.494048 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] Creating event network-changed:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h1-851029-13 Oct 04 22:47:07.499460 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1d11bd46-c184-4583-aaa3-5ccbf6cd44a8 req-50b0ecb6-3610-4ac2-b7ac-f14fe59182ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037324 Oct 04 22:47:07.500348 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3843/7792] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:49:34.393555 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:49:34.394573 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:49:34.396013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:34.396794 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=34 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:34.397733 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:49:34.397894 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action (ip 10.222.0.36) !!! Oct 04 22:49:34.399162 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:49:34.399334 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action (ip 10.222.0.36) !!! Oct 04 22:49:34.400235 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:49:34.400387 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action (ip 10.222.0.36) !!! Oct 04 22:49:34.405283 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:34.411606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:34.418181 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:34.418655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:34.419148 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:34.419856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:34.420307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:34.420731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:34.446731 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lazy-loading 'flavor' on Instance uuid 2d36264d-0332-428d-94c9-69bc79f2dcc9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:49:35.228344 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bda086e-79d2-4cae-ab0b-07e6c7abb68c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action" status: 202 len: 0 microversion: 2.1 time: 0.836926 Oct 04 22:49:35.228996 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3950/7793] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:49:34 2022] POST /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:49:35.236262 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:49:35.237244 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:49:35.237979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:35.238857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:49:35.240400 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:49:35.240556 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 (ip 10.222.0.36) !!! Oct 04 22:49:35.242239 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:49:35.242352 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 (ip 10.222.0.36) !!! Oct 04 22:49:35.249872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:35.250633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:35.266170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:35.268497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:35.268497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:35.268497 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:35.269072 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:35.269516 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:35.483739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:35.492808 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2fab6166-3073-4e17-94bf-9c0f6e6af798 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.258731 Oct 04 22:49:35.493419 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3844/7794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:35 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:36.518500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:36.519244 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:36.528524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:36.529002 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:36.529450 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:36.530165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:36.530623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:36.531088 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:36.536242 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51090. Oct 04 22:49:36.539454 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51088. Oct 04 22:49:36.685955 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:36.694743 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b8f57f9-d3da-439b-b7d7-b31e5e583056 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.181770 Oct 04 22:49:36.695482 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3951/7795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:36 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:37.720339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:37.721191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:37.732264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.732953 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.733537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.734422 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:37.734972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:37.735539 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:37.765033 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51096. Oct 04 22:49:37.765931 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51094. Oct 04 22:49:37.893228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:37.903368 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59623039-dd86-4bfe-b345-84340697cfab tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.188426 Oct 04 22:49:37.903980 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3845/7796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:37 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:38.930706 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:38.931472 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:38.938776 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.939298 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.939761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:38.940473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:38.940928 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:38.941352 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:39.082774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:39.090851 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6cd36a7-de61-453d-9fbb-268a52d10c7a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.165312 Oct 04 22:49:39.091471 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3952/7797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:38 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:40.115834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:40.116416 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:40.123597 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:40.124101 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:40.124549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:40.125296 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:40.125762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:40.126196 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:40.266472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:40.274356 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81d74228-71ef-45f6-9322-26bb7b9ba959 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.163080 Oct 04 22:49:40.274959 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3846/7798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:40 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:41.297632 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:41.298248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:41.305400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:41.305885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:41.306327 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:41.307064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:41.307574 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:41.308003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:41.442795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:41.450909 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85228f44-2f1f-4b19-9cdd-29fdbaee3ecb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.157216 Oct 04 22:49:41.451857 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3953/7799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:41 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:42.475449 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:42.476238 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:42.483643 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:42.484676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:42.484676 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:42.485277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:42.485776 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:42.486273 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:42.636123 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:42.643874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7eafe20-d3b2-432d-b5c4-56c722ddc2c4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.172497 Oct 04 22:49:42.644451 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3847/7800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:42 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:43.667713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:43.668790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:43.675545 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:43.676030 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:43.676463 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:43.677175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:43.677629 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:43.678053 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:43.821885 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:43.830443 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dd2eb219-1773-4510-8c1f-9d9830b15b83 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.166801 Oct 04 22:49:43.831123 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3954/7801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:43 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:49:44.853627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:44.854147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:44.861325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:44.861783 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:44.862280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:44.863054 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:44.864059 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:44.864490 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:45.004496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:45.012899 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebb613e2-1864-4391-9644-b9286ff654e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.163262 Oct 04 22:49:45.013486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3848/7802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:44 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:46.036905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:46.037532 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:46.045064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:46.045560 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:46.045997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:46.046737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:46.047203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:46.047630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:46.187872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:46.196524 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8213be5d-9580-4e47-b08a-c97b4b4d739d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.163514 Oct 04 22:49:46.197132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3955/7803] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:46 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:47.221094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:47.221923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:47.230171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:47.232175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:47.232175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:47.232175 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:47.234135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:47.234135 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:47.373343 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:47.383660 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1cf4b1b9-f21b-4822-b44c-70155d0d3a7f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.166648 Oct 04 22:49:47.384715 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3849/7804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:47 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:48.407991 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:48.408615 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:48.415858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:48.416361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:48.416800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:48.417557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:48.418015 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:48.418439 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:48.579886 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:48.588401 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d3a3163-d576-48f7-a595-e07dcf527469 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.184978 Oct 04 22:49:48.589014 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3956/7805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:48 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:49.614098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:49.614743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:49.621583 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:49.622074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:49.622546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:49.623347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:49.623810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:49.624244 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:49.758074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:49.767239 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab90f2eb-8dcb-42a7-b151-25fcee21cb19 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.156758 Oct 04 22:49:49.768111 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3850/7806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:49 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:50.791653 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:50.792271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:50.799172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:50.799651 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:50.800101 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:50.800807 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:50.801260 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:50.801726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:50.941506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:50.949723 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e8504e94-6506-467e-b1fa-0562619bfe70 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.161950 Oct 04 22:49:50.950297 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3957/7807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:50 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:51.973499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:51.974028 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:51.980934 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:51.982268 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:51.983095 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:51.983818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:51.984289 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:51.984725 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:52.121721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:52.129606 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f76bde4-2fb6-4b4f-b426-30b58c3c72b5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1701 microversion: 2.1 time: 0.160075 Oct 04 22:49:52.130207 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3851/7808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:51 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:53.153627 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:53.154134 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:53.161708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.162187 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.162621 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.163332 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:53.163777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:53.164209 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:53.305695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:53.313803 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eba8a471-9b67-4505-90ff-713fd2a2596c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1701 microversion: 2.1 time: 0.164165 Oct 04 22:49:53.314389 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3958/7809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:53 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:54.339034 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:54.339660 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:54.346568 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.347093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.348121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:54.348824 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:54.349290 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:54.349728 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:54.486176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:54.494572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93acd20f-3e25-4b59-887d-92ff660a333a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1701 microversion: 2.1 time: 0.159471 Oct 04 22:49:54.495185 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3852/7810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:54 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:55.385579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "name": "network-vif-plugged", "status": "completed", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:49:55.396908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.397370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.397803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.409213 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] Creating event network-vif-plugged:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h1-851029-13 Oct 04 22:49:55.415204 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-763c2e55-643d-4ed3-92bc-8c697ce9d7c2 req-b0f7675b-2d35-4363-ab0b-7b573d60ca02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Oct 04 22:49:55.415798 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3959/7811] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:49:55.518541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:55.519207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:55.525867 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.526364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.526856 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.527603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:55.528071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:55.528538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:55.662828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:55.670626 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75a97de4-3113-4887-9df5-12aedcfeafe0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1701 microversion: 2.1 time: 0.156948 Oct 04 22:49:55.671239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3853/7812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:55 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:56.696127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:56.696838 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:56.703459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.703950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.704396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.705095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:56.705555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:56.705987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:56.851889 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:56.861238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d85f9def-dcd6-4854-9e2a-6b7832c3ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.170524 Oct 04 22:49:56.861843 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3960/7813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:56 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:57.886993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:57.888677 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:57.896718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:57.897493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:57.898120 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:57.899207 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:57.899863 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:57.900314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:58.075896 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:58.086698 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61db28c9-a0fd-4d24-9782-f2e85c8fb33d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.204363 Oct 04 22:49:58.102765 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3854/7814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:57 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:49:59.114774 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:49:59.115400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:49:59.122933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.123425 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.123900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.124609 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:49:59.125099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:49:59.125536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:49:59.269585 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:49:59.278400 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c619b10-6c11-431b-9adc-6b98a1c2c68d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.168409 Oct 04 22:49:59.279194 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3961/7815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:49:59 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:00.301546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:00.302177 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:00.309546 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.310069 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.310562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.311555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:00.311713 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:00.312148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:00.476712 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:00.484988 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2895ea1-9270-4273-830c-d51b77e81afb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.187386 Oct 04 22:50:00.492071 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3855/7816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:00 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:01.508904 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:01.510308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:01.517780 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.518362 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.520475 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.521273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:01.521823 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:01.522329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:01.669678 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:01.679137 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f0e604d-3ab6-41b4-a5a1-cc930f611c05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.173963 Oct 04 22:50:01.692762 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3962/7817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:01 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:02.702246 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:02.703204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:02.711088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.711708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.712168 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:02.712973 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:02.713493 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:02.713967 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:02.872629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:02.885801 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fffc0f3b-05fd-4208-b06d-a6289996e62c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.186684 Oct 04 22:50:02.885801 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3856/7818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:02 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:03.909698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:03.910363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:03.917879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:03.918365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:03.918839 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:03.919792 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:03.920437 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:03.921050 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:04.069482 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:04.082498 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be460ce7-ec36-413b-bb2c-4da0ce59be84 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.177646 Oct 04 22:50:04.086770 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3963/7819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:03 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:05.110191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:05.111664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:05.120136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:05.121027 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:05.121878 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:05.122912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:05.123634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:05.124300 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:05.276106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:05.284184 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab7046c8-50d9-494d-b8cb-acd6b87b710f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.180537 Oct 04 22:50:05.285124 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3857/7820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:05 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:06.312320 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:06.312998 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:06.315255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=29 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:06.320299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:06.320784 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:06.321225 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:06.321933 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:06.322374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:06.322895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:06.327294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:06.562769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:06.562769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07132d57-3f33-497c-9e27-c53e29ad63cd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.173702 Oct 04 22:50:06.562769 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3964/7821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:06 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:07.584883 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:07.585513 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:07.588271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=29 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:07.593023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:07.593517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:07.593966 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:07.594682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:07.595156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:07.595596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:07.598881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=85 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:50:07.735033 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:07.743160 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9d2766e-06aa-4f7a-9089-20d8d7bd9d05 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.162529 Oct 04 22:50:07.743751 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3858/7822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:07 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:08.766702 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:08.767311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:08.774997 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:08.775481 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:08.776003 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:08.776613 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:08.777076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:08.777503 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:08.911708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:08.919640 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5bf3ff4-115c-4654-bb9a-9bff220d2e68 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1696 microversion: 2.1 time: 0.157980 Oct 04 22:50:08.920214 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3965/7823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:08 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:09.943265 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:09.943886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:09.950616 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:09.951170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:09.951630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:09.952347 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:09.953090 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:09.953537 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:10.087306 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:10.095042 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f12e39d5-d2b6-476f-bf1e-58f00d7a967a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1678 microversion: 2.1 time: 0.156686 Oct 04 22:50:10.095639 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3859/7824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:09 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:11.118906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:11.119516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:11.126673 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:11.127155 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:11.127591 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:11.128816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:11.129271 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:11.129691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:11.268323 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:11.276813 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ce9f9d1-16b1-4afb-8f37-82af2993cb1d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1678 microversion: 2.1 time: 0.161893 Oct 04 22:50:11.277818 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3966/7825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:11 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:12.300664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:12.301293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:12.308187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.308683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.309133 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.309838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.310307 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.310773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.442171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:12.450361 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86fa4bad-0f77-4f9a-bd47-707b17761045 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1621 microversion: 2.1 time: 0.153549 Oct 04 22:50:12.454797 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3860/7826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:12 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:12.473719 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:12.474452 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:12.481610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.482097 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.482537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.483263 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.483716 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.484146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.526135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123541) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:50:12.821248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d35296d-2a8c-4311-8d0a-a13abd84ed1f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action" status: 202 len: 0 microversion: 2.1 time: 0.351523 Oct 04 22:50:12.821883 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3967/7827] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:50:12 2022] POST /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:50:12.830530 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:12.831699 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:12.837993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.838565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.839143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.839871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:12.840280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:12.840715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:12.979508 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:12.988002 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a0a4be8-c633-4b11-afb1-b90fefabdc2e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1629 microversion: 2.1 time: 0.161681 Oct 04 22:50:12.988591 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3861/7828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:12 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1629 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:13.433435 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "name": "network-vif-unplugged", "status": "completed", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:13.443146 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:13.449321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:13.449321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:13.456299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_external_events [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] Unable to find a host for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9. Dropping event network-vif-unplugged {{(pid=123541) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:50:13.457200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-60e1894b-7bf1-4bb7-86fa-968d851b80d8 req-f1917fe9-9fa7-416b-9dec-0ba2eac54099 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027998 Oct 04 22:50:13.457803 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3968/7829] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:50:14.011830 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:14.012696 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:14.020979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:14.021558 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:14.022338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:14.023170 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:14.023649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:14.024094 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:14.160679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:14.168810 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77cfda6c-75f0-4f50-9217-936653327025 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1629 microversion: 2.1 time: 0.161258 Oct 04 22:50:14.169392 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3862/7830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:14 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1629 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:15.193721 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:15.194365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:15.201676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:15.202312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:15.203166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:15.204083 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:15.204663 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:15.205241 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:15.345735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:15.354305 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3207e72d-97f3-4353-ada7-c136f4ef9869 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1629 microversion: 2.1 time: 0.165167 Oct 04 22:50:15.354952 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3969/7831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:15 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1629 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:16.377297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:16.378001 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:16.385275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:16.392570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:16.392570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:16.392570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:16.392570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:16.392570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:16.529405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:16.538201 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68edf783-8f59-4d3c-9206-590a20e4d482 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1629 microversion: 2.1 time: 0.164792 Oct 04 22:50:16.538836 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3863/7832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:16 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1629 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:17.562733 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:17.563284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:17.570932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:17.571519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:17.571858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:17.572564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:17.573022 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:17.573447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:17.712080 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:17.720888 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a56f998-3c44-44a5-90ab-4889ca7741e4 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1629 microversion: 2.1 time: 0.162804 Oct 04 22:50:17.722054 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3970/7833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:17 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1629 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:18.745662 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:18.746424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:18.754148 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:18.754641 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:18.755113 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:18.755825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:18.756297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:18.756774 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:18.894708 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:18.902616 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93d1cdcd-e32d-45c7-90b8-b9085740f8e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.161070 Oct 04 22:50:18.903301 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3864/7834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:18 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:19.927160 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:19.927777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:19.934748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:19.935232 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:19.935666 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:19.936363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:19.936814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:19.937239 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:20.073617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:20.082829 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13568746-3145-4623-b752-352db1ad217d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.159640 Oct 04 22:50:20.083422 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3971/7835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:19 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:20.162605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:20.173420 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:20.173918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:20.174367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:20.189938 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] Creating event network-changed:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h2-851029-13 Oct 04 22:50:20.197061 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-11719169-3791-4468-8a72-495fde56047c req-adc5f519-0d7f-4671-b626-ef0fd328f7b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110155 Oct 04 22:50:20.197694 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3865/7836] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:21.107196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:21.107816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:21.116775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:21.117139 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:21.117770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:21.118700 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:21.119356 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:21.119785 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:21.752011 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:21.761755 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0898431-0e66-437c-b6c0-1408bb9f2feb tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.658471 Oct 04 22:50:21.762361 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3972/7837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:21 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:22.792655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:22.793377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:22.801171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:22.801678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:22.802119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:22.802864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:22.803331 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:22.803765 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:22.953375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:22.962373 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4c50b34-d968-4dc2-b8de-709ad740da23 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.174180 Oct 04 22:50:22.963606 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3866/7838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:22 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:23.985860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:23.986557 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:23.994259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:23.995172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:23.995676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:23.996465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:23.996992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:23.997490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:24.144361 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:24.153327 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83996651-3a6f-41b1-9088-7b6b2d46f50b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.171278 Oct 04 22:50:24.153928 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3973/7839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:23 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:25.178217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:25.179208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:25.186626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:25.187217 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:25.187674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:25.188407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:25.188906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:25.189380 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:25.334805 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:25.343314 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8112d11f-1ae4-44e2-bc86-c09bb81d8a89 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.168988 Oct 04 22:50:25.343916 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3867/7840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:25 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:26.368349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:26.370443 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:26.377586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:26.378066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:26.378504 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:26.379328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:26.379828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:26.380255 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:26.563205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:26.576769 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7824ec5e-7cb7-4e23-b493-fb4a1beea837 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.212445 Oct 04 22:50:26.577685 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3974/7841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:26 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:27.603098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:27.603864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:27.610540 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:27.611061 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:27.611511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:27.612270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:27.612744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:27.613184 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:27.774441 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:27.782966 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-279c4572-264f-459d-970f-8f337cf8c8f2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.184574 Oct 04 22:50:27.793486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3868/7842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:27 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:28.808847 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:28.809618 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:28.817567 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:28.818074 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:28.818521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:28.819305 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:28.820017 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:28.820455 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:28.959096 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:28.967128 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe234294-c20b-4faa-a03d-a49ec08a39f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.162407 Oct 04 22:50:28.967712 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3975/7843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:28 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:29.992227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:29.992812 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:29.999698 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:30.000189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:30.000630 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:30.001329 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:30.001793 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:30.002227 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:30.134680 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:30.142415 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23453ef0-4c9d-45b2-a317-a2e2a0a71f3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.154232 Oct 04 22:50:30.143031 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3869/7844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:29 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:31.166086 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:31.166724 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:31.173714 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:31.174849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:31.175295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:31.175999 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:31.176490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:31.176921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:31.312269 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:31.321537 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c43c914d-8b5a-4b5f-a6cb-018d462e2412 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.159361 Oct 04 22:50:31.322437 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3976/7845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:31 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:32.346761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:32.347318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:32.354375 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:32.354909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:32.355358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:32.356066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:32.356535 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:32.356974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:32.496521 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:32.504762 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4294249-c143-417f-b9f3-d1a7b70245db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.162659 Oct 04 22:50:32.505354 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3870/7846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:32 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:33.417781 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "name": "network-vif-plugged", "status": "completed", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:50:33.422309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.422812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.423289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.435102 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] Creating event network-vif-plugged:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h2-851029-13 Oct 04 22:50:33.440535 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a48d52d7-e1c5-4289-8167-6448f8960586 req-f2963d64-56b8-4978-9e98-3a08245e1d47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Oct 04 22:50:33.441165 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3977/7847] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:50:33.528621 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:33.529565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:33.537664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.538803 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.539292 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.540013 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:33.540868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:33.541309 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:33.732052 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:33.740690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f96f6145-2f2b-4fdd-9512-5e0431219066 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.216103 Oct 04 22:50:33.741298 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3871/7848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:33 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:34.766105 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:34.766855 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:34.773248 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:34.773736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:34.774259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:34.774975 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:34.775429 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:34.775850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:34.917909 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:34.926805 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0ace962-a9b0-4bcb-9c8c-5f2877f8efbd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.165938 Oct 04 22:50:34.927709 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3978/7849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:34 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:35.949736 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:35.950356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:35.958298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.958822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.959270 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:35.960022 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:35.960486 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:35.960923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:36.105334 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:36.113530 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa2aa7ed-6b21-4272-840b-15bb5d6e233d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1687 microversion: 2.1 time: 0.167905 Oct 04 22:50:36.114105 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3872/7850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:35 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:50:37.136927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:50:37.137516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:50:37.144226 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:37.144771 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:37.145230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:37.146457 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:50:37.146950 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:50:37.147377 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:50:37.278310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:50:37.286772 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef79b340-9811-4f60-85c4-65a85a6efa17 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1674 microversion: 2.1 time: 0.153877 Oct 04 22:50:37.287364 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3979/7851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:50:37 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:48.868943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:48.869628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:48.869999 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:48.870796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:48.873754 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=29 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:48.874479 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=85 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:51:48.875533 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:51:48.875671 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 (ip 10.222.0.36) !!! Oct 04 22:51:48.875755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:48.887171 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:48.887669 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:48.887943 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:48.888135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:48.888575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:48.889159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:48.890467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:48.891035 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:48.891718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:48.901934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] Creating event network-changed:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h2-851029-13 Oct 04 22:51:48.908461 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6cb3de7d-f238-4182-9572-87f1eba4ca0a req-b889ea64-b97e-44f9-bf71-e3795b6436b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041015 Oct 04 22:51:48.909380 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3980/7852] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:48.926395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:51:49.399741 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4737483c-4231-438a-9139-9e3f4ef01a8a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 204 len: 0 microversion: 2.1 time: 0.535023 Oct 04 22:51:49.400583 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3873/7853] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:51:48 2022] DELETE /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:51:49.411459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:49.412675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:49.419195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:49.419795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:49.420312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:49.421131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:49.421812 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:49.422465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:49.585236 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:49.593913 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db5e53b6-3af2-4cbc-a39d-d5aaa15e0b9f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1680 microversion: 2.1 time: 0.187122 Oct 04 22:51:49.594796 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3981/7854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:49 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:50.620692 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:50.621464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:50.629436 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:50.629930 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:50.630378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:50.631121 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:50.631589 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:50.632081 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:50.868827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:50.877920 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfb69f43-3922-4962-97cc-b9102b617b7d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1562 microversion: 2.1 time: 0.261614 Oct 04 22:51:50.878516 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3874/7855] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:50 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:51.428917 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d36264d-0332-428d-94c9-69bc79f2dcc9", "name": "network-vif-deleted", "tag": "e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:51.440992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.441478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.441906 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.455067 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] Creating event network-vif-deleted:e513c9cb-b249-4aa0-8ecc-2ad7ffdebfcc for instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 on n-h2-851029-13 Oct 04 22:51:51.460208 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b76c561f-0bc5-456c-8b1c-2b6ee9317492 req-dceae30d-a4fd-41f1-b06c-f14e48b15a57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035361 Oct 04 22:51:51.463227 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3982/7856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:51:51.901612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:51.902236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:51.909171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.909664 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.910114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.910917 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.911384 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.911822 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.945695 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:51.946202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:51.946679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:51.947156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lazy-loading 'fault' on Instance uuid 2d36264d-0332-428d-94c9-69bc79f2dcc9 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:51:51.990407 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:51:52.002358 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa8d3241-2071-485f-8c25-7647d1b58213 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 200 len: 1337 microversion: 2.1 time: 0.104680 Oct 04 22:51:52.002985 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3875/7857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:51 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:51:53.027039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:53.027746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 2d36264d-0332-428d-94c9-69bc79f2dcc9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:51:53.034114 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:53.034601 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:53.035068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:53.035758 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:51:53.036217 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:51:53.036646 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:51:53.050613 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] HTTP exception thrown: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Request method failure captured: Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 HTTP/1.1 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLfQ5RU42lCxBlGPcWr61wP-4h8Ae8-AnxrH0UFm0rykj39xSeD9qqk-ttvMOYCqkjLgRPBjXuyK03c4uBTb2Riz1kn0B2MT37fAmULz1Xp71gdHTlx3OryUcJ5YG-4xQA4RHUaAcx1PhUp9zPeevPP-UaX9bptAy6CIDUKngw7Uh_g Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: 445d5e66aff147509d3420fe603311e5 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestShelveInstance-1378955456 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/445d5e66aff147509d3420fe603311e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/445d5e66aff147509d3420fe603311e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/445d5e66aff147509d3420fe603311e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_445d5e66aff147509d3420fe603311e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestShelveInstance-1378955456 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: 445d5e66aff147509d3420fe603311e5 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestShelveInstance-1378955456 Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestShelveInstance-1378955456-project Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: d4165f92e6374dde923e0f9c47483e2a Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestShelveInstance-1378955456-project Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '2d36264d-0332-428d-94c9-69bc79f2dcc9'} Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:51:53.052318 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Returning 404 to user: Instance 2d36264d-0332-428d-94c9-69bc79f2dcc9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03ba6de2-d518-4c9e-bc08-a825147c7584 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9" status: 404 len: 111 microversion: 2.1 time: 0.031897 Oct 04 22:51:53.056594 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3983/7858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:51:53 2022] GET /compute/v2.1/servers/2d36264d-0332-428d-94c9-69bc79f2dcc9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:51:53.307510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70240d9a-d773-4992-9b6d-9dbc34935c5f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '.version_select at 0x7f54fa5a05e0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:51:53.463415 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70240d9a-d773-4992-9b6d-9dbc34935c5f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022190403" status: 202 len: 0 microversion: 2.1 time: 0.159963 Oct 04 22:51:53.464021 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3876/7859] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 22:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022190403 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:51:53.495169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-044a4722-a31e-4061-8719-ef229bcfe5e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'create', calling method: .version_select at 0x7f54f56cbe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1076992941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWgkWStKS9cHruq37rSLyRR/q58anPN3sIbc2vrEPG+o6XWUt4+F436AJqCgndTgYVUtZrdYpg3iognlu087CqCaF5Tp+5mk6ZY8guHJgpM+aRlqE2ZSdh2WLE5n/didQ=="}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:51:53.511428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-044a4722-a31e-4061-8719-ef229bcfe5e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for project 445d5e66aff147509d3420fe603311e5. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:51:53.518212 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-044a4722-a31e-4061-8719-ef229bcfe5e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for user d4165f92e6374dde923e0f9c47483e2a and project 445d5e66aff147509d3420fe603311e5. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:51:53.641035 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-044a4722-a31e-4061-8719-ef229bcfe5e3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.149651 Oct 04 22:51:53.641817 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3984/7860] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:51:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:52:20.234315 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:20.235115 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:20.239792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1424753035", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1076992941", "security_groups": [{"name": "tempest-secgroup-smoke-1514990470"}], "networks": [{"uuid": "c72b6d90-7345-4a06-b8d1-ba171bd2cd83"}], "block_device_mapping_v2": [{"uuid": "367069a7-af07-4ed9-882d-d4b0d30dca1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:52:20.355719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] validate_networks() for [('c72b6d90-7345-4a06-b8d1-ba171bd2cd83', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:52:20.784006 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:52:20.784469 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:52:20.784962 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:52:20.785438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:52:20.785868 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:52:20.795669 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:20.796100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:20.796550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:20.797305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:20.797778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:20.798216 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:20.816187 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for project 445d5e66aff147509d3420fe603311e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:52:20.821726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Getting quotas for user d4165f92e6374dde923e0f9c47483e2a and project 445d5e66aff147509d3420fe603311e5. Resources: {'instances', 'ram', 'cores'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:52:20.881778 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:52:20.884130 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='367069a7-af07-4ed9-882d-d4b0d30dca1f',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:52:21.496451 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c02b80a3-fde9-49fa-b9ba-ebf927fca5e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.264720 Oct 04 22:52:21.497966 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3877/7861] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:52:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:52:21.509205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8906f6b7-11db-46dc-afda-862f39d71554 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:21.510640 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8906f6b7-11db-46dc-afda-862f39d71554 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:21.512131 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=12 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:21.512849 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=4 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:21.513432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:21.572954 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-8906f6b7-11db-46dc-afda-862f39d71554 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:21.581934 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8906f6b7-11db-46dc-afda-862f39d71554 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1089 microversion: 2.1 time: 0.076975 Oct 04 22:52:21.582736 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3985/7862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:21 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:22.605909 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:22.606562 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:22.612764 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:22.613266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:22.616707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:22.616707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:22.616707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:22.616707 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:22.678722 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:22.686771 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-763b347f-5377-47ce-8536-90dd34badda1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1139 microversion: 2.1 time: 0.085687 Oct 04 22:52:22.687422 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3878/7863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:22 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:23.711319 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:23.712038 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:23.719809 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:23.720286 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:23.720718 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:23.721412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:23.721875 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:23.722290 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:23.796675 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:23.796675 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f915d922-7088-454e-ac24-cdfbb95a1d85 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1195 microversion: 2.1 time: 0.088062 Oct 04 22:52:23.796675 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3986/7864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:23 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:24.819025 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:24.819757 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:24.827735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:24.828367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:24.829156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:24.829972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:24.830624 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:24.831255 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:24.979284 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:24.990159 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-831300bc-e395-4c6b-a50d-57575e54575f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1273 microversion: 2.1 time: 0.174661 Oct 04 22:52:25.000027 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3879/7865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:24 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:25.835602 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:52:25.846049 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:25.846535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:25.847005 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:25.859955 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] Creating event network-changed:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h1-851029-13 Oct 04 22:52:25.865053 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b445c215-29ad-4268-9802-c2372ec0256e req-9c919503-2285-4c18-9795-c227a78820ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099156 Oct 04 22:52:25.869327 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3987/7866] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:52:26.013636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:26.014280 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:26.021139 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:26.021638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:26.022088 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:26.022836 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:26.023298 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:26.023734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:26.167840 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:26.176604 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a9fc1fba-99e8-43b8-92e1-85a0348a63ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1273 microversion: 2.1 time: 0.166863 Oct 04 22:52:26.177311 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3880/7867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:26 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:27.201748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:27.202444 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:27.209045 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:27.209491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:27.209925 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:27.210612 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:27.211094 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:27.211513 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:27.346548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:27.354872 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dde22295-d9e4-40c2-b049-53ea66371d3f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1273 microversion: 2.1 time: 0.158184 Oct 04 22:52:27.355462 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3988/7868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:27 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:28.378902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:28.379457 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:28.388197 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:28.389314 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:28.389761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:28.390478 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:28.390970 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:28.391406 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:28.528854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:28.536693 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d713041-7b1e-49d6-b5d2-85be3e2a93b3 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1273 microversion: 2.1 time: 0.161943 Oct 04 22:52:28.537328 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3881/7869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:28 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:29.559588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:29.560367 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:29.567941 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:29.568459 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:29.568901 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:29.569688 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:29.570310 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:29.570872 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:29.704841 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:29.712648 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa4f4a91-fd1f-46c3-abd5-07b7aeba3338 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1273 microversion: 2.1 time: 0.157085 Oct 04 22:52:29.713351 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3989/7870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:29 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:30.735871 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:30.736496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:30.743528 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:30.744024 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:30.744467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:30.745172 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:30.745633 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:30.746109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:30.803446 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:30.832308 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:30.888229 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:30.897091 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30e2dc92-3505-4388-8f63-7fccbd0eee59 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.165850 Oct 04 22:52:30.897664 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3882/7871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:30 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:52:31.920767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:31.921376 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:31.928257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:31.928746 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:31.929190 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:31.929890 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:31.930347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:31.930805 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:32.065247 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:32.073138 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ecbfd1c3-5063-4ac2-be69-955387ccdee8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.156657 Oct 04 22:52:32.073716 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3990/7872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:31 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:33.097487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:33.098152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:33.105545 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:33.106051 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:33.106510 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:33.107792 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:33.108271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:33.108717 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:33.252711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:33.262247 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93a2d0af-15ee-49df-859e-de1a325c7fee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.169165 Oct 04 22:52:33.262877 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3883/7873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:33 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:34.284900 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:34.285521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:34.288365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:52:34.293294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:34.293778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:34.294214 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:34.295044 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:34.295510 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:34.295939 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:34.432207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:34.440565 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9973e7b-376c-4d2f-84fc-b809b023c35e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.159546 Oct 04 22:52:34.441091 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3991/7874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:34 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:35.464249 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:35.464889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:35.472394 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:35.472886 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:35.473330 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:35.474031 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:35.474492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:35.474954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:35.606788 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:35.615114 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8456e8e7-e156-4a24-b366-fb8d2ff9469d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.154746 Oct 04 22:52:35.615687 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3884/7875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:35 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:36.638048 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:36.638763 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:36.645153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:36.645668 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:36.646107 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:36.646859 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:36.647316 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:36.647748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:36.791857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:36.800745 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-80ca8fbf-2654-49d2-8dd6-4a8c54af3b04 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.166880 Oct 04 22:52:36.801328 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3992/7876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:36 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:37.879929 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:37.880679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:37.886992 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:37.887487 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:37.887941 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:37.888678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:37.889149 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:37.889587 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:38.022949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:38.031161 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-511a5bb9-ce40-4458-ae58-fb6a1cf958a2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.155281 Oct 04 22:52:38.031748 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3885/7877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:37 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:39.054915 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:39.055534 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:39.062417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:39.062929 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:39.063371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:39.064060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:39.064508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:39.064932 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:39.201442 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:39.209572 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf153be1-d457-461d-810e-45db67ec49dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.158607 Oct 04 22:52:39.210153 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3993/7878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:39 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:40.232564 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:40.233179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:40.240273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:40.240760 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:40.241203 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:40.241963 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:40.242421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:40.242879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:40.272715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "name": "network-vif-plugged", "status": "completed", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:52:40.283085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:40.284287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:40.284287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:40.295762 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] Creating event network-vif-plugged:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h1-851029-13 Oct 04 22:52:40.300892 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d50e4526-f133-496e-869e-c2b8ed9fe9a1 req-7d6ace9a-baff-46e1-b6bd-61071a546245 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084175 Oct 04 22:52:40.301495 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3886/7879] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:52:40.385778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:40.394404 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3699b3dc-eac3-4099-aa65-4babc266369b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.165705 Oct 04 22:52:40.395019 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3994/7880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:40 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:41.418922 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:41.420150 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:41.426366 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:41.426902 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:41.427356 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:41.428065 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:41.428534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:41.428974 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:41.561395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:41.570705 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-39091b21-50a8-43be-801e-371c7198fe6a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1261 microversion: 2.1 time: 0.156830 Oct 04 22:52:41.571303 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3887/7881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:41 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:42.594264 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:42.600524 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:42.602204 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:42.602709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:42.603153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:42.603874 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:42.604337 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:42.604764 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:43.067703 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:43.075715 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-796e1f21-3856-45ab-b751-a7d43ef7a41d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1445 microversion: 2.1 time: 0.485766 Oct 04 22:52:43.076309 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3995/7882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:42 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1445 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:43.098102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:52:43.098748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:52:43.105947 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:43.106470 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:43.107511 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:43.108218 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:43.108682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:43.109119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:43.238176 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:52:43.245874 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe9e97b0-c588-4efa-a24c-ba06a7daf709 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1445 microversion: 2.1 time: 0.151587 Oct 04 22:52:43.246433 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3888/7883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:52:43 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:52:45.384833 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:52:45.395985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:52:45.396467 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:52:45.396903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:52:45.408423 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] Creating event network-changed:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h1-851029-13 Oct 04 22:52:45.413541 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f58c482d-2b6f-4614-a7df-5f0d3f877175 req-c71abafa-b2b5-4dd5-bd18-85214dc76869 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Oct 04 22:52:45.414153 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3996/7884] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:22.113367 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:55:22.114291 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:55:22.114837 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:22.115655 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=64 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:22.116594 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:55:22.116739 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:55:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action (ip 10.222.0.36) !!! Oct 04 22:55:22.118196 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:55:22.118331 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 22:55:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action (ip 10.222.0.36) !!! Oct 04 22:55:22.123222 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:22.123770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:22.131346 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.131848 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.132297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.133014 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.133483 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.133921 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.160715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lazy-loading 'flavor' on Instance uuid 1f85a211-325d-49fd-9937-158e858dab8d {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:55:22.491909 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e17c88d-9aa8-4241-a775-0a1abb7400dd tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action" status: 202 len: 0 microversion: 2.1 time: 0.380427 Oct 04 22:55:22.492492 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3889/7885] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:55:22 2022] POST /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:55:22.499619 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:55:22.500629 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:55:22.501110 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=26 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:22.501892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=58 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:22.502978 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:55:22.503104 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:55:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d (ip 10.222.0.36) !!! Oct 04 22:55:22.504915 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:55:22.505029 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:55:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d (ip 10.222.0.36) !!! Oct 04 22:55:22.520686 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:22.521390 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:22.529262 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.529735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.530164 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.530911 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:22.531368 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:22.531798 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:22.734058 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:22.735436 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08d6eed2-ecec-4b8f-8c6a-c461e6f3825a tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.237791 Oct 04 22:55:22.736006 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3997/7886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:22 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:23.762603 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:23.763345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:23.772158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:23.772649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:23.773098 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:23.773809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:23.774264 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:23.774719 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:23.782451 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51706. Oct 04 22:55:23.784722 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51708. Oct 04 22:55:23.956944 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:23.964692 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35b57d6c-518f-4d51-8e0e-a81f4d7cb292 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.208783 Oct 04 22:55:23.965268 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3890/7887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:23 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:24.988167 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:24.988819 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:24.998495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:24.999013 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:24.999446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:25.000141 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:25.000617 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:25.001042 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:25.005848 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51716. Oct 04 22:55:25.008124 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51714. Oct 04 22:55:25.139254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:25.147178 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83972b9e-46a6-4534-9e8d-df1b54b52742 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.162989 Oct 04 22:55:25.147770 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3998/7888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:24 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:26.171005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:26.171627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:26.178389 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:26.178918 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:26.179364 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:26.180068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:26.180559 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:26.180990 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:26.311129 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:26.318969 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a7301362-547a-4555-9c27-154afdd6e2db tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.151931 Oct 04 22:55:26.319545 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3891/7889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:26 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:27.345172 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:27.345877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:27.353230 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:27.353734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:27.354179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:27.354966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:27.355430 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:27.355869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:27.501423 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:27.510120 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06ad9b81-0bf6-4657-bfba-6fd649922a06 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.168899 Oct 04 22:55:27.510765 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3999/7890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:27 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:28.535557 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:28.536498 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:28.544000 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:28.544494 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:28.544938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:28.545638 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:28.546105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:28.546538 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:28.689423 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:28.697791 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35ad68b8-cb1b-456a-aafd-4fb477ba594f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.166502 Oct 04 22:55:28.698357 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3892/7891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:28 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:29.721655 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:29.722202 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:29.729737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:29.730229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:29.730676 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:29.731370 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:29.731825 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:29.732285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:29.865237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:29.873130 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-254d0d69-b0a8-451f-a4c1-b1d5424b1238 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.155633 Oct 04 22:55:29.873710 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4000/7892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:29 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:30.896363 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:30.896899 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:30.904440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:30.904932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:30.905382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:30.906104 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:30.906600 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:30.907062 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:31.040799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:31.048672 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1d3e0d5d-389d-40a5-a980-dc7eb11a1421 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.156845 Oct 04 22:55:31.049257 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3893/7893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:30 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:32.073177 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:32.073790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:32.080987 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:32.081468 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:32.081905 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:32.082625 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:32.083106 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:32.083571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:32.219321 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:32.227789 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-32bcba39-c9fe-464a-b1bc-1ba6b6b1030f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.159213 Oct 04 22:55:32.228579 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4001/7894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:32 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:33.252889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:33.253533 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:33.263548 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:33.275620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:33.275620 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:33.276466 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:33.277685 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:33.278163 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:33.434721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:33.443025 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0cb177a5-e8f0-4d84-8ea9-e11e0c076ce0 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.194711 Oct 04 22:55:33.443777 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3894/7895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:33 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:34.467095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:34.467639 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:34.474683 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:34.475251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:34.475692 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:34.476891 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:34.477349 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:34.477782 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:34.622092 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:34.624100 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-438ca0b2-f233-49e2-b3c7-5782e69a78f8 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.161206 Oct 04 22:55:34.624681 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4002/7896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:34 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:35.646733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:35.647361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:35.656748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:35.657250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:35.657704 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:35.658421 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:35.658916 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:35.659354 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:35.793773 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:35.801881 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3e944c47-0792-4f62-acd5-c21e7b47348b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.159009 Oct 04 22:55:35.802500 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3895/7897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:35 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:36.825856 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:36.826465 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:36.833596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:36.834007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:36.834438 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:36.835152 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:36.835603 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:36.836025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:36.972278 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:36.981205 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-08865b94-9bf2-414c-ab85-23a09e17d92d tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.159198 Oct 04 22:55:36.981783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4003/7898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:36 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:38.005503 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:38.006042 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:38.013381 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.013873 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.014318 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.015074 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.015541 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.015978 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.150225 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:38.158311 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b83c83b6-9d7f-4a60-aa33-90ed3f84e9b2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1510 microversion: 2.1 time: 0.156814 Oct 04 22:55:38.158938 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3896/7899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:38 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:38.181282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:38.181952 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:38.188967 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.189446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.189879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.190563 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.191064 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.191490 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.220606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123541) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:55:38.506414 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-217818d9-de28-4275-b4ec-408d793a8bcf tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "POST /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action" status: 202 len: 0 microversion: 2.1 time: 0.329513 Oct 04 22:55:38.507088 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4004/7900] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 22:55:38 2022] POST /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:55:38.515596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:38.516220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:38.522335 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.522919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.523374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.524256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:38.524733 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:38.525174 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:38.664413 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:38.672171 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-621b8b1d-6fcf-469c-8fdc-967ff87c7035 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1518 microversion: 2.1 time: 0.160429 Oct 04 22:55:38.672752 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3897/7901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:38 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:39.100985 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "name": "network-vif-unplugged", "status": "completed", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:39.110344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:39.110858 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:39.111289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:39.122371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_external_events [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] Unable to find a host for instance 1f85a211-325d-49fd-9937-158e858dab8d. Dropping event network-vif-unplugged {{(pid=123541) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:55:39.123261 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7ca03e6f-9fd6-4905-b93a-ab55a4117a21 req-98cd99a7-8d5c-4852-89e3-16bded0fd086 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026823 Oct 04 22:55:39.123841 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4005/7902] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:55:39.695152 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:39.695825 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:39.702570 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:39.703100 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:39.703542 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:39.704236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:39.704702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:39.705137 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:39.835226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:39.844399 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab083623-3fe8-4a00-bb7f-762900434881 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1518 microversion: 2.1 time: 0.153677 Oct 04 22:55:39.846056 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3898/7903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:39 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:40.868879 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:40.869497 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:40.876421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:40.876903 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:40.877341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:40.878039 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:40.878495 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:40.878949 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:41.014029 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:41.022250 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39329a65-ebf0-44f7-a6be-acbda7b72a60 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1518 microversion: 2.1 time: 0.157699 Oct 04 22:55:41.023357 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4006/7904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:40 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:42.046683 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:42.047359 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:42.055859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:42.056361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:42.056814 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:42.057527 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:42.057997 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:42.058438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:42.193882 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:42.201745 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be38e5f2-c4bd-4337-aa5d-3ff7e1315a92 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1518 microversion: 2.1 time: 0.158993 Oct 04 22:55:42.202318 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3899/7905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:42 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:43.225285 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:43.225913 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:43.232790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:43.233272 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:43.233708 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:43.234396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:43.234878 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:43.235308 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:43.364571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:43.375354 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-478231ae-5d45-450b-a556-9758743fc17f tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1518 microversion: 2.1 time: 0.154019 Oct 04 22:55:43.375943 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4007/7906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:43 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:44.401460 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:44.402125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:44.409519 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:44.409994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:44.410439 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:44.411181 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:44.411649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:44.412086 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:44.549605 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:44.558690 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-513c8965-1484-4563-aad3-4182dbd03aa2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1520 microversion: 2.1 time: 0.161187 Oct 04 22:55:44.564452 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3900/7907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:44 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:45.583755 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:45.584507 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:45.592306 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:45.592800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:45.593246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:45.593947 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:45.594412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:45.594887 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:45.739159 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:45.747153 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb65011d-9e50-40f5-9d8c-701194bc4735 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1520 microversion: 2.1 time: 0.167613 Oct 04 22:55:45.747779 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4008/7908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:45 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:46.770987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:46.771637 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:46.778575 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:46.779106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:46.779549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:46.780261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:46.780726 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:46.781159 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:46.914464 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:46.922734 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d763daf8-2d4e-4692-9070-1860ebe54d0c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1520 microversion: 2.1 time: 0.155579 Oct 04 22:55:46.923332 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3901/7909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:46 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:47.946803 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:47.947413 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:47.954341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:47.954857 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:47.955289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:47.956246 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:47.956697 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:47.957150 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:48.095628 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:48.103608 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25f946e8-6089-4595-842c-1aff42e13840 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1520 microversion: 2.1 time: 0.161200 Oct 04 22:55:48.104190 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4009/7910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:47 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:49.126923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:49.127565 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:49.135275 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:49.135700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:49.136158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:49.136906 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:49.137377 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:49.137818 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:49.274688 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:49.282786 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a29d4c6-650d-4226-93d2-f3defec2bce5 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1520 microversion: 2.1 time: 0.159917 Oct 04 22:55:49.283375 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3902/7911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:49 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:50.306505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:50.307229 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:50.314301 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:50.314816 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:50.315254 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:50.316344 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:50.316483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:50.316908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:50.495432 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:50.503220 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cab6ab98-c67a-45e1-9d37-23a87c6897ee tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.200652 Oct 04 22:55:50.503803 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4010/7912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:50 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:51.132550 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:55:51.142405 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:51.142923 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:51.143372 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:51.154631 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] Creating event network-changed:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h2-851029-13 Oct 04 22:55:51.160476 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-1281f0d7-d4cc-4183-834d-aea568dae711 req-ed9824ed-6a4d-42e0-8c75-05d00d03445d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087566 Oct 04 22:55:51.161104 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3903/7913] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:55:51.527660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:51.528282 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:51.535257 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:51.535777 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:51.536221 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:51.536951 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:51.537394 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:51.538447 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:51.704258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:51.711785 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff786b86-34b1-4695-a3ee-8b4383c91828 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.188064 Oct 04 22:55:51.712482 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4011/7914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:51 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:52.736599 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:52.737236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:52.740079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:52.745640 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:52.746138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:52.746596 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:52.747357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:52.747834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:52.748279 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:52.752410 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:52.885960 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:52.893770 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-42abbbc4-9f15-4bfa-b46f-589881a7ee02 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.161905 Oct 04 22:55:52.900655 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3904/7915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:52 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:53.918129 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:53.918768 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:53.921492 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:53.926318 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:53.934422 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:55:54.065330 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:54.073796 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0c40d44a-dd2a-4291-8e16-834c19caf6fc tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.159603 Oct 04 22:55:54.074398 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4012/7916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:53 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:55.098194 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:55.098838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:55.106338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:55.106857 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:55.107304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:55.108002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:55.108467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:55.108900 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:55.244872 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:55.252599 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48405ed7-93dc-416e-aa7d-334c18c7bf56 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.158615 Oct 04 22:55:55.253166 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3905/7917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:55 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:56.276895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:56.277519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:56.284608 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:56.285104 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:56.285544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:56.286251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:56.286736 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:56.287175 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:56.426478 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:56.434591 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-beed9b4d-5407-4148-8dbd-dc01939aa9e1 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.161576 Oct 04 22:55:56.435151 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4013/7918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:56 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:57.457734 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:57.458357 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:57.465809 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:57.466297 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:57.466770 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:57.467474 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:57.467946 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:57.468374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:57.607702 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:57.615654 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7030adf-0cf4-446a-8cc2-aed8c5cf2c3e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.162104 Oct 04 22:55:57.616232 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3906/7919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:57 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:58.638959 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:58.639580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:58.646526 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:58.647118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:58.647558 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:58.648251 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:58.648712 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:58.649144 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:58.781817 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:58.790395 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83c9cb7b-dc4e-470e-95ef-017c1a1705f9 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.155408 Oct 04 22:55:58.791229 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4014/7920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:58 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:55:59.814080 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:55:59.814721 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:55:59.822226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:59.822743 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:59.823190 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:59.823891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:55:59.824353 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:55:59.824786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:55:59.956247 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:55:59.964066 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a4c62f7-ae2c-4e95-97c4-3a034afa58d2 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.154043 Oct 04 22:55:59.964699 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3907/7921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:55:59 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:00.987684 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:00.988303 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:00.995588 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:00.996103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:00.996546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:00.997259 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:00.997761 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:00.998145 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:01.009171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "name": "network-vif-plugged", "status": "completed", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:56:01.020820 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:01.021305 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:01.022378 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:01.034245 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] Creating event network-vif-plugged:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h2-851029-13 Oct 04 22:56:01.040081 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7ffd6924-5b17-4bd5-9053-27ee47b42630 req-c8380c54-39f4-46de-a17d-27da043259d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036134 Oct 04 22:56:01.040907 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3908/7922] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:56:01.144307 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:01.152713 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-753e2180-b918-4640-b633-bec188345545 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.168994 Oct 04 22:56:01.153305 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4015/7923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:00 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:02.178926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:02.179659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:02.186445 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:02.186979 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:02.187440 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:02.188166 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:02.188700 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:02.189158 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:02.329254 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:02.338390 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-239a1bb9-f1f0-4cdd-95a1-81cfdba17499 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1576 microversion: 2.1 time: 0.165087 Oct 04 22:56:02.339046 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3909/7924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:02 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:56:03.361734 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:56:03.362345 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:56:03.369730 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:03.370208 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:03.370644 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:03.371347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:56:03.371800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:56:03.372223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:56:03.514555 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:56:03.522684 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04febce7-473a-4630-b673-2488eda29179 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1563 microversion: 2.1 time: 0.164857 Oct 04 22:56:03.523283 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4016/7925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:56:03 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:52.605744 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=11 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:52.606710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=31 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:52.612263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:52.612804 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:52.617892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=9 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:52.618682 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=29 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:57:52.619515 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:57:52.619648 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 22:57:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 04 22:57:52.624569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:52.640240 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:52.640747 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:52.641193 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:52.642002 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:52.642475 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:52.642977 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:52.648521 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:52.649051 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:52.649491 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:52.662244 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] Creating event network-changed:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h2-851029-13 Oct 04 22:57:52.670572 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-811f75f1-0c17-45b8-9132-1d814d6f4de9 req-f3c2eabb-7472-442e-a54d-ebb34a74cabd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054311 Oct 04 22:57:52.671799 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4017/7926] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:52.674715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:57:52.998704 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7d9472ab-fe5d-45a9-aaea-d577d6c9b4ea tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 204 len: 0 microversion: 2.1 time: 0.395118 Oct 04 22:57:52.999361 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3910/7927] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 22:57:52 2022] DELETE /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:57:53.010179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:53.011371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:53.020119 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:53.020623 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:53.021060 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:53.021978 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:53.022607 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:53.023061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:53.192372 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:53.200315 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ec6cd160-0ced-42d7-8377-8c722eafa51e tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1569 microversion: 2.1 time: 0.195666 Oct 04 22:57:53.200889 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4018/7928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:53 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:54.228136 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:54.228854 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:54.235361 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:54.236358 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:54.236806 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:54.237517 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:54.237989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:54.238427 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:54.389171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:54.397060 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4489ee9-86a9-45d5-921d-045d5feef4d6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1451 microversion: 2.1 time: 0.175128 Oct 04 22:57:54.397635 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3911/7929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:54 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:55.067553 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f85a211-325d-49fd-9937-158e858dab8d", "name": "network-vif-deleted", "tag": "49c0394b-4ce7-4009-8d98-de39f9c0642a"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:57:55.078156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:55.078645 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:55.079118 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:55.092462 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] Creating event network-vif-deleted:49c0394b-4ce7-4009-8d98-de39f9c0642a for instance 1f85a211-325d-49fd-9937-158e858dab8d on n-h2-851029-13 Oct 04 22:57:55.098200 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-fa4139d3-41c5-4564-8c40-805103417ea3 req-881302be-9534-441b-8f46-b3006beff4d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Oct 04 22:57:55.098875 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4019/7930] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:57:55.421838 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:55.422627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:55.434236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:55.434904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:55.435419 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:55.436210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:55.436888 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:55.437796 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:55.514647 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:55.522956 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69133e19-3254-4843-bf5b-238380832799 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1220 microversion: 2.1 time: 0.104998 Oct 04 22:57:55.523663 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3912/7931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:55 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:56.551476 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:56.552395 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:56.559537 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:56.560025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:56.560456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:56.561156 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:56.561610 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:56.562035 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:56.633445 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:56.643238 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b9d2531-2fac-4190-be83-c253312c4391 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1220 microversion: 2.1 time: 0.098300 Oct 04 22:57:56.643819 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4020/7932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:56 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:57.665935 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:57.666578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:57.673739 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:57.674243 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:57.674718 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:57.675467 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:57.675926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:57.676367 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:57.744576 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:57.754074 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a17b9d6c-785b-44e5-91cb-4cfd54131aaa tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1220 microversion: 2.1 time: 0.092246 Oct 04 22:57:57.754800 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3913/7933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:57 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:58.778519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:58.779804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:58.787531 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:58.788085 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:58.788529 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:58.789240 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:58.789726 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:58.790333 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:58.856973 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:58.865506 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fbdf091e-1250-4f7c-9fe9-90ded892a16b tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1220 microversion: 2.1 time: 0.091748 Oct 04 22:57:58.866244 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4021/7934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:58 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:57:59.889659 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:57:59.890313 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:57:59.897693 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:59.898220 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:59.898682 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:59.899424 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:57:59.899892 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:57:59.900325 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:57:59.968105 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:57:59.976656 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62dbb59a-c46c-47d0-99b3-9fa3e83d21df tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1220 microversion: 2.1 time: 0.090855 Oct 04 22:57:59.977239 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3914/7935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:57:59 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:01.000374 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:01.001767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:01.008920 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:01.009431 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:01.009945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:01.010695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:01.011147 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:01.011570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:01.044163 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:01.044620 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:01.045078 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:01.045548 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lazy-loading 'fault' on Instance uuid 1f85a211-325d-49fd-9937-158e858dab8d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:58:01.094739 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4165f92e6374dde923e0f9c47483e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445d5e66aff147509d3420fe603311e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:01.100370 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f82836eb-16a3-42b6-87c1-7f5a772e2cc6 tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 200 len: 1225 microversion: 2.1 time: 0.103916 Oct 04 22:58:01.101174 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4022/7936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:00 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:02.124156 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:02.124949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] [instance: 1f85a211-325d-49fd-9937-158e858dab8d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:02.134859 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:02.135484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:02.136085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:02.136862 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:02.137484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:02.138102 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:02.154285 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] HTTP exception thrown: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Request method failure captured: Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: request: GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d HTTP/1.1 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Accept: application/json Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Accept-Encoding: identity Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Connection: close Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Content-Length: 0 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Content-Type: application/json Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Host: 10.222.0.36 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: Openstack-System-Scope: None Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: User-Agent: python-urllib3/1.26.12 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Auth-Token: gAAAAABjPLfQ5RU42lCxBlGPcWr61wP-4h8Ae8-AnxrH0UFm0rykj39xSeD9qqk-ttvMOYCqkjLgRPBjXuyK03c4uBTb2Riz1kn0B2MT37fAmULz1Xp71gdHTlx3OryUcJ5YG-4xQA4RHUaAcx1PhUp9zPeevPP-UaX9bptAy6CIDUKngw7Uh_g Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Id: None Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Domain-Name: None Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Identity-Status: Confirmed Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Is-Admin-Project: True Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Id: default Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Domain-Name: Default Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Id: 445d5e66aff147509d3420fe603311e5 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Project-Name: tempest-TestShelveInstance-1378955456 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Role: member,reader Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Roles: member,reader Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/445d5e66aff147509d3420fe603311e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/445d5e66aff147509d3420fe603311e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/445d5e66aff147509d3420fe603311e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_445d5e66aff147509d3420fe603311e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant: tempest-TestShelveInstance-1378955456 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Id: 445d5e66aff147509d3420fe603311e5 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-Tenant-Name: tempest-TestShelveInstance-1378955456 Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-User: tempest-TestShelveInstance-1378955456-project Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Id: default Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Domain-Name: Default Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Id: d4165f92e6374dde923e0f9c47483e2a Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: X-User-Name: tempest-TestShelveInstance-1378955456-project Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: method: > Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: exception: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: action_args: {'id': '1f85a211-325d-49fd-9937-158e858dab8d'} Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:58:02.156654 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: ERROR nova.api.openstack.wsgi Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Returning 404 to user: Instance 1f85a211-325d-49fd-9937-158e858dab8d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-add9c61b-ac2c-457a-a4b4-e74b4b03984c tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d" status: 404 len: 111 microversion: 2.1 time: 0.039097 Oct 04 22:58:02.160552 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3915/7937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:02 2022] GET /compute/v2.1/servers/1f85a211-325d-49fd-9937-158e858dab8d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:58:02.399076 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2ba921d-a2ca-4272-b76c-272356876cef tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] Calling method '.version_select at 0x7f54f5df8af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:02.549176 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2ba921d-a2ca-4272-b76c-272356876cef tempest-TestShelveInstance-1378955456 tempest-TestShelveInstance-1378955456-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1076992941" status: 202 len: 0 microversion: 2.1 time: 0.154530 Oct 04 22:58:02.549808 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4023/7938] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 22:58:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1076992941 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:58:27.200786 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:27.201629 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:27.412996 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Action: 'create', calling method: .version_select at 0x7f54f55e5ca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-847660906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCThCWK3+2857e5K9mGXSUH2MOtWHJY5m7T4wDn1qQCSVHL6YRI9YsxhvyQJtin0OCendCfaakAo1z62sahK4n1z75sksbDS/zNASKuZMZuIRKcWKpP2M3jCdwl2dzVLKQ=="}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:27.429210 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:58:27.434995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.quota [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for user 27a8e6b80642421ba16eb6d43c6d248c and project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:58:27.449137 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:58:28.460101 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [421d04cc-308e-41e0-96d9-e8633d2d96db] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52002. Oct 04 22:58:28.583180 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e263bc3-575b-4f1f-b909-a6220ed41c6d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.388138 Oct 04 22:58:28.592475 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3916/7939] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 4 22:58:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:58:31.446473 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1293286765", "imageRef": "08650df2-2319-4b76-af09-4569093fd163", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-847660906", "security_groups": [{"name": "tempest-secgroup-smoke-159943457"}], "networks": [{"uuid": "63027d56-c2d6-48a9-abf3-40475edecf15"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:31.457571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=30 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:31.458213 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:31.558850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] validate_networks() for [('63027d56-c2d6-48a9-abf3-40475edecf15', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:58:32.042117 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:58:32.042546 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:58:32.043056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:58:32.043579 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:58:32.044001 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:58:32.053309 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:32.053790 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:32.054223 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:32.055009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:32.055461 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:32.055908 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:32.074158 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:58:32.079931 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for user 27a8e6b80642421ba16eb6d43c6d248c and project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:58:32.092845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:58:32.095258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08650df2-2319-4b76-af09-4569093fd163',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:58:32.222301 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:58:33.231931 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52036. Oct 04 22:58:33.236114 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-737562a1-8ef4-442a-bfe4-7b02cf59c5a7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.793850 Oct 04 22:58:33.236862 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4024/7940] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 22:58:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:58:33.251009 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4a5f951b-01cc-4ad7-81eb-52f7a68527ae tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:33.251674 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4a5f951b-01cc-4ad7-81eb-52f7a68527ae tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:33.308735 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-4a5f951b-01cc-4ad7-81eb-52f7a68527ae tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:33.317087 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4a5f951b-01cc-4ad7-81eb-52f7a68527ae tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1248 microversion: 2.1 time: 0.071308 Oct 04 22:58:33.323538 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3917/7941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:33 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:34.342538 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6fbb945e-e655-4a3e-b575-24edd2179df9 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:34.343185 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6fbb945e-e655-4a3e-b575-24edd2179df9 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:34.398116 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6fbb945e-e655-4a3e-b575-24edd2179df9 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:34.405248 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6fbb945e-e655-4a3e-b575-24edd2179df9 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1248 microversion: 2.1 time: 0.068250 Oct 04 22:58:34.405864 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4025/7942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:34 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:35.431269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:35.432272 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:35.442524 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:35.443114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:35.443912 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:35.444926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:35.445425 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:35.445864 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:35.511555 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:35.519280 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-477c26f5-0d25-410e-97e4-1f9c516639f1 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1300 microversion: 2.1 time: 0.092990 Oct 04 22:58:35.519860 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3918/7943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:35 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:36.541446 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:36.542061 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:36.549808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:36.550289 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:36.550769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:36.551483 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:36.551942 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:36.552380 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:36.619515 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:36.629051 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4290dfd3-ea0c-4eb4-9ccb-261d24696014 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1306 microversion: 2.1 time: 0.091505 Oct 04 22:58:36.629640 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4026/7944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:36 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:37.652109 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:37.652729 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:37.660260 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:37.660761 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:37.661205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:37.661926 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:37.662395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:37.662949 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:37.797226 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:37.805347 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-14dfa97c-c086-43a5-aa8e-918b54a1377a tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.157101 Oct 04 22:58:37.805934 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3919/7945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:37 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:37.980007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:37.989369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:37.989843 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:37.990268 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:38.003242 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] Creating event network-changed:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 22:58:38.008715 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-15c02da3-54f4-4c1c-ba72-c8921c6e9b49 req-1f9dc0c0-2c9d-450a-b2b4-a8ca1216d0a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095103 Oct 04 22:58:38.009394 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4027/7946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:58:38.828287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:38.828829 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:38.836003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:38.836492 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:38.836938 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:38.837649 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:38.838114 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:38.838547 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:38.970345 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:38.978461 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-08241303-bf4e-4aa1-9ea9-b06ccd406414 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.154202 Oct 04 22:58:38.979078 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3920/7947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:38 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:40.003458 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:40.004173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:40.010386 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:40.010912 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:40.011354 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:40.012047 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:40.012500 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:40.012927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:40.155311 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:40.163917 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6dc59222-271f-45d2-b77f-f0e1428b1e1e tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.166178 Oct 04 22:58:40.164510 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4028/7948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:39 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:41.187140 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:41.187727 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:41.194499 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:41.195023 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:41.195472 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:41.196173 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:41.196639 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:41.197073 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:41.330003 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:41.337894 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc9a7159-7c5d-4f97-93bb-af8c9c9c3f16 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.154842 Oct 04 22:58:41.338474 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3921/7949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:41 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:42.363066 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:42.363814 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:42.366596 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:42.371570 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:42.372056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:42.372516 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:42.375173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:42.375173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:42.375173 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:42.517313 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:42.525824 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76a0f7b4-5cc0-4cd7-94c7-f3814a5bec32 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.166753 Oct 04 22:58:42.526413 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4029/7950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:42 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:43.549066 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:43.549730 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:43.552560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=6 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:43.557626 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:43.558138 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:43.558592 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:43.559344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:43.559817 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:43.560256 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:43.695987 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:43.704204 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6314b8d3-d36a-4fb4-af88-e879b4ea48bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.159622 Oct 04 22:58:43.704789 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3922/7951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:43 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:44.269740 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "name": "network-vif-plugged", "status": "completed", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:44.279369 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:44.279850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:44.280312 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:44.291388 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] Creating event network-vif-plugged:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 22:58:44.296991 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7a23440b-0b11-41af-baf8-ee453b8aec45 req-b86aa7ad-3f23-4455-87ac-dc9d43fdf1a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090211 Oct 04 22:58:44.297638 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4030/7952] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:58:44.727348 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:44.727889 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:44.735500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:44.735993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:44.736724 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:44.737147 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:44.737627 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:44.738060 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:44.874933 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:44.883473 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-44d5baa2-3684-4067-a671-4eca606ab00c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.160027 Oct 04 22:58:44.884167 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3923/7953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:44 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:58:45.902921 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=8 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:58:45.907960 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:45.908698 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:45.914877 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:45.915364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:45.915800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:45.916499 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:45.916958 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:45.917388 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:46.053393 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:46.061173 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2da7eb70-0841-402e-b774-c4914028f80b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1373 microversion: 2.1 time: 0.159324 Oct 04 22:58:46.062375 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4031/7954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:45 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:47.085828 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:47.086454 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:47.093495 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:47.093989 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:47.094433 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:47.095171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:47.095634 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:47.096068 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:47.237675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:47.251676 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-37ead62f-b717-49d4-aa3b-dc60f9b1b122 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1557 microversion: 2.1 time: 0.170272 Oct 04 22:58:47.252332 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3924/7955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:47 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:47.276237 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:58:47.276861 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:58:47.284200 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:47.284691 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:47.285127 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:47.285831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:47.286287 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:47.286860 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:47.435804 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:58:47.444577 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-978a6a27-1e93-4148-ae17-daf36339c21d tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1557 microversion: 2.1 time: 0.172349 Oct 04 22:58:47.445218 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4032/7956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 22:58:47 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:58:49.484835 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:58:49.495266 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:58:49.497995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:58:49.497995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:58:49.508633 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] Creating event network-changed:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 22:58:49.513947 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e0f7afef-f9f1-465a-92be-edb42508388c req-46aa55cd-ad5f-4432-9732-173678d2a601 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Oct 04 22:58:49.515486 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3925/7957] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 22:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:16.496137 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:01:16.497074 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:01:16.500936 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1855646112"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:16.503341 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:16.505569 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:16.506299 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=36 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:16.507519 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:01:16.507668 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 23:01:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8/action (ip 10.222.0.36) !!! Oct 04 23:01:16.509578 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 23:01:16.509715 n-d-851029-13 devstack@n-api.service[123541]: Tue Oct 4 23:01:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8/action (ip 10.222.0.36) !!! Oct 04 23:01:16.519178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:16.519892 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:16.520099 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:16.520808 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:16.521266 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:16.521701 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:17.300473 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-02fe1754-b765-4928-a713-69454d8e15c8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "POST /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8/action" status: 202 len: 0 microversion: 2.1 time: 0.668489 Oct 04 23:01:17.300473 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4033/7958] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 23:01:16 2022] POST /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 23:01:24.989311 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:01:24.990347 n-d-851029-13 devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 23:01:24.991269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:24.992106 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=44 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:24.993168 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:01:24.993314 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 23:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 04 23:01:24.998919 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "name": "network-vif-plugged", "status": "completed", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:25.009566 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:25.016005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:25.016005 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:25.022275 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] Creating event network-vif-plugged:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 23:01:25.027712 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a6eb462f-2bba-420c-a9ee-860391651eeb req-20f15060-1771-430c-8ccc-ca23f0fce761 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040291 Oct 04 23:01:25.028325 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3926/7959] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:39.026982 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:39.040722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:39.040722 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-69801481", "imageRef": "bf09adad-bbf9-4578-b67d-ec9de9881d13", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-847660906", "security_groups": [{"name": "tempest-secgroup-smoke-159943457"}], "networks": [{"uuid": "63027d56-c2d6-48a9-abf3-40475edecf15"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:39.048012 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5576e88-78fb-4086-9bf3-c95d61b5984c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52322. Oct 04 23:01:39.065127 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [042db447-521a-4b62-b906-3219889b356e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52320. Oct 04 23:01:39.170339 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] validate_networks() for [('63027d56-c2d6-48a9-abf3-40475edecf15', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 23:01:39.566606 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 23:01:39.567063 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 23:01:39.567552 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 23:01:39.567968 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 23:01:39.568387 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 23:01:39.578397 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:39.578977 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:39.579535 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:39.580355 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:39.581068 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:39.581820 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:39.605850 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 23:01:39.611572 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.quota [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Getting quotas for user 27a8e6b80642421ba16eb6d43c6d248c and project d7d15a93e9594ee1b2c6db1d944fcb31. Resources: {'instances', 'ram', 'cores'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 23:01:39.624575 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 23:01:39.630033 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf09adad-bbf9-4578-b67d-ec9de9881d13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 23:01:39.796114 n-d-851029-13 devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 23:01:40.803980 n-d-851029-13 devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [5316865a-51a4-4d15-97b1-18053bdb6bca] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52334. Oct 04 23:01:40.808318 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9cd86f92-3c2d-4a0e-9883-4db3616eaea0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.786279 Oct 04 23:01:40.808987 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4034/7960] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 4 23:01:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 23:01:40.823619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-df008688-f9d6-43ce-a740-3dbba18b8d27 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:40.824572 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-df008688-f9d6-43ce-a740-3dbba18b8d27 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:40.840045 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [42f23717-43cd-4e7e-af87-2aff35044716] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52338. Oct 04 23:01:40.840740 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe8d988b-7963-4dc8-9ea6-3e4168bc7910] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52340. Oct 04 23:01:40.940337 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-df008688-f9d6-43ce-a740-3dbba18b8d27 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:40.949554 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-df008688-f9d6-43ce-a740-3dbba18b8d27 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1246 microversion: 2.1 time: 0.133085 Oct 04 23:01:40.950140 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3927/7961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:40 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:41.973815 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:41.974366 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:41.981541 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:41.982027 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:41.982470 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:41.983196 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:41.987884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:41.987884 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:42.050041 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:42.063333 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-523b9983-5df5-4b31-9e8f-d459402525f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1250 microversion: 2.1 time: 0.094324 Oct 04 23:01:42.063937 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4035/7962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:41 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:42.970178 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "name": "network-vif-unplugged", "status": "completed", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:42.982064 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:42.982578 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:42.983084 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:42.995020 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] Creating event network-vif-unplugged:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 23:01:43.000063 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b289a9e7-cf5a-4f10-94cf-a631c2189202 req-47dba02b-059e-44a7-b431-e773c530ce2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033980 Oct 04 23:01:43.000660 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3928/7963] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:43.088365 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:43.088983 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:43.096095 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.096586 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.097034 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.097737 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:43.098201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:43.098633 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:43.175462 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:43.184290 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19055ca3-6639-4edd-9310-441f68af3c23 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1298 microversion: 2.1 time: 0.100031 Oct 04 23:01:43.184949 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4036/7964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:43 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:44.217500 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:44.218082 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:44.224412 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:44.224915 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:44.225374 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:44.226093 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:44.226560 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:44.227045 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:44.514365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:44.524931 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f450c861-4f44-4c76-802a-567ae5b4c097 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.312437 Oct 04 23:01:44.529600 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3929/7965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:44 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:45.549690 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:45.550328 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:45.560449 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:45.561109 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:45.561619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:45.562363 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:45.562945 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:45.563486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:45.715179 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:45.723781 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fdaeb604-b580-40d3-9dbe-3a966d271811 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.177949 Oct 04 23:01:45.724368 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4037/7966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:45 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:46.749134 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:46.750219 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:46.757762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.758295 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.758904 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.759711 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:46.760236 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:46.760687 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:46.910200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:46.918898 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aa39b2e4-83ed-46cf-ab0c-2b918a3a2dbc tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.173819 Oct 04 23:01:46.927355 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3930/7967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:46 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:47.944165 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:47.944813 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:47.952329 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:47.952927 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:47.953456 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:47.954233 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:47.954735 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:47.955169 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:48.101494 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:48.109521 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f267b7dd-cd07-4ac4-9fa4-756782f0a0a2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.169462 Oct 04 23:01:48.110308 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4038/7968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:47 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:49.133208 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:49.133860 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:49.141612 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:49.142118 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:49.142571 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:49.143350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:49.143826 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:49.144263 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:49.298344 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:49.308572 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-702d3ea2-fd8a-4745-a190-73718ba009f7 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.178492 Oct 04 23:01:49.319497 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3931/7969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:49 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:50.332178 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:50.333126 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:50.336040 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=2 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:50.336993 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell0:SELECT=6 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:50.342201 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:50.342821 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:50.343519 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:50.345506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:50.345506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:50.345506 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:50.567748 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:50.567748 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0901162-2d33-4915-a5e3-7bc77229271c tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.183741 Oct 04 23:01:50.567748 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4039/7970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:50 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:01:51.592271 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:51.592927 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:51.595875 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell0:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:01:51.601491 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:51.607395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:51.607395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:51.607395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:51.607395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:51.607395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:51.766512 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:51.775805 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-60d73de2-f68f-43e8-bce3-a110860e883f tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.187326 Oct 04 23:01:51.776421 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3932/7971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:51 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:52.799778 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:52.800436 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:52.809284 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:52.809772 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:52.810211 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:52.810938 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:52.811396 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:52.811822 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:52.952070 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:52.960224 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6b818443-2e05-4516-92bf-df1c039f20b2 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.164470 Oct 04 23:01:52.960820 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4040/7972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:52 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:53.916079 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:01:53.925823 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.933591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.933591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:53.938900 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] Creating event network-changed:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:01:53.944851 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3ea1aa34-461d-4a21-aac9-e8dd972e2efa req-7964312b-eb39-4a0d-8420-736a18f07dfa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093555 Oct 04 23:01:53.945466 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3933/7973] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:01:53.983966 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:53.984571 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:53.995770 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.996322 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.996767 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:53.997477 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:53.997937 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:53.998371 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:54.557166 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:54.567345 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6e750299-ad15-4289-8bca-ff90cdc857b4 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.587180 Oct 04 23:01:54.568195 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4041/7974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:53 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:55.593690 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:55.594396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:55.601663 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:55.602085 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:55.602549 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:55.603304 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:55.603799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:55.604277 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:55.767396 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:55.777143 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e82a89bf-63ac-4716-8c7d-6e6e82be1f43 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.187640 Oct 04 23:01:55.777944 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3934/7975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:55 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:56.803536 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:56.804153 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:56.811787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:56.812273 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:56.812711 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:56.813428 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:56.813869 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:56.814296 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:56.952415 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:56.961444 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-837e6867-1ec8-469f-8bce-9f6824f371ba tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.161359 Oct 04 23:01:56.968178 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4042/7976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:56 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:57.985339 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:57.985881 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:57.993496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:57.993984 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:57.994430 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:57.995169 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:57.995636 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:57.996071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:58.129619 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:58.137548 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30ad75cb-3acd-4180-b105-42d3651171d0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.156325 Oct 04 23:01:58.138173 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3935/7977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:57 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:01:59.160138 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:01:59.160769 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:01:59.167926 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:59.168412 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:59.168845 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:59.169544 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:01:59.169994 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:01:59.170418 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:01:59.308796 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:01:59.316481 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4cba12ad-c55a-434b-bb5d-706047b4a509 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.160405 Oct 04 23:01:59.317050 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4043/7978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:01:59 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:00.340125 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:00.340748 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:00.348772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.349269 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.349715 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.350429 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.351484 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.352011 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.488772 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:00.497144 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b594fabf-650f-432b-9b16-224f19621043 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.160985 Oct 04 23:02:00.497714 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3936/7979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:00 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:00.745294 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "name": "network-vif-plugged", "status": "completed", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:00.757258 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:00.761992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:00.761992 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:00.769940 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] Creating event network-vif-plugged:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:02:00.775832 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0a0f1480-330c-40bc-bc19-ad5c01d72955 req-cefe66b5-d1e1-4abc-be78-16518263b666 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Oct 04 23:02:00.776458 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4044/7980] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:02:01.520183 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:01.520766 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:01.528189 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:01.528675 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:01.529119 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:01.529827 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:01.530311 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:01.530756 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:01.663323 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:01.671659 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e2ffa3b5-e670-4f60-b9c8-449cdf0d9116 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1371 microversion: 2.1 time: 0.155635 Oct 04 23:02:01.672231 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3937/7981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:01 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:02.696713 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:02.697350 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:02.703660 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.704149 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.704592 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:02.705292 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.705754 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.706189 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:02.847787 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:02.856470 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4fc4ccc-5d11-4990-84eb-88df15f1b3f8 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1555 microversion: 2.1 time: 0.164995 Oct 04 23:02:02.857060 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4045/7982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:02 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:02.881063 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:02:02.881691 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:02:02.890438 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.891202 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.891658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:02.892382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:02.892891 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:02.893338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:03.036954 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:02:03.045985 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bae91e49-d20b-4dae-af7f-924cdc24a748 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1555 microversion: 2.1 time: 0.170569 Oct 04 23:02:03.055987 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3938/7983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:02:02 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:02:05.193918 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:02:05.204665 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:02:05.205168 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:02:05.205486 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:02:05.218115 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] Creating event network-changed:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:02:05.223625 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-941a1f21-4d7a-4ba5-9ed0-0d00a905b25e req-5a1258d1-9a62-4b94-8669-51eadc3f14e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Oct 04 23:02:05.224685 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4046/7984] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:03:33.205658 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=28 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:33.206504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=60 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:33.208399 n-d-851029-13 devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 23:03:33.208399 n-d-851029-13 devstack@n-api.service[123542]: Tue Oct 4 23:03:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98/action (ip 10.222.0.36) !!! Oct 04 23:03:33.267706 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-215219152"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:33.270111 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:33.276338 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:33.276834 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:33.277293 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:33.277994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:33.278525 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:33.278995 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:33.800526 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-10084618-350e-4e0b-9c6a-4a9c7721cef5 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "POST /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98/action" status: 202 len: 0 microversion: 2.1 time: 0.596773 Oct 04 23:03:33.806063 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3939/7985] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 4 23:03:33 2022] POST /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 23:03:39.311102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "name": "network-vif-plugged", "status": "completed", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:39.320619 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:39.321598 n-d-851029-13 devstack@n-api.service[123541]: DEBUG dbcounter [-] [123541] Writing DB stats nova_cell1:SELECT=66 {{(pid=123541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:39.327831 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:39.330679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:39.330679 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:39.343366 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] Creating event network-vif-plugged:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:03:39.351131 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-82ec578b-2c57-41d0-931f-ffeca89433d8 req-1ee3cf21-846d-45ef-a7ef-e796c184ea1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044991 Oct 04 23:03:39.352473 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4047/7986] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:50.863116 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:50.863879 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:50.870071 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_api:SELECT=2 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:50.871046 n-d-851029-13 devstack@n-api.service[123542]: DEBUG dbcounter [-] [123542] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 23:03:50.876678 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.877191 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.877653 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.878679 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.879171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.879622 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.908382 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:03:50.919709 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:50.929543 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:50.930037 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:50.930542 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:50.947721 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] Creating event network-changed:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:03:50.953553 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7943a92d-bf1a-4fc9-a26e-e6ded16b3942 req-6c86a19a-43e4-41bb-be83-ea34baac78b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096136 Oct 04 23:03:50.954132 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4048/7987] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:51.287624 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-42ff79df-d04a-46a1-adaa-34ad09c01dfd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 204 len: 0 microversion: 2.1 time: 0.435743 Oct 04 23:03:51.323163 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3940/7988] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 23:03:50 2022] DELETE /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:51.323434 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:51.474996 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:51.483490 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bf28d9e-eebd-4d10-a6c2-c8442edb48be tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1680 microversion: 2.1 time: 0.190491 Oct 04 23:03:51.484095 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4049/7989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:51 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:52.509021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:52.509741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:52.516703 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.517200 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.517650 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.518360 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:52.518853 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:52.519287 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:52.703317 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:52.711323 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d569b355-6bf8-4716-aa92-548eb49bb4bd tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1680 microversion: 2.1 time: 0.207126 Oct 04 23:03:52.711900 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3941/7990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:52 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:53.405379 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3899bcb8-35da-414c-b8c2-5e6065a3ef98", "name": "network-vif-deleted", "tag": "5099d421-9f9e-47cf-aa21-f05f643fd589"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:53.415870 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:53.423417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:53.423417 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:53.428089 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] Creating event network-vif-deleted:5099d421-9f9e-47cf-aa21-f05f643fd589 for instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 on n-h2-851029-13 Oct 04 23:03:53.433101 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-0cec0b57-a929-401a-8f4e-3f671cfbfab6 req-5cd770a0-ade9-4dac-a1f3-ab5174620626 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Oct 04 23:03:53.433694 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4050/7991] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:03:53.736282 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:53.737004 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:53.744994 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:53.745534 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:53.745993 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:53.746762 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:53.747395 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:53.747799 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:53.816180 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:53.824148 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a06e893c-7f33-4e74-bf73-f44436d1f4eb tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 200 len: 1331 microversion: 2.1 time: 0.091966 Oct 04 23:03:53.824742 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3942/7992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:53 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:54.849400 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:54.850102 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 3899bcb8-35da-414c-b8c2-5e6065a3ef98] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:54.856295 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:54.856775 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:54.857205 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:54.857895 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:54.858347 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:54.858800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:54.873380 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] HTTP exception thrown: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Request method failure captured: Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 HTTP/1.1 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLqMd6_cEEG27iWg3Lmi5ctIcmKZ_bEmi7gpHAfs6CrZ8YC508dfuzBkbsa9RcuY32pRtX6QSCZ4EEGdgQ60nN-ourIl3ZUtrjdGJKIv_48FfO8sG1xTIxDyDibl2zPNZ6LtZY_ySBLGXPdK6lcN_sNst-s3Gqy5kimU4lkoyWC_hGo Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: d7d15a93e9594ee1b2c6db1d944fcb31 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestSnapshotPattern-1893135095 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestSnapshotPattern-1893135095 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: d7d15a93e9594ee1b2c6db1d944fcb31 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestSnapshotPattern-1893135095 Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestSnapshotPattern-1893135095-project Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 27a8e6b80642421ba16eb6d43c6d248c Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestSnapshotPattern-1893135095-project Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '3899bcb8-35da-414c-b8c2-5e6065a3ef98'} Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:03:54.875023 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Returning 404 to user: Instance 3899bcb8-35da-414c-b8c2-5e6065a3ef98 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c544203f-f5b2-4a70-802f-214fa5c2f453 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98" status: 404 len: 111 microversion: 2.1 time: 0.032133 Oct 04 23:03:54.879783 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4051/7993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:54 2022] GET /compute/v2.1/servers/3899bcb8-35da-414c-b8c2-5e6065a3ef98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:03:57.669932 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:57.670504 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:57.673250 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:57.679021 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:57.679588 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:57.680261 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:57.681204 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:57.681741 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:57.682250 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:57.684103 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:57.684580 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:57.685183 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:57.697637 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] Creating event network-changed:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 23:03:57.702919 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c17b0c63-2eea-49a0-910f-18bd1150b84d req-5e648ac9-bbf4-4621-b26b-8a3d43f1050a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034338 Oct 04 23:03:57.703676 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4052/7994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 23:03:57.714428 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 23:03:58.072840 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c31ad07f-b129-43af-b1e6-4e0aaeb399b3 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 204 len: 0 microversion: 2.1 time: 0.406945 Oct 04 23:03:58.073363 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3943/7995] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 4 23:03:57 2022] DELETE /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 23:03:58.082317 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:58.083056 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:58.089695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:58.090195 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:58.090630 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:58.091364 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:58.091828 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:58.092253 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:58.232421 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.policy [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:58.240621 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cf72d5d1-6648-42ec-9515-2df316461e68 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1682 microversion: 2.1 time: 0.162624 Oct 04 23:03:58.241207 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4053/7996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:58 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:59.265157 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:03:59.265907 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:03:59.273286 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:59.273782 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:59.274228 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:59.274972 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:59.275760 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:59.276205 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:59.348598 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:03:59.357377 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-897a8673-52d5-4eb7-978d-b9845c15c55b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1496 microversion: 2.1 time: 0.096503 Oct 04 23:03:59.358305 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3944/7997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:03:59 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1496 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 23:03:59.721800 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c814993-a00e-49ea-b469-67b2df0909a8", "name": "network-vif-deleted", "tag": "e23125f3-6192-47a0-ad6e-9f07e53f0b27"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 23:03:59.732207 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:03:59.732695 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:03:59.733135 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:03:59.744996 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] Creating event network-vif-deleted:e23125f3-6192-47a0-ad6e-9f07e53f0b27 for instance 4c814993-a00e-49ea-b469-67b2df0909a8 on n-h1-851029-13 Oct 04 23:03:59.750058 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-9c25d2b8-22a1-4c2e-b495-683c591bf620 req-6d2f0698-7f1d-4ed7-b82c-4c6c123a54e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Oct 04 23:03:59.751083 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4054/7998] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 4 23:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 23:04:00.380710 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:04:00.381274 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:04:00.388496 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:00.389030 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:00.389485 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:00.390199 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:00.390684 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:00.391143 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:00.422365 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:00.422890 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:00.423350 n-d-851029-13 devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:00.423810 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lazy-loading 'fault' on Instance uuid 4c814993-a00e-49ea-b469-67b2df0909a8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 23:04:00.466171 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a8e6b80642421ba16eb6d43c6d248c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d15a93e9594ee1b2c6db1d944fcb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 23:04:00.473959 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9a514f0-30f5-498e-aec0-0737c895be72 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 200 len: 1338 microversion: 2.1 time: 0.097830 Oct 04 23:04:00.474539 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3945/7999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:04:00 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 23:04:01.499069 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:04:01.499795 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] [instance: 4c814993-a00e-49ea-b469-67b2df0909a8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 23:04:01.506505 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:01.507007 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:01.507448 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:01.508130 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Acquiring lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 23:04:01.508587 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 23:04:01.509009 n-d-851029-13 devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Lock "53a07c22-f558-466a-be6a-02b63f0f6ed3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 23:04:01.524401 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] HTTP exception thrown: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Request method failure captured: Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: request: GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 HTTP/1.1 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Accept: application/json Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Accept-Encoding: identity Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Connection: close Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Content-Length: 0 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Content-Type: application/json Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Host: 10.222.0.36 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: Openstack-System-Scope: None Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: User-Agent: python-urllib3/1.26.12 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Auth-Token: gAAAAABjPLqMd6_cEEG27iWg3Lmi5ctIcmKZ_bEmi7gpHAfs6CrZ8YC508dfuzBkbsa9RcuY32pRtX6QSCZ4EEGdgQ60nN-ourIl3ZUtrjdGJKIv_48FfO8sG1xTIxDyDibl2zPNZ6LtZY_ySBLGXPdK6lcN_sNst-s3Gqy5kimU4lkoyWC_hGo Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Id: None Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Domain-Name: None Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Identity-Status: Confirmed Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Is-Admin-Project: True Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Id: default Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Domain-Name: Default Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Id: d7d15a93e9594ee1b2c6db1d944fcb31 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Project-Name: tempest-TestSnapshotPattern-1893135095 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Role: member,reader Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Roles: member,reader Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7d15a93e9594ee1b2c6db1d944fcb31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant: tempest-TestSnapshotPattern-1893135095 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Id: d7d15a93e9594ee1b2c6db1d944fcb31 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-Tenant-Name: tempest-TestSnapshotPattern-1893135095 Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-User: tempest-TestSnapshotPattern-1893135095-project Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Id: default Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Domain-Name: Default Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Id: 27a8e6b80642421ba16eb6d43c6d248c Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: X-User-Name: tempest-TestSnapshotPattern-1893135095-project Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: method: > Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: exception: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: action_args: {'id': '4c814993-a00e-49ea-b469-67b2df0909a8'} Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 23:04:01.526025 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: ERROR nova.api.openstack.wsgi Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Returning 404 to user: Instance 4c814993-a00e-49ea-b469-67b2df0909a8 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33b071e5-3a02-4f51-b978-fde87dbd366b tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8" status: 404 len: 111 microversion: 2.1 time: 0.033681 Oct 04 23:04:01.536508 n-d-851029-13 devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4055/8000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 4 23:04:01 2022] GET /compute/v2.1/servers/4c814993-a00e-49ea-b469-67b2df0909a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 23:04:01.748591 n-d-851029-13 devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-309afdf0-9f7d-4500-b893-44c8455b86c0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] Calling method '.version_select at 0x7f54f4f8e430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 23:04:01.848226 n-d-851029-13 devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-309afdf0-9f7d-4500-b893-44c8455b86c0 tempest-TestSnapshotPattern-1893135095 tempest-TestSnapshotPattern-1893135095-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-847660906" status: 202 len: 0 microversion: 2.1 time: 0.103758 Oct 04 23:04:01.848911 n-d-851029-13 devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3946/8001] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 4 23:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-847660906 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)